We are seeking an experienced Data Engineer (PySpark) to design, build, optimize, and maintain scalable data pipelines for production environments. The role requires strong hands-on experience in big data processing, pipeline optimization, and deployment using modern data engineering tools and frameworks.
Key Responsibilities
Design, develop, and maintain robust, scalable data pipelines using Python and PySpark
Perform data ingestion, transformation, cleansing, and validation across structured and unstructured datasets
Conduct Exploratory Data Analysis (EDA) to identify data patterns, anomalies, and quality issues
Apply data imputation techniques, data linking, and cleansing to ensure high data quality
Implement feature engineering pipelines to support analytics and downstream use cases
Optimize Spark jobs for performance, scalability, and cost efficiency
Deploy and tune production-grade data pipelines, ensuring reliability and performance
Automate workflows using Apache Airflow and/or Jenkins
Collaborate with cross-functional teams to integrate data solutions into production systems
Write and maintain unit tests to ensure code quality and reliability
Manage source code, CI/CD, and deployments using Git, GitHub, and GitHub Actions
Data Engineer (PySpark) • Abu Dhabi, United Arab Emirates
As a Business Data Engineer you will provide technical support for Power BI and SharePoint within Boskalis Nederland.You will work closely with our Netherlands-based team and support us in developi... أظهر المزيد
Join a forward-thinking cloud services company that is transforming the digital landscape.This role offers an exciting opportunity to work with a passionate team dedicated to delivering tailored cl... أظهر المزيد
ClearPeaks is seeking a Data Engineer in Abu Dhabi to develop and manage data pipelines while utilizing orchestration tools such as Airflow and CI/CD practices.The ideal candidate has a degree in S... أظهر المزيد
A technology solutions provider in Abu Dhabi is seeking a Databricks Data Platform Engineer to design and build scalable data pipelines on Azure Databricks.The ideal candidate will have 5+ years of... أظهر المزيد
A leading tech super app in the UAE is seeking a Data Engineer to build a centralized data lake and develop data processing pipelines using GCP services.The ideal candidate has experience in PySpar... أظهر المزيد
Architect batchstream pipelines (Airflow Kafka dbt) for diverse structured and unstructured marked data.Provide reusable SDKs in Python and Go for internal data producers.Implement and tune S3 colu... أظهر المزيد
We are an exclusive cloud services company, transforming the world with digital technology.We excel in serving customers with experienced, certified professional cloud talent.We are passionate abou... أظهر المزيد
A leading technology-driven organization in the UAE is seeking skilled Data Engineers to support the design and delivery of enterprise-grade data solutions.The role involves building scalable data ... أظهر المزيد
Bachelor’s degree in computer science, Engineering, Information Systems, or related field is necessary.Should have at least 8 years of experience in data engineering.Should possess at least 4 years... أظهر المزيد
A dynamic tech company in Abu Dhabi is seeking a Software Developer specialized in Azure Data Factory and big data technologies.The role requires 5-8 years of experience in software development, wi... أظهر المزيد
A leading technology solutions provider in the United Arab Emirates seeks a highly skilled Azure Data Engineer.The ideal candidate will design and maintain scalable ETL/ELT pipelines, utilizing tec... أظهر المزيد
A leading technology firm is seeking a Senior Data Engineer in Abu Dhabi to develop and optimize scalable data pipelines for investment analytics.The candidate will utilize expertise in Databricks ... أظهر المزيد
A leading data engineering firm in Abu Dhabi seeks a Senior Data Engineer with 7-10 years of experience.The role involves designing and maintaining scalable data pipelines and optimizing ETL/ELT pr... أظهر المزيد
Presight is seeking a Senior Data Engineer in Abu Dhabi to build and maintain data infrastructure.The role involves designing data pipelines, collaborating with teams for data quality, and ensuring... أظهر المزيد
This role supports the delivery of enterprise data platforms and analytics pipelines within a cloud-based environment for a government enterprise.Support batch and streaming data processing.Collabo... أظهر المزيد
We are looking for a highly skilled Azure Data Engineer for an engagement to build scalable, production-ready data solutions.The ideal candidate will have strong hands‑on experience with Python, Py... أظهر المزيد
We are seeking a Senior Data Engineer with strong hands‑on expertise in Databricks, PySpark, and cloud‑based data platforms to support the development, migration, and optimization of our enterprise... أظهر المزيد
This is a production engineering role.As a Senior Data Engineer at SentraAI you will build, migrate and operate data pipelines at enterprise scale involving vast numbers of source systems, hundreds... أظهر المزيد
Edison Smart is partnered with an Abu Dhabi-based digital bank & we are looking for a Senior Data Engineer to join their data team and take full ownership of designing, building and scaling data in... أظهر المزيد
Job Description: Data Warehouse and Machine Learning Engineer We are seeking a highly skilled and experienced Data Warehouse and Machine Learning Engineer to join our this role you will be respons... أظهر المزيد
