Talent.com
Emaratech
Senior Data EngineerEmaratech • Dubai, Dubai, AE
Senior Data Engineer

Senior Data Engineer

Emaratech • Dubai, Dubai, AE
2 منذ أيام
نوع الوظيفة
  • Quick Apply
الوصف الوظيفي

About the Role

We are seeking a highly skilled and experienced Data Lake Cloud Engineer with a proven track record of designing, implementing, and maintaining large-scale cloud-based data lake platforms. This role requires a professional who can take ownership of our current data lake ecosystem, optimize its performance, and drive future enhancements with minimal oversight. The ideal candidate will have at least 5 years of hands-on experience in building enterprise-grade data lakes, strong cloud architecture expertise, and the ability to work with cutting-edge data ingestion, processing, and analytics tools.

Key Responsibilities

  • Take ownership of the existing enterprise data lake platform, ensuring scalability, reliability, and performance.
  • Lead the design, architecture, and implementation of cloud-native data lake solutions and integrations.
  • Manage and optimize data ingestion pipelines on Oracle OCI, using tools such as Apache NiFi, Kafka, Batch Processing of data, Data captures, and or CSV.
  • Design and implement pipelines for network data ingestion and file formats (e.g., Parquet, Avro, OCR, etc.), ensuring efficient storage, processing, and retrieval.
  • Build, configure, and tune query engines such as Trino (Presto), Spark, and Hive for efficient analytics and reporting.
  • Implement and maintain metadata management, data governance, and security frameworks.
  • Monitor and troubleshoot system performance, ensuring SLAs are met for ingestion, processing, and query workloads.
  • Automate platform deployment, monitoring, and maintenance with Infrastructure-as-Code (Terraform, CloudFormation, etc.).
  • Collaborate with data engineers, analysts, and business teams to understand data requirements and deliver solutions that maximize data accessibility and usability.
  • Keep the data platform up to date with the latest open-source and cloud-agnostic technologies, implementing upgrades and enhancements where needed.

Requirements

5+ years of proven, hands-on experience implementing and managing large-scale data lakes in the cloud (OCI). Strong expertise in:

  • Data ingestion & orchestration: Apache NiFi, Apache Kafka, CSV, and others
  • Data processing frameworks: Apache Spark, PySpark, Trino (Presto), Hive, Flink.
  • Storage & lakehouse architectures: Delta Lake, Apache Hudi, Iceberg, and cloud-native object storage (S3).
  • Query & analytics tools: Trino/Presto, SparkSQL, Metabase, or Apache Superset.
  • Experience with data lake file formats such as Apache Parquet, Avro, ORC, CSV, etc. including ingestion, parsing, and analytics within a data lake.
  • Solid understanding of data governance, lineage, cataloging, and security frameworks (Apache Atlas).
  • Experience with CI/CD and IaC (ArgoCD, Terraform, Ansible) for automated deployments.
  • Hands-on experience with cloud security best practices, including IAM, encryption, and network security.
  • Strong proficiency in Python or Java for data engineering and automation tasks.
  • Proven ability to work independently, quickly understand existing environments, and deliver results without extensive training.

Preferred Skills

  • Exposure to machine learning workflows integrated with data lakes.
  • Experience with real-time streaming data pipelines.
  • Familiarity with containerization and orchestration (Docker, Kubernetes).
  • Knowledge of cost optimization strategies in cloud-based data platforms.
إنشاء تنبيه وظيفي لهذا البحث

Senior Data Engineer • Dubai, Dubai, AE

الوظائف المماثلة

Senior Data Engineer

BHFTsharjah, sharjah emirate, United Arab Emirates

Architect batchstream pipelines (Airflow Kafka dbt) for diverse structured and unstructured marked data.Provide reusable SDKs in Python and Go for internal data producers.Implement and tune S3 colu... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer (PySpark)

GSSTech Groupdubai, dubai, United Arab Emirates

Job Title: Data Engineer (PySpark).We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team.As a Data Engi... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

GSS Tech Groupdubai, dubai, United Arab Emirates

We are seeking a highly skilled.The ideal candidate will play a critical role in designing, building, and optimizing scalable data pipelines and enabling advanced analytics and machine learning ini... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

Virtusadubai, dubai, United Arab Emirates

Senior Data Engineer with strong expertise in Informatica DEI EDC CDC API development and cloud platforms to support scalable secure data integration in a telecom environment.Design and develop dat... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Platform Engineer

Ziinadubai, dubai, United Arab Emirates

Ziina is looking for a Senior Data Platform Engineer to join our team.This role is an exciting opportunity to build the foundations of our data platform from the ground up — the pipelines, warehous... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

Keyrockdubai, dubai, United Arab Emirates

Since our beginnings in 2017, we've grown to be a leading change‑maker in the digital asset space, renowned for our partnerships and innovation.Today, we partner with over 250 team members around t... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

Global Software Solutions Groupdubai, dubai, United Arab Emirates

We are seeking a highly skilled.The ideal candidate will play a critical role in designing, building, and optimizing scalable data pipelines and enabling advanced analytics and machine learning ini... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

Searchability®dubai, dubai, United Arab Emirates

Please note – this opportunity is only open to candidates already residing in Dubai.Salary on offer Dh30,000–35,000 per month.Searchability MENA are partnered with a Global Tech Consultancy seeking... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

Sana Commercedubai, dubai, United Arab Emirates

Data Pipeline Development & Infrastructure.Data Solutions & AI-Driven Applications.ML recommenders search functionality and AI-enhanced features.Commerce-related data solutions.Collaboration & Cont... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

Moovedubai, dubai, United Arab Emirates

We are seeking a hands‑on Senior Data Engineer who can autonomously design, build, and maintain robust data pipelines that power our business decisions and AI‑driven applications.You will own data ... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer (PySpark)

Global Software Solutions Groupdubai, dubai, United Arab Emirates

Job Title: Data Engineer (PySpark).About The Role We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

Emaratechdubai, dubai, United Arab Emirates

We are seeking a highly skilled and experienced Data Lake Cloud Engineer with a proven track record of designing, implementing, and maintaining large-scale cloud-based data lake platforms.This role... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له • جديد!

Senior Data Engineer

Sokindubai, dubai, United Arab Emirates

We are looking for a Data Engineer to join our team.We are seeking a skilled and motivated Data Engineer to design, build, and maintain scalable data infrastructure that supports analytics and busi... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer (Pyspark)

Valuelabsdubai, dubai, United Arab Emirates

The Data Engineer role involves acquiring requirements, conducting EDA, ingesting required datasets, and transforming data using Big-data technologies & Feature Engineering techniques for machine l... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer RibbitZ

Tarakidubai, dubai, United Arab Emirates

Our client RibbtZ is looking for Senior Data Engineer (Cloud Analytics) to work remotely.We are seeking a highly skilled Senior Data Engineer with strong expertise in cloud-based data platforms big... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

GSSTech GroupDubai, Dubai, AE
Quick Apply

We are seeking a highly skilled .The ideal candidate will play a critical role in designing, building, and optimizing scalable data pipelines and enabling advanced analytics and machine learni... أظهر المزيد

Senior Data Engineer

SentraAIDubai, Dubai, AE
Quick Apply

As a Senior Data Engineer at SentraAI, you are responsible for designing, building, and owning production-grade data pipelines that underpin enterprise analytics, AI, and regulatory ... أظهر المزيد

Senior Data Platform Engineer

BlackStone eITdubai, dubai, United Arab Emirates

BlackStone eIT is seeking an experienced.In this role, you will ensure that our data infrastructure is scalable, reliable, and optimized to support advanced analytics and business intelligence effo... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer - Snowflake & GenAI Lead, Abu Dhabi

NorthBay Solutionsdubai, dubai, United Arab Emirates

A leading data technology company is looking for a Senior Data Engineer to join their team in Abu Dhabi.This onsite position involves designing and maintaining scalable data pipelines, implementing... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer - PySpark on CDP Pipelines

Virtusadubai, dubai, United Arab Emirates

A leading technology services provider is seeking a highly skilled Data Engineer in Dubai.The role involves designing and maintaining scalable data pipelines using PySpark on the Cloudera Data Plat... أظهر المزيد