As a Data Engineer, your main goal is to build and maintain the systems that process and store data for the Events & Exhibitions ecosystem. You will take scattered, vendor-specific data (from registration systems, apps, marketing tools) and transform it into a unified, AI-ready dataset using a Medallion Architecture on Azure.
Think of it as organizing raw data into a structured pipeline that’s ready for analysis and machine learning.
Requirements
1. Data Ingestion & API Integration (Bronze Layer)
2. Transformation & Modeling (Silver & Gold Layers)
3. Infrastructure & Performance Optimization
4. Business Enablement
Technical Requirements
Benefits
Data Engineer • Dubai, Dubai, AE
The ENTERTAINER is a leading digital company dedicated to adding value for consumers by bringing them the best incentive offers globally.We are a 100 digital datadriven tech company providing first... أظهر المزيد
Role: Senior Lead Software Engineer.Strong functional knowledge/Experience of the domain Banking.Develop and optimize data pipelines using Spark Hive and Python on Cloudera.Develop real time data w... أظهر المزيد
Design develop and maintain robust ETL pipelines using Data Bricks and Azure Data Factory.Transform raw data into actionable insights to support business decision-making.Manage and optimize data st... أظهر المزيد
We are seeking a highly skilled Data Engineer with deep expertise in.Cloudera Data Platform (CDP) to join our data engineering team.As a Data Engineer you will be responsible for designing developi... أظهر المزيد
Artefact is a new generation of data service providers specialising in data consulting and datadriven digital marketing.It is dedicated to transforming data into business impact across the entire v... أظهر المزيد
Build robust observable data pipelines that power research and production AI.Success means high pipeline reliability (on-time SLAs) strong data quality (validation & lineage) and enabling fast expe... أظهر المزيد
Pyspark JD:ResponsibilitiesData Pipeline Development: Design develop and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform ensuring data integrity and... أظهر المزيد
Data Engineer Finance Systems.OFSAA Financial Consolidation and Regulatory Reporting.The ideal candidate will have expertise in.ETL processes data modeling and big data technologies.Hadoop HDFS... أظهر المزيد
Coders Connect is working with a fast-scaling company building a modern data foundation across regions and we re on the hunt for a Lead Data Engineer to own architecture pipeline design and s... أظهر المزيد
Architect batchstream pipelines (Airflow Kafka dbt) for diverse structured and unstructured marked data.Provide reusable SDKs in Python and Go for internal data producers.Implement and tune S3 colu... أظهر المزيد
Data Pipeline Development & Infrastructure.Design build and maintain .Data Solutions & AI-Driven Applications.ML recommenders search functionality and AI-enhanced features.Commerce-rel... أظهر المزيد
Hands on experience in work with bigdata platforms and relatedprogramming languages (e.Linux Python PySpark GITJenkins).Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Wareh... أظهر المزيد
Were looking for a Data Engineer whos passionate about building reliable scalable and cost-efficient data systems.Youll work with a modern stack Kafka Google Cloud Platform (GCP) AWS to design and ... أظهر المزيد
Job Title: Senior AWS Data Engineer / Data Platform Engineer.We are seeking a highly experienced.The ideal candidate will have deep hands-on experience with AWS data services batch and streaming da... أظهر المزيد
Apache Spark Databricks or equivalent bigdata frameworks.Hands on expertise with streaming and messaging systems such as.Apache Kafka (publish subscribe architecture) Confluent Cloud.Deep understan... أظهر المزيد
Data Engineer (Microsoft Fabric Azure Databricks).Azure-based data platforms and Microsoft Fabric.The ideal candidate will have strong skills in.PySpark SQL and modern data engineering frameworks... أظهر المزيد
At SentraAI Data Engineers work on.The pipelines you build will be used monitored and relied upon.When they break you are expected to help fix them.If you are not ready to take responsibility for p... أظهر المزيد
We are seeking an experienced Data Engineer (PySpark) to design build optimize and maintain scalable data pipelines for production environments.The role requires strong hands-on experience in big d... أظهر المزيد
We are actively looking for Data Engineer for a permanent position in Dubai United Arab Emirates.This exciting opportunity is with a wellestablished global IT service provider known for its excelle... أظهر المزيد
We are seeking an experienced Python Developer with a strong background in ERP data migration and integration preferably within Oracle or Microsoft Dynamics environments.The ideal candidate will de... أظهر المزيد
