Talent.com
DeepSource Technologies
L1 Data Engineer - RemoteDeepSource Technologies • Dubai, Dubai, AE
L1 Data Engineer - Remote

L1 Data Engineer - Remote

DeepSource Technologies • Dubai, Dubai, AE
3 منذ أيام
نوع الوظيفة
  • Quick Apply
الوصف الوظيفي

We are looking for a motivated and technically solid L1 Data Engineer to join our growing Data & Analytics team. In this role, you will be responsible for designing, building, and maintaining the data architecture and infrastructure that supports our organization's data strategy. You will work hands-on to develop, test, and deploy reliable data solutions — ensuring pipelines are scalable, efficient, and aligned with business requirements.

This is an ideal opportunity for a data professional who is eager to deepen their expertise in cloud-native data platforms, particularly within the Microsoft Azure and Databricks ecosystem, and who thrives in a collaborative, fast-paced environment.

KEY RESPONSIBILITIES

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows to support business intelligence and analytics use cases.

• Build and optimize data ingestion processes using Azure Data Factory and Databricks, ensuring data quality and consistency across all layers of the data platform.

• Transform and process large datasets using PySpark and Python, applying best practices for performance and maintainability.

• Write and optimize complex SQL queries to support analytical reporting and data validation requirements.

• Collaborate with data architects and senior engineers to implement and maintain data models aligned with organizational standards.

• Monitor, troubleshoot, and resolve pipeline failures and data quality issues, applying root-cause analysis to prevent recurrence.

• Contribute to documentation of data pipelines, data dictionaries, and engineering standards.

• Support the team in exploring and evaluating new tools and approaches to continuously improve the data infrastructure.

Requirements

  • 2+ years of professional experience in a Data Engineering or closely related role.
  • Strong proficiency in Python for data processing, transformation, and automation tasks.
  • Hands-on experience with Pandas for data manipulation and PySpark for distributed data processing.
  • Practical experience with Databricks, including notebook development, clusters, and job orchestration.
  • Experience building and managing data pipelines with Azure Data Factory.
  • Working knowledge of Azure Synapse Analytics, particularly Spark pool integration.
  • Solid SQL skills, including query writing, optimization, and performance tuning.
  • Familiarity with data engineering principles including incremental loading, data lake architecture, and Delta Lake.
  • Understanding of data governance and security concepts within a cloud data platform.

NICE TO HAVE

  • Experience with SQL Server migration projects, including schema conversion and data movement.
  • Exposure to Terraform for Azure infrastructure provisioning and management.
  • Familiarity with CI/CD practices applied to data engineering workflows.
  • Experience with Delta Sharing or Lakehouse Federation concepts.

CERTIFICATION REQUIREMENT

  • Candidates are expected to hold or be actively working toward the Databricks Certified Data Engineer Associate certification. This certification validates foundational knowledge across the following domains:
  • Databricks Lakehouse Platform architecture and capabilities
  • ETL and ELT workflows using Spark SQL and PySpark
  • Incremental data processing and structured streaming
  • Production pipeline development and orchestration
  • Data governance and security within the Databricks environment
إنشاء تنبيه وظيفي لهذا البحث

L1 Data Engineer - Remote • Dubai, Dubai, AE

الوظائف المماثلة

Sr Data Engineer, 3866

MindtelDubai, Dubai, UAE

Design develop and maintain robust ETL pipelines using Data Bricks and Azure Data Factory.Transform raw data into actionable insights to support business decision-making.Manage and optimize data st... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Data Engineer

Entertainer FzDubai, Dubai, UAE

The ENTERTAINER is a leading digital company dedicated to adding value for consumers by bringing them the best incentive offers globally.We are a 100 digital datadriven tech company providing first... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Data Engineer - ETL- Banking

VAM SystemsDubai, Dubai, UAE

Skill set and terms & conditions.Data models with good knowhow of various data modelling techniques like star schema snow flake schema dimension modelling etc.Expert in Database stored procedur... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

VirtusaDubai, Dubai, UAE

Job DescriptionSenior Data Engineer with strong expertise in Informatica DEI EDC CDC API development and cloud platforms to support scalable secure data integration in a telecom environmentKey Resp... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Big Data Engineer

VirtusaDubai, Dubai, UAE

Role: Senior Lead Software Engineer.Strong functional knowledge/Experience of the domain Banking.Develop and optimize data pipelines using Spark Hive and Python on Cloudera.Develop real time data w... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Data Engineer - Pyspark

VirtusaDubai, Dubai, UAE

About the RoleWe are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team.As a Data Engineer you will be resp... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Data Engineer

Talent Bridge HR Consultancy DubaiDubai, Dubai, UAE

Build robust observable data pipelines that power research and production AI.Success means high pipeline reliability (on-time SLAs) strong data quality (validation & lineage) and enabling fast expe... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Data Engineer

ArtefactDubai, Dubai, UAE

Artefact is a new generation of data service providers specialising in data consulting and datadriven digital marketing.It is dedicated to transforming data into business impact across the entire v... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Data Engineer PySpark

VirtusaDubai, Dubai, UAE

Pyspark JD:ResponsibilitiesData Pipeline Development: Design develop and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform ensuring data integrity and... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Data Engineer

Iconic IT Consulting ServicesDubai, Dubai, UAE

Data Engineer Finance Systems.OFSAA Financial Consolidation and Regulatory Reporting.The ideal candidate will have expertise in.ETL processes data modeling and big data technologies.Hadoop HDFS... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Lead Data Engineer

Coders ConnectDubai, Dubai, UAE

Coders Connect is working with a fast-scaling company building a modern data foundation across regions and we re on the hunt for a Lead Data Engineer to own architecture pipeline design and s... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Data Platform Engineer

BlackStone eITDubai, Dubai, AE
Quick Apply

BlackStone eIT is looking for a skilled.You will be responsible for designing, building, and maintaining scalable data platforms that support the company’s data processing and analytics needs.In th... أظهر المزيد

Senior Data Engineer (MLAI)

Sana CommerceDubai, Dubai, UAE

Collaborating with Data Scientists and ML Engineers to understand.Leveraging distributed processing frameworks (e.Spark Databricks Azure Synapse) for.Data Engineer working with Azure and Databricks... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

Sana CommerceDubai, Dubai, UAE

Data Pipeline Development & Infrastructure.Design build and maintain .Data Solutions & AI-Driven Applications.ML recommenders search functionality and AI-enhanced features.Commerce-rel... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

BHFTDubai, Dubai, UAE

Architect batchstream pipelines (Airflow Kafka dbt) for diverse structured and unstructured marked data.Provide reusable SDKs in Python and Go for internal data producers.Implement and tune S3 colu... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior AWS Data Engineer Data Platform Engineer

NorthBay SolutionsDubai, Dubai, UAE

Job Title: Senior AWS Data Engineer / Data Platform Engineer.We are seeking a highly experienced.The ideal candidate will have deep hands-on experience with AWS data services batch and streaming da... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Data Engineer

SentraAIDubai, Dubai, UAE

At SentraAI Data Engineers work on.The pipelines you build will be used monitored and relied upon.When they break you are expected to help fix them.If you are not ready to take responsibility for p... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Data Engineer (PySpark)

Black Pearl ConsultDubai, Dubai, UAE

We are seeking an experienced Data Engineer (PySpark) to design build optimize and maintain scalable data pipelines for production environments.The role requires strong hands-on experience in big d... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Data Engineer

Zone IT SolutionsDubai, Dubai, UAE

We are actively looking for Data Engineer for a permanent position in Dubai United Arab Emirates.This exciting opportunity is with a wellestablished global IT service provider known for its excelle... أظهر المزيد

 • عَرْضٌ مُرَوَّجٌ له

Senior Data Engineer

NorthBay SolutionsDubai, Dubai, UAE

We are seeking a highly skilled.The ideal candidate will have deep expertise in building and optimizing scalable data pipelines working with large datasets and leveraging modern cloud-based technol... أظهر المزيد