Title : Data Engineer
Location : Dubai, UAE
Duration : 6 months extendable
Key Responsibilities :
- Collaborate with business lines to understand data ingestion and engineering requirements.
- Translate requirements into cloud / on-premise data engineering designs and develop Databricks and Azure
Data Factory (ADF) pipelines.
Strong hands-on skills with at least 3 years of experience in developing Databricks and ADF pipelines.Implement medallion architecture principles (three-layered data zones) in Azure Data Lake.Work collaboratively within multi-disciplinary Agile teams, adopting Agile methodology and tools.Scale and code applications across multi-cloud environments integrated with on-premise systems.Proactively identify and remediate potential operational risks in collaboration with the platform lead.Qualifications & Experience :
Minimum Qualification :
Bachelor's degree in Computer Science, Information Technology, Engineering(Computer / Telecommunication), or equivalent.
Experience :5–7 years of experience in data engineering and transformation on Cloud.3+ years of strong hands-on experience in Azure Data Engineering, Databricks.Expertise in supporting and developing enterprise-level data warehouse workloads.Proficiency in developing and deploying workloads using PySpark on distributed computing environments.Experience with cloud deployment, preferably on Microsoft Azure.Experience in platform and application monitoring using cloud-native tools.Ability to implement proactive and reactive self-healing solutions for applications.#J-18808-Ljbffr