Job description
Data Engineer – Azure / Databricks / Delta Lake
Experience: 5–7 Years
Role Overview:
We are seeking a skilled Data Engineer with strong expertise in Azure-based data platforms, including Databricks and Delta Lake. The ideal candidate will be responsible for building, validating, and maintaining scalable data pipelines while ensuring high data quality and reliability across the data lifecycle.
Key Responsibilities:
Develop, validate, and optimize ETL/ELT pipelines using Azure Databricks, Delta Lake, and Azure Data Factory (ADF)
Perform data profiling, cleansing, and reconciliation between source and target systems
Identify and resolve data issues such as duplicates, null values, schema mismatches, and incremental load failures
Ensure data consistency and integrity across Bronze, Silver, and Gold layers in a Lakehouse architecture
Design and implement automated data quality checks, validation frameworks, and monitoring solutions
Troubleshoot data pipeline issues and support defect resolution in collaboration with cross-functional teams
Work closely with Data Engineers, BI developers, and business stakeholders to ensure accurate data delivery
Maintain data governance standards, documentation, and best practices
Required Skills:
Strong proficiency in SQL and data analysis
Hands-on experience with Azure Databricks and Delta Lake
Experience with Azure Data Factory (ADF) for pipeline orchestration
Knowledge of incremental data load strategies (CDC, watermarking, SCD)
Experience in data profiling, validation, and reconciliation techniques
Understanding of data governance and data quality frameworks collaborative environment
This job post has been translated by AI and may contain minor differences or errors.
