Team Lead Data Engineer

We are seeking a highly skilled and proactive Data Engineer to join our team. The ideal candidate will have strong hands-on expertise with AWS cloud services, Databricks, Apache Spark, Python, and SQL, along with excellent communication and stakeholder engagement skills. You will play a key role in designing, building, and optimizing data pipelines and analytics solutions that support critical business initiatives.Key Responsibilities

• Design, develop, and maintain scalable data pipelines and transformation workflows using Databricks and Spark.
• Build and optimize ETL/ELT processes to ingest, cleanse, and prepare large datasets.
• Work with AWS services such as S3, Lambda, IAM, ECS and CloudWatch to support data architecture and operational needs.
• Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and translate them into technical solutions.
• Ensure data quality, reliability, and performance across all data systems.
• Implement and enforce best practices for coding, version control, CI/CD, and environment management.
• Monitor and troubleshoot data pipelines, ensuring high availability and timely delivery.
• Contribute to architectural decisions, documentation, and process improvements.