Data Engineering Lead Analyst - HIH - Evernorth

The job profile for this position is HIH - Data Engineering Lead Analyst, which is a Band 3 Senior Contributor Career Track Role.

Excited to grow your career?

We value our talented employees, and whenever possible strive to help one of our associates grow professionally before recruiting new talent to our open positions. If you think the open position you see is right for you, we encourage you to apply!

Our people make all the difference in our success.

Software Engineering Lead Analyst

Position Summary:

We value our talented employees and strive to help them grow professionally before recruiting externally. If you believe this role is the right fit, we encourage you to apply! Our people make all the difference in our success.

As a Data Engineering Lead Analyst, you will join a team transforming healthcare and improving the lives of millions of members we serve. We leverage cutting-edge Artificial Intelligence (AI) and Machine Learning (ML) algorithms to develop solutions for automated document processing and intelligent customer service platforms.

We are looking for an experienced data engineer with strong expertise in building ETL data pipelines using Databricks. You will play a key role in designing and implementing ETL data pipelines, and integrating advanced analytics capabilities using modern big data technologies.

• Design, develop, and maintain ETL data pipelines ensuring reliability, scalability, and performance.
• Implement data quality checks and monitoring to ensure data integrity.
• Monitor and troubleshoot Databricks jobs, clusters, and resource utilization
• Implement security best practices for data access, encryption, and compliance.
• Integrate Databricks with external data sources (e.g., APIs, databases, cloud storage).
• Build and maintain data catalogs and metadata management solutions.
• Support real-time and batch data processing using Spark Structured Streaming.
• Collaborate with AI/ML teams to integrate data-driven solutions into production systems.
• Manage and optimize cloud-based services (AWS preferred) for data storage, compute, and orchestration.

Desired Qualifications

• Experience: 6–10 years in software engineering with a strong focus on data engineering.
• Programming: Proficiency in Scala or Python;
• Big Data & Analytics: Hands-on experience with Apache Spark, Databricks, and distributed data processing.
• ETL Development: Proven experience designing and implementing ETL pipelines for large-scale data systems.
• Databases:
• Relational: MySQL, PostgreSQL
• NoSQL: DynamoDB, MongoDB, Cassandra
• Caching: Redis, Memcached
• CI/CD: Familiarity with modern DevOps practices and tools.
• Cloud: Experience with AWS (preferred) or other major cloud platforms.
• Strong problem-solving skills with the ability to troubleshoot and optimize complex systems.
• Excellent communication and collaboration skills.

Preffered Qualifications

• Advanced proficiency with Snowflake and Databricks
• Strong knowledge of cloud architecture.

Please note that you must meet our posting guidelines to be eligible for consideration.  Policy can be reviewed at this link.