Jr. Software Platform Engineer

CI/CD, DevOps, and Automated Delivery (Primary Focus)

• Establish and maintain CI/CD pipeline development, deployment, and testing for data workflows using Azure DevOps or GitHub Actions.

• Implement Git-based source control practices for data engineering assets (ADF pipelines, Databricks notebooks/jobs, SQL scripts), including branching and release management across environments.

• Automate deployments with validation and rollback strategies and set up monitoring/alerting for pipeline and platform health.

• Build and maintain YAML-based pipelines and standardized build/deploy patterns (e.g., reusable templates, triggers, approvals).

• Ensure production deployments follow required change governance and audit-friendly release controls.

Data Engineering & ETL/ELT Pipelines (ADF + Databricks)

• Architect, build, and maintain ETL/ELT pipelines using Azure Data Factory and Azure Databricks (PySpark, SQL, Delta Lake).

• Optimize ingestion, transformation, and storage patterns for performance, scalability, reliability, and cost efficiency.

• Implement orchestration standards, error handling, retries, and operational guardrails to meet SLA/SLO expectations.

• Develop robust transformations/aggregations to support downstream analytics and reporting needs.

Azure Platform Operations & Reliability

• Support administration and optimization of core Azure data services used by the platform (e.g., ADF, Databricks, ADLS, Azure SQL and/or Synapse where applicable).

• Monitor platform health, performance, and cost usage; implement automation to improve efficiency and reliability.

Data Governance, Security & Compliance

• Implement data access controls, auditing, and security best practices using Azure-native capabilities (e.g., RBAC, secrets management, and governance tooling such as Purview or equivalent where applicable).

Knowledge, Skills and Abilities

Education

• Preferably Graduate in Computer Applications / Computer Science.

• 2-4 years relevant experience

Knowledge and skills (general and technical)

• Deep hands-on expertise in Azure Data Factory (ADF) and Azure Databricks (PySpark/SQL/Delta Lake).
• Strong coding skills in SQL and Python/PySpark, including performance tuning and operational troubleshooting.
• Proven experience implementing CI/CD pipelines and DevOps best practices for data engineering deployments using Azure DevOps or GitHub Actions.
• At least 2+ years in Azure-based environments

Preferred / Nice to Have

• Familiarity with enterprise DevOps delivery standards for Azure DevOps pipelines (build/deploy pipeline patterns and operational steps).
• Microsoft Certified: Azure Data Engineer Associate preferred (Azure Solutions Architect Expert a plus).