DataOps Consultant, Lakehouse Support

Project description We are currently seeking a highly skilled and motivated individual to join our Research & Analytics IT Production Management Support team (in Middle East). The ideal candidate should possess a technical background with 5-7 years of experience in production support and be ITIL certified. It is essential for the candidate to have a solid understanding of incident, problem, and change management processes. In this role, the successful candidate will play a vital part in ensuring the smooth operation of our production environment leveraging their technical and non-technical skills. Responsibilities Own and manage L2 incident resolution for data platforms Perform deep operational diagnostics across data pipelines (batch/stream) Coordinate resolution across platform engineering, Data Engineers and data domain teams Ensure correct usage of ITSM tools (e.g., ServiceNow) for incident tracking and lifecycle management Leverage metadata and documentation for troubleshooting and root cause analysis Maintain clear ownership, escalation paths and communication during incidents Reduce incident noise and recurring issues through structured problem management Skills Must have 5y+ hands-on experience in production support, with a proven track record of successfully managing complex environments in investment banks/BFSI companies. ITIL certification showcasing knowledge and expertise in incident, problem and change management processes. Technical background with a profound understanding of ETL/ELT processes for data transformation. Proficiency in utilizing PySpark for distributed data processing and analytics. Advanced expertise in SQL for proficient querying and manipulation of data, guaranteeing accurate and reliable results. Fundamental proficiency in Python debugging of data transformation issues and scripting automation. Familiarity with the financial markets, related data and applications, providing a contextual understanding of the industry. Bachelor's degree in computer science or related technical discipline, providing a solid foundation for understanding complex technical concepts. Excellent problem-solving skills with a proactive attitude towards incident resolution and issue identification. Comprehensive understanding of REST API, enabling seamless integration between internal and external systems. Expertise in relevant areas such as data management, data engineering, or financial systems. Hands-on experience managing big data platform like Palantir Foundry, Databricks. Proficiency in managing batches in scheduling tools such as StoneBranch, Control-M, ActiveBatch, Autosys. Proficiency in managing observability tools like Dynatrace/AppDynamics/Geneos. Expertise in workflow automation applications and tools such as KNIME Analytics, PowerAutomate, Altryx, Informatica) Experience in managing BI Platforms like MicroStrategy, PowerBI, QlikView, Tableau. Strong background in working with agile environments, participating in sprints and adhering to CI/CD practices. Effective communication skills, both written and verbal, enabling effective collaboration and conveyance of ideas and solutions. Nice to have Palantir (Foundry) — DQC setup in workshop, diagnostics of build failures and data pipelines Monte Carlo — data quality alert management and observability Azure DevOps — repository management, CI/CD Working knowledge of investment management data: portfolio terminology (maturity date, value date), trade lifecycle, market and risk data; familiarity with domain systems (Optima, Cardia) Understanding of data lineage, observability and metadata-driven operations concepts Exposure to enterprise-scale data platforms and batch orchestration / data workflow tools Other Languages English: C1 Advanced Seniority Senior