Senior MLOps / AI Ops Engineer

Who We Are

At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses.  We are at the heart of progress; with proven expertise and a continuous flow of AI-powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people—Kyndryls—that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well-being is prioritized and your potential can thrive.

The Role

Key Responsibilities

• Design, implement, and optimize MLOps/AI Ops architectures supporting scalable AI/ML solutions.
• Build and manage cloud-native infrastructure using Azure, Kubernetes, Docker, Terraform, and CI/CD pipelines.
• Lead end-to-end AI/ML lifecycle operations, including data ingestion, model training, versioning, deployment, and monitoring.
• Implement and manage agent/model registries, automated deployment workflows, and model monitoring systems.
• Drive AI Ops capabilities, including prompt lifecycle management, RAG pipeline optimization, semantic search enhancements, vector database integration, and LLM observability.
• Establish robust monitoring, alerting, and performance tuning practices for large-scale production systems.
• Collaborate with data engineering teams to ensure efficient data pipelines and infrastructure alignment.
• Ensure high standards of security, governance, and reliability across ML/AI systems.
• Implement security best practices such as IAM, secrets management, policy-as-code, drift detection, and audit trails.
• Optimize production systems for autoscaling, resiliency, and cost efficiency.
• Evaluate emerging technologies and recommend enhancements to the AI/ML platform.

Your Future at Kyndryl
Every position at Kyndryl offers a way forward to grow your career. We have opportunities that you won’t find anywhere else, including hands-on experience, learning opportunities, and the chance to certify in all four major platforms. Whether you want to broaden your knowledge base or narrow your scope and specialize in a specific sector, you can find your opportunity here.

Who You Are

Who You Are
You’re good at what you do and possess the required experience to prove it. However, equally as important – you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused – someone who prioritizes customer success in their work. And finally, you’re open and borderless – naturally inclusive in how you work with others.

Required Skills & Expertise

• 12+ years of overall experience, with strong expertise in MLOps, AI Ops, and cloud infrastructure.
• Hands-on experience with Kubernetes, Docker, Terraform, Azure cloud, and CI/CD pipelines.
• Strong understanding of the full AI/ML lifecycle, including data engineering, model development, deployment, monitoring, and retraining.
• Experience with LLM lifecycle, prompt management, RAG frameworks, vector databases, semantic caching, and observability tools.
• Solid understanding of infrastructure-as-code, automation, and cloud-native architectures.
• Knowledge of IAM, secrets management, security policies, audit logging, and compliance frameworks.
• Proven ability in performance tuning, autoscaling, and managing large-scale distributed systems.
• Excellent communication, collaboration, and leadership skills.

Good to Have

• Experience with reliability engineering, SRE practices, and cost-optimization strategies.
• Exposure to monitoring tools and frameworks for AI/ML observability.
• Certifications in Azure, Kubernetes, DevOps, or AI/ML.

Education

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Being You

The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging — being a valued, respected, trusted member of the team — is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.

What You Can Expect

Your career with us isn’t just a job—it’s an adventure with purpose.  We offer a dynamic, hybrid-friendly culture that supports your well-being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health—because we know that when you feel your best, you do your best.
From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute—you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth.
We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in-demand skills to grow your career and achieve your ambitions with access to cutting-edge learning opportunities—from certifications with Microsoft, Google, and Amazon to coaching and hands-on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success.
We want you to thrive here—and we’re committed to helping you do just that. Ready to make an impact? Join us and help shape what’s next.

Get Referred!

If you know someone that works at Kyndryl, when asked ‘How Did You Hear About Us’ during the application process, select ‘Employee Referral’ and enter your contact's Kyndryl email address.