This role will work cross-functionally with Product, Engineering, and Program teams to ensure QA readiness, stakeholder visibility, and continuous process improvement. The ideal candidate is highly organized, data-driven, comfortable operating in ambiguity, and relentlessly focused on delivering results.
Key job responsibilities
• Own stakeholder management for assigned business lines — serve as primary QA coordination point, manage expectations, provide status updates, and drive alignment
• Manage the bug intake pipeline end-to-end: triage, categorize, prioritize, and route defects; ensure tickets are SLA-compliant, well-documented, and properly closed
• Drive bug verification workflows, ensuring defects are validated and reproducible before escalation to engineering
• Generate weekly/monthly QA reports for leadership covering defect trends, escape rates, test coverage, and cycle time metrics
• Analyze data to surface systemic gaps, recurring patterns, and areas of risk across supported business lines
• Build and maintain dashboards providing real-time visibility into QA health and program readiness
• Proactively identify gaps in test coverage, process adherence, and handoffs; recommend and implement improvements
• Support launch readiness, ad-hoc testing programs, and peak event preparations through capacity tracking and milestone coordination
• Document and standardize SOPs for QA account management processes
• Contribute to WBR/MBR content and drive operational review discussions for QA metrics
About the team
Optima team in Rufus and Alexa Shopping Org strives to become the most reliable source for dataset generation and annotations. We work in collaboration with Shopping feature teams to enhance customer experience (CX) quality across shopping features, devices, and locales. Our primary focus lies in handling annotations for training, measuring, and improving Artificial Intelligence (AI) and Large Language Models (LLMs), enabling Amazon to deliver a superior shopping experience to customers worldwide. Our mission is to empower Amazon's LLMs through Reinforcement Learning from Human Feedback (RLHF) across various categories at high speed. We aspire to provide an end-to-end data solution for the LLM lifecycle, leveraging cutting-edge technology alongside our operational excellence. By joining us, you will play a pivotal role in shaping the future of the shopping experience for customers worldwide.
- 3+ years of program or project management experience
- 3+ years of working cross functionally with tech and non-tech teams experience
- 3+ years of defining and implementing process improvement initiatives using data and metrics experience
- Bachelor's degree
- Knowledge of Excel (Pivot Tables, VLookUps) at an advanced level and SQL
- Experience defining program requirements and using data and metrics to determine improvements
- 3+ years of driving end to end delivery, and communicating results to senior leadership experience
- 3+ years of driving process improvements experience
- Experience in stakeholder management, dealing with multiple stakeholders at varied levels of the organization
- Experience building processes, project management, and schedules
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.