Bayt.com

Submitting more applications increases your chances of landing a job.

Here’s how busy the average job seeker was last month:

Opportunities viewed

Applications submitted

Keep exploring and applying to maximize your chances!

Looking for employers with a proven track record of hiring women?

Click here to explore opportunities now!
We Value Your Feedback

You are invited to participate in a survey designed to help researchers understand how best to match workers to the types of jobs they are searching for

Would You Be Likely to Participate?

If selected, we will contact you via email with further instructions and details about your participation.

You will receive a $7 payout for answering the survey.


User unblocked successfully
https://bayt.page.link/ymR8S71HUWE1hxKz9
Back to the job results

AI Application Test Enginee (m/f/d)

16 days ago 2026/08/13
Other Business Support Services
Create a job alert for similar positions
Job alert turned off. You won’t receive updates for this search anymore.
Undo

Job description

We are looking for an experienced AI Application Test Engineer to join our growing team. You will focus on testing AI-powered applications, including conversational AI and RAG-based systems, ensuring they meet quality standards and perform reliably at scale.

Key Responsibilities
  • Design and execute test cases for AI/ML applications, with emphasis on conversational AI and RAG architectures
  • Perform end-to-end testing of AI applications across development, staging, and production environments
  • Test LLM-based applications for accuracy, consistency, and appropriate responses
  • Validate retrieval systems, vector search functionality, and document ingestion pipelines
  • Conduct functional, regression, and integration testing for AI components
  • Identify and document bugs, edge cases, and model behavior issues
  • Collaborate with cross-functional teams to ensure quality throughout the AI development lifecycle
  • Contribute to the development of AI testing best practices and standards

Required Technical Skills
  • AI/ML Testing: 3+ years of hands-on experience testing AI applications, chatbots, or RAG-based solutions
  • Azure Platform: Strong experience with Azure AI services including Azure OpenAI, Azure ML, Cognitive Services, and Azure AI Search
  • Test Automation: Proficiency in automation frameworks and tools (Selenium, Playwright, PyTest, etc.)
  • Programming: Good coding skills in Python for test automation
  • AI Concepts: Understanding of LLM behavior, prompt testing, and conversational AI patterns
  • API Testing: Experience testing REST APIs, especially AI model endpoints
  • Cloud Testing: Familiarity with testing cloud-native applications on Azure
  • Version Control: Experience with Git and collaborative development workflows

Preferred Qualifications
  • Experience with Azure DevOps and CI/CD pipelines
  • Knowledge of data quality testing and validation techniques
  • Familiarity with vector databases (e.g., Pinecone, Weaviate, Azure AI Search)
  • Understanding of AI model evaluation metrics
  • Experience in Agile environments using Jira or similar tools
  • Exposure to MLOps practices

Halian Group:
With over 28 years of experience, we have come to understand that innovation is the only way to provide agile, practical solutions that transform businesses and careers.
Our resourcing and smart services help you to realize tomorrow’s potential. Discover the amazing things possible when you bring the right people and the right technologies together.
At Halian, we recognize that diversity, equity, and inclusion (DEI) are essential to building high-performing teams for our clients. We are committed to connecting organizations with top talent from all backgrounds, ensuring that every individual feels valued, respected, and empowered to contribute their unique perspectives. We encourage applications from all qualified candidates, regardless of race, gender, disability, or any other characteristic that makes them unique. By fostering diverse and inclusive workplaces, we help our clients drive innovation, enhance collaboration, and better reflect the communities they serve.

#LI-PG1

 

This job post has been translated by AI and may contain minor differences or errors.
Apply on company site Email to Friend Complete Questionnaire
You’ve reached the maximum limit of 15 job alerts. To create a new alert, please delete an existing one first.
MANAGE
Job alert created for this search. You’ll receive updates when new jobs match.
Manage alerts
Are you sure you want to unapply?

You'll no longer be considered for this role and your application will be removed from the employer's inbox.