QA Engineer – GenAI & Conversational Systems

About the role

We are looking for a QA Engineer with an analytical mindset and curiosity about generative AI. The role ensures the quality of conversational systems powered by GenAI, covering functional and exploratory testing, defect tracking, and metric analysis.

Key responsibilities

• Design, execute and document functional and exploratory tests for GenAI‑based conversational applications.
• Validate the quality of conversation flows, prompt responses and integrations within generative‑AI pipelines.
• Report and track defects, taking into account the inherent variability of large language models.
• Collect and analyse quality metrics to monitor system behaviour under test.
• Manage test cases, test plans and defect records using Azure DevOps.
• Collaborate with development and product teams to ensure acceptance criteria are clear and verifiable.

Required profile

• Experience with manual testing, including test‑case design, execution and defect reporting.
• Understanding of QA best practices and quality‑metric frameworks.
• Familiarity with Azure DevOps for test management.
• Basic knowledge of GenAI concepts such as prompt engineering, LLM variability and hallucination risks.
• Exposure to agentic AI and multi‑turn conversational flows.
• Previous involvement in GenAI or agentic‑AI projects.

Required skills

• Azure DevOps