← All roles

AI QA Automation Engineer (Python)

Permanentremote5+ yrs📍 Remote Ukraine, Ukraine, 🇺🇦 Ukraine🗣 English

Senior QA automation engineer building evaluation frameworks for AI agents and RAG systems.

Design and implement automated testing solutions for generative AI systems, including evaluation frameworks, benchmark datasets, and quality gates across API, UI, and CI/CD pipelines. The role requires deep expertise in Python-based test automation, LLM evaluation techniques, and production quality monitoring for AI-powered applications. You'll develop intelligent test generation and validation workflows while addressing adversarial testing and responsible AI concerns.

Tech stack
PythonPlaywrightSeleniumLLM evaluation frameworks
Rate
Not stated by the agency
via

Membership is €29/month, cancel anytime: every rate, every original listing link, and a daily alert for roles matching your filters.

Found at a specialist agency · listed 23 September 2026 · InsideJobs links you to the original posting.