Senior QA Engineer - AI-Native Platform
SL KG
- Нур-Султан
- Постоянная работа
- Полная занятость
- Build and maintain AI evaluation framework
- Test RAG pipeline quality and retrieval relevance
- Design testing approaches for non-deterministic LLM outputs
- Build multi-tenant isolation test suite, including AI layer isolation
- Write cross-service integration and contract tests
- Test Temporal workflows, event-driven flows, and YAML DSL validation
- Build and maintain automated regression suites
- 3+ years in QA automation / SDET
- Hands-on experience testing AI/ML systems
- Strong Python (pytest, async testing)
- Experience building test infrastructure from scratch
- Experience testing distributed or event-driven systems
- Experience testing multi-tenant applications
- Autonomous work style
- English – B1 level or higher
- RAG / vector search quality evaluation
- LangGraph, LangChain, or similar agent frameworks
- Go test automation
- BentoML / MLflow or equivalent MLOps tooling
- Security testing: prompt injection, context leakage
- Performance / load testing for ML inference endpoints
- Data pipeline testing (Delta Lake, Great Expectations, Dagster)
- Russian – advanced level or higher
- Remote-first setup: work from anywhere in the world (except Russia and Belarus)
- Work on a greenfield, technically challenging product (distributed system at scale)
- Direct collaboration with senior technical stakeholders (engineering leadership, product)
- Ownership and impact: influence QA strategy, tooling, and quality gates from the early stage of the product
- Fast iteration environment: work closely with engineering to improve reliability and release confidence
HeadHunter