QA/Test Engineer

JD:
Role Name: QA/Test Engineer
Contract
Location: Atlanta, GA (Onsite)

JOB DESCRIPTION:
Position open only for Atlanta, Chicago and Vienna

Job Responsibilities
Test chatbot responses for accuracy relevance hallucinations and safety
Validate data used for grounding and retrieval completeness correctness bias
Execute prompt and conversation flow testing across common user scenarios
Identify log and explain issues with responses data or prompts
Work closely with engineers and product teams to improve response quality
Support ongoing evaluations and regression testing as models and prompts evolve

Required Experience and Skills
3-6 years of experience in data testing QA or analytics testing
Strong understanding of DQ dimensions accuracy completeness consistency bias
Handson experience testing GenAI LLMbased systems or chatbots
Familiarity with prompt engineering concepts and conversational AI flows
SQL and basic scripting skills for data validation and analysis
Experience working in Agile productdriven team