QA Testers with AI
3B Staffing LLC, Hartford, CT, United States
QA Testers with AI Experience
CVS
Hartford, CT
USC, GC or GC EAD only
Hybrid 3 days a week - LAST interview will be onsite. Please share candidates who are TRULY local and can interview onsite NOT candidates who will come up with excuses at the time of the onsite interview.
We are seeking to fill
Quality Assurance Automation Engineer roles (3) local to Hartford, CT.
Position Summary
The Aetna IT Delivery organization, part of CVS Health's Data, Digital, Analytics, Technology (DDAT) division, is seeking a highly skilled Quality Assurance Automation Engineer to design, develop, and maintain automated testing solutions for virtual assistants (agents) to support members and providers by accessing timely, accurate health insurance answers across digital channels.
The ideal candidate will have strong experience in Behavior Driven Development and Test Driven Development methodologies, automation scripting, and healthcare domain knowledge.
Key Responsibilities
Test Automation Development:
Design, develop, and maintain automated test scripts using industry-standard tools and frameworks (e.g., Selenium, Cypress, Playwright, Appium).
Build and enhance automation frameworks to support functional, regression, and performance testing.
Quality Assurance:
Collaborate with developers and QA analysts to understand application functionality and define test coverage.
Execute automated test suites and analyze results to identify defects and ensure compliance with quality standards.
Continuous Integration & Delivery (CI/CD):
Integrate automated tests into CI/CD pipelines using tools like Jenkins, GitLab CI, or Azure DevOps.
Monitor and maintain test execution in CI environments to ensure timely feedback.
Defect Management:
Log, track, and verify defects using tools such as JIRA or Azure DevOps.
Work with development teams to reproduce issues and validate fixes.
Documentation & Reporting:
Prepare detailed test plans, test cases, and automation scripts documentation.
Generate and present test execution reports to stakeholders.
Process Improvement:
Identify opportunities to improve automation coverage and efficiency.
Stay updated with emerging trends, tools, and best practices in test automation.
Required Qualifications
3+ years of experience in QA automation and software testing.
Proficiency in programming languages such as Java, Python, or JavaScript.
Hands-on experience with automation tools including Hammer On Demand and Selenium
Strong understanding of SDLC, Agile methodologies, and QA principles.
Experience with CI/CD tools and version control systems (e.g., Git).
Frameworks & Methodologies:
BDD (e.g., Cucumber, SpecFlow)
TDD
Testing Expertise: Functional, Regression, Integration, and Performance Testing
Healthcare Domain Knowledge: Familiarity with HIPAA compliance and healthcare workflows
Strong analytical and problem-solving skills
Excellent communication and collaboration abilities
Conversational AI Testing: Hands-on experience or strong exposure to testing chatbots and voice-based virtual assistants across multiple platforms.
AI Model Evaluation: Familiarity with key evaluation metrics such as accuracy, precision, recall, and F1-score for assessing AI model performance.
Experience with Agentic IDEs: Familiarity with AI-powered development environments (e.g., Windsurf, Cursor, or similar) for creating, maintaining, and optimizing automated test scripts.
Experience with API testing (REST, SOAP)
Knowledge of cloud platforms (AWS, GCP, or IBM Cloud)
Education
Bachelor's degree in Computer Science, Engineering, or related field.
CVS
Hartford, CT
USC, GC or GC EAD only
Hybrid 3 days a week - LAST interview will be onsite. Please share candidates who are TRULY local and can interview onsite NOT candidates who will come up with excuses at the time of the onsite interview.
We are seeking to fill
Quality Assurance Automation Engineer roles (3) local to Hartford, CT.
Position Summary
The Aetna IT Delivery organization, part of CVS Health's Data, Digital, Analytics, Technology (DDAT) division, is seeking a highly skilled Quality Assurance Automation Engineer to design, develop, and maintain automated testing solutions for virtual assistants (agents) to support members and providers by accessing timely, accurate health insurance answers across digital channels.
The ideal candidate will have strong experience in Behavior Driven Development and Test Driven Development methodologies, automation scripting, and healthcare domain knowledge.
Key Responsibilities
Test Automation Development:
Design, develop, and maintain automated test scripts using industry-standard tools and frameworks (e.g., Selenium, Cypress, Playwright, Appium).
Build and enhance automation frameworks to support functional, regression, and performance testing.
Quality Assurance:
Collaborate with developers and QA analysts to understand application functionality and define test coverage.
Execute automated test suites and analyze results to identify defects and ensure compliance with quality standards.
Continuous Integration & Delivery (CI/CD):
Integrate automated tests into CI/CD pipelines using tools like Jenkins, GitLab CI, or Azure DevOps.
Monitor and maintain test execution in CI environments to ensure timely feedback.
Defect Management:
Log, track, and verify defects using tools such as JIRA or Azure DevOps.
Work with development teams to reproduce issues and validate fixes.
Documentation & Reporting:
Prepare detailed test plans, test cases, and automation scripts documentation.
Generate and present test execution reports to stakeholders.
Process Improvement:
Identify opportunities to improve automation coverage and efficiency.
Stay updated with emerging trends, tools, and best practices in test automation.
Required Qualifications
3+ years of experience in QA automation and software testing.
Proficiency in programming languages such as Java, Python, or JavaScript.
Hands-on experience with automation tools including Hammer On Demand and Selenium
Strong understanding of SDLC, Agile methodologies, and QA principles.
Experience with CI/CD tools and version control systems (e.g., Git).
Frameworks & Methodologies:
BDD (e.g., Cucumber, SpecFlow)
TDD
Testing Expertise: Functional, Regression, Integration, and Performance Testing
Healthcare Domain Knowledge: Familiarity with HIPAA compliance and healthcare workflows
Strong analytical and problem-solving skills
Excellent communication and collaboration abilities
Conversational AI Testing: Hands-on experience or strong exposure to testing chatbots and voice-based virtual assistants across multiple platforms.
AI Model Evaluation: Familiarity with key evaluation metrics such as accuracy, precision, recall, and F1-score for assessing AI model performance.
Experience with Agentic IDEs: Familiarity with AI-powered development environments (e.g., Windsurf, Cursor, or similar) for creating, maintaining, and optimizing automated test scripts.
Experience with API testing (REST, SOAP)
Knowledge of cloud platforms (AWS, GCP, or IBM Cloud)
Education
Bachelor's degree in Computer Science, Engineering, or related field.