Lead AI Engineer Agentic Test Automation
The AES GroupAbout the role
Role - GenAI / Agentic Test Automation Engineer
Location - Tysons, VA
Let s create our future together at The AES Group!
About The AES Group
The AES Group is a premier technology and engineering consulting company that has been bringing businesses and talent together for over 20 years to deliver innovative solutions that have the greatest positive impact on society. AES has helped over 40 business enterprises, including Fortune 500 companies, engage their customers, empower their employees, and transform their business operations with the power of cloud, data, AI, engineering, and other emerging technologies.
Job Description
We are seeking a GenAI / Agentic Test Automation Engineer with strong experience in LLM-powered agents, test automation, GitHub Copilot, GitHub Actions, Karate, and Playwright. The candidate will build reusable AI-driven testing solutions, quality gates, and reporting capabilities across microservices.
Key Responsibilities
Design and implement agentic testing frameworks for test generation, test maintenance, failure analysis, root-cause identification, and defect drafting.
Develop reusable testing patterns, reference implementations, templates, and standards across UI, API, integration, and contract testing.
Define test coverage standards, risk-based testing strategies, tagging/metadata, and test governance.
Build GenAI-powered reporting that aggregates test results, service health, logs, metrics, traces, and defect data across microservices.
Develop AI-driven insights for release readiness, failure clustering, trend analysis, and change/PR correlation.
Build automated AI quality gates to validate user stories, acceptance criteria, test data, dependencies, edge cases, and non-functional requirements.
Integrate quality gates and automation into GitHub Actions, pull requests, issue templates, and CI/CD workflows.
Required Skills
Hands-on experience building LLM-powered/agentic AI solutions, including prompting, structured outputs/JSON schemas, guardrails, evaluation, and hallucination reduction.
Strong experience with GitHub Copilot, GitHub Actions, CI/CD, GitHub APIs, PR checks, and branch protection.
Advanced Karate experience for API/contract testing and Playwright experience for UI automation.
Strong knowledge of test design, including positive, negative, edge/boundary, regression, test data, and test isolation strategies.
Experience working with microservices and aggregating test results across multiple pipelines.
Experience developing automated requirements validation and AI-assisted reporting solutions.
Key Deliverables
Reusable Agentic Test Automation Kit
Standardized test coverage guidelines and templates
GenAI-assisted reporting pipeline
Automated AI quality gates integrated with GitHub
Improved test coverage, reduced test maintenance, and reduced story churn/rework
Responsibilities
- Design and implement agentic testing frameworks for test generation and maintenance
- Develop reusable testing patterns and standards across various testing types
- Define test coverage standards and risk-based testing strategies
- Build GenAI-powered reporting that aggregates test results and service health
- Develop AI-driven insights for release readiness and trend analysis
- Build automated AI quality gates for validating user stories and requirements
- Integrate quality gates and automation into CI/CD workflows
Qualifications
- Hands-on experience with LLM-powered AI solutions
- Strong experience with GitHub Copilot and GitHub Actions
- Advanced experience with Karate for API testing and Playwright for UI automation
- Strong knowledge of test design strategies
- Experience with microservices and aggregating test results
Skills mentioned
About The AES Group
At The AES Group, we believe technology is most powerful when it brings people, ideas and opportunity together. For more than 20 years, we have partnered with forward-thinking organizations to connect exceptional talent with transformative technology solutions that drive meaningful business outcomes and create lasting impact. Our teams help enterprises reimagine how they engage customers, empower employees, optimize operations and unlock new possibilities through emerging technologies. From designing differentiated digital experiences that deepen customer relationships, to enabling employees with modern tools that foster learning, collaboration and growth, we help organizations build workplaces where people and innovation thrive. We also work alongside our clients to transform and streamline core business operations — strengthening resilience, efficiency and long-term performance in an increasingly dynamic world. At the same time, we explore and deploy AI and emerging technologies that enable organizations to evolve their business models and lead confidently into the future. At AES, we are driven by a simple belief: when businesses and talent move forward together, extraordinary things happen. Let’s create our future, together.