Lead Software Test Automation Engineer | Test Architect - Agentic AI

Wolters KluwerUSA - Coppell, TXfull timeLead
ActiveVerified 38m ago

Job description

We are seeking a Lead Test Automation Architect to define and lead an enterprise-grade test automation strategy across UI, API, data, and platform layers—while evolving our quality engineering capabilities to support Agentic AI / LLM-based systems (probabilistic outputs, confidence-based validation, hallucination detection, and model evaluation). This role will architect scalable automation frameworks, drive engineering excellence, and accelerate delivery through highly productive, maintainable automation programs.

Key Responsibilities

Automation Strategy & Architecture

  • Define and own the test automation architecture and multi-layer strategy (UI/API/contract/integration/e2e), aligned to product risk and release cadence.

  • Establish automation standards, patterns, and reference implementations (framework structure, page-object/screenplay usage, test data patterns, reporting).

  • Drive shift-left testing practices (contract testing, component testing, pre-merge validation) and reduce reliance on fragile end-to-end tests.

Agentic AI / LLM Test Model Alignment

  • Design and implement testing approaches for non-deterministic AI outputs, including:

    • confidence/threshold-based assertions

    • semantic similarity checks and rubric-based validation

    • goldens/benchmark datasets and evaluation harnesses

    • hallucination and groundedness testing strategies

    • regression detection across model/prompt/version changes

  • Define AI test coverage across accuracy, robustness, bias/safety (as applicable), performance, and reliability.

  • Partner with ML/AI, Product, and Engineering to establish acceptance criteria for AI capabilities and measurable quality gates.

High-Productivity Automation Programs

  • Build and scale high-throughput automation projects that are reliable, fast, and easy to extend.

  • Improve test execution time, reduce flaky tests, and optimize CI/CD pipelines (parallelization, test selection, retries with guardrails).

  • Create actionable, engineering-friendly quality dashboards (pass/fail trends, flake rate, coverage, defect escape metrics).

Tooling, CI/CD, and Quality Gates

  • Integrate automation into CI/CD with quality gates (PR checks, nightly suites, release readiness criteria).

  • Standardize observability for testing: logs, tracing hooks, screenshots/video, artifacts, and test run diagnostics.

  • Define practices for test environments, data management, service virtualization, and dependency control.

Technical Leadership & Mentorship

  • Serve as the QE technical authority: coach engineers on automation design, code quality, and best practices.

  • Lead design reviews for test architecture and automation PRs; enforce coding standards and maintainability.

  • Influence roadmap and delivery by translating risk into clear testing priorities.

Required Qualifications

  • 8–12+ years in Quality Engineering / Test Automation with architect-level ownership of frameworks and strategy.

  • Proven experience designing scalable automation across:

    • API testing (contract + integration)

    • UI automation with stable locator strategies (test IDs, accessibility roles)

    • Test data strategy and environment reliability

  • Strong programming skills in at least one modern language (e.g., Java, Python, TypeScript/JavaScript, C#).

  • Expertise with automation tools/frameworks (examples):

    • UI: Playwright / Cypress / Selenium

    • API: REST-assured / SuperTest / Postman/Newman / pytest

    • CI: GitHub Actions / Jenkins / Azure DevOps

  • Demonstrated ability to reduce flakiness and improve execution speed through engineering solutions.

Preferred Qualifications (Strongly Desired)

  • Experience testing LLM/Agentic AI features or other probabilistic systems, including:

    • evaluation harnesses, benchmark datasets, semantic scoring, and drift detection

    • prompt/version regression strategies and structured evaluation reports

  • Familiarity with modern quality approaches: test pyramid, contract testing, consumer-driven contracts, risk-based testing, shift-left.

  • Knowledge of security/performance testing integration (baseline understanding; hands-on is a plus).

  • Experience building reusable automation libraries for multiple teams/products.

Our Interview Practices

To maintain a fair and genuine hiring process, we kindly ask that all candidates participate in interviews without the assistance of AI tools or external prompts. Our interview process is designed to assess your individual skills, experiences, and communication style. We value authenticity and want to ensure we’re getting to know you—not a digital assistant. To help maintain this integrity, we ask to remove virtual backgrounds and include in-person interviews in our hiring process. Please note that use of AI-generated responses or third-party support during interviews will be grounds for disqualification from the recruitment process.

Applicants may be required to appear onsite at a Wolters Kluwer office as part of the recruitment process.

Compensation:

$89,600.00 - $157,000.00 USD

This role is eligible for Bonus.

Compensation range listed is based on primary location of the position. Actual base salary offer is influenced by a wide array of factors including but not limited to skills, experience and actual hiring location. Your recruiter can share more information about the specific offer for the job location during the hiring process.

Additional Information:

Wolters Kluwer offers a wide variety of competitive benefits and programs to help meet your needs and balance your work and personal life, including but not limited to: Medical, Dental, & Vision Plans, 401(k), FSA/HSA, Commuter Benefits, Tuition Assistance Plan, Vacation and Sick Time, and Paid Parental Leave. Full details of our benefits are available upon request.

Similar jobs

Job Description The Robotics Engineer III - Motion Planning leads the development, optimization, and large-scale deployment of motion planning architectures for fleet-wide AMR navigation. This position focuses on high-performance optimization, AI-driven behavioral planning, fail-safe recovery strategies, and large-scale robotic coordination. The Robotics Engineer III - Motion Planning designs and refines graph search, optimization-based planners, and reinforcement learning-based motion strategies while ensuring seamless integration with perception and real-time control. Responsibilities Architect scalable motion planning frameworks for fleet-level AMR deployments.Develop and refine AI-driven motion planning (reinforcement learning, imitation learning, deep MPC).Implement real-time model predictive planners using CasADi, ACADOS, and convex/non-convex solvers.Design and implement advanced fail-safe motion planning strategies, including autonomous re-routing, recovery-based motion primitives, and redundant planning checks.Enhance multi-agent coordination strategies for large-scale robotic path planning and collision avoidance.Decompose complex behaviors into modular, reusable tree structures.Integrate graph-based, hierarchical, and predictive planning models for decision-making.Deploy AI-based planning models (e.g., learning-based cost functions, uncertainty-aware planners).Conduct large-scale simulation and on-robot validation to assess real-time system performance.Optimize cost-aware, energy-efficient, and high-speed trajectory planning for AMRs.Ensure robust software development, CI/CD implementation, and fault-tolerant motion control strategies.Lead cross-functional collaborations and mentor junior engineers in robotics motion planning.Other duties and projects, as assigned. Requirements Education:Master's Degree in Robotics, Engineering, Computer Science, or related field, requiredPhD in Robotics, Engineering, Computer Science, or related field, preferredExperience:1 year as a Robotics Engineer II - Motion Planning or equivalent experience, preferred4 years of experience in robotics motion planning, AI-driven decision models, or multi-agent autonomy.Computer Skills:Expertise in motion planning algorithms (Hybrid A*, RRT*, ILQR, AI-driven planning). Upon Hire, requiredExperience with CasADi, ACADOS, convex/non-convex optimization solvers. Upon Hire, requiredAdvanced proficiency in C++/Python, ROS2, and high-performance robotic software development. Upon Hire, requiredStrong foundation in multi-agent fleet planning, reinforcement learning-based decision-making, and real-time control. Upon Hire, requiredAdditional Requirements:Proven leadership in large-scale robotic motion planning. Upon Hire, requiredStrong research background with experience in industry robotics advancements. Upon Hire, requiredExperience deploying robotic systems in real-world industrial or logistics environments. Upon Hire, preferredExperience designing Behavior Trees (BTs) for high-level decision-making in autonomous systems. Upon Hire, preferredUnderstanding of perception integration for planning in dynamic environments. Upon Hire, requiredStrong mathematical foundation in optimization, graph theory, and control systems. Upon Hire, requiredCompetencies:Active LearningC++Communicating Complex ConceptsDisruptive InnovationLinuxProgrammingRobotics/Computer Controlled MachineryTroubleshooting Technical Problems Other Details Work Hours:Generally, 8:00 am - 5:00 pm with occasional irregular hours depending on workload.Travel Requirements:Occasional (25%-50%) Potential testing and data collection at customer sites.Compensation:This is a salary position paid biweekly. About UsArcBest® (Nasdaq: ARCB) is a multibillion-dollar integrated logistics company that helps keep the global supply chain moving. Founded in 1923 and now with 14,000 employees across 250 campuses and service centers, the company is a logistics powerhouse, using its technology, expertise and scale to connect shippers with the solutions they need — from ground, air and ocean transportation to fully managed supply chains. ArcBest has a long history of innovation that is enriched by deep customer relationships. With a commitment to helping customers navigate supply chain challenges now and in the future, the company continues to invest in purpose-built technology such as ArcBest View™, its digital logistics platform that brings quoting, booking, shipment visibility and reporting into one connected experience.

ArcBest
Verified Sep 23, 2026Posted 20 days ago

Job Description The Robotics Engineer III - Motion Planning leads the development, optimization, and large-scale deployment of motion planning architectures for fleet-wide AMR navigation. This position focuses on high-performance optimization, AI-driven behavioral planning, fail-safe recovery strategies, and large-scale robotic coordination. The Robotics Engineer III - Motion Planning designs and refines graph search, optimization-based planners, and reinforcement learning-based motion strategies while ensuring seamless integration with perception and real-time control. Responsibilities Architect scalable motion planning frameworks for fleet-level AMR deployments.Develop and refine AI-driven motion planning (reinforcement learning, imitation learning, deep MPC).Implement real-time model predictive planners using CasADi, ACADOS, and convex/non-convex solvers.Design and implement advanced fail-safe motion planning strategies, including autonomous re-routing, recovery-based motion primitives, and redundant planning checks.Enhance multi-agent coordination strategies for large-scale robotic path planning and collision avoidance.Decompose complex behaviors into modular, reusable tree structures.Integrate graph-based, hierarchical, and predictive planning models for decision-making.Deploy AI-based planning models (e.g., learning-based cost functions, uncertainty-aware planners).Conduct large-scale simulation and on-robot validation to assess real-time system performance.Optimize cost-aware, energy-efficient, and high-speed trajectory planning for AMRs.Ensure robust software development, CI/CD implementation, and fault-tolerant motion control strategies.Lead cross-functional collaborations and mentor junior engineers in robotics motion planning.Other duties and projects, as assigned. Requirements Education:Master's Degree in Robotics, Engineering, Computer Science, or related field, requiredPhD in Robotics, Engineering, Computer Science, or related field, preferredExperience:1 year as a Robotics Engineer II - Motion Planning or equivalent experience, preferred4 years of experience in robotics motion planning, AI-driven decision models, or multi-agent autonomy.Computer Skills:Expertise in motion planning algorithms (Hybrid A*, RRT*, ILQR, AI-driven planning). Upon Hire, requiredExperience with CasADi, ACADOS, convex/non-convex optimization solvers. Upon Hire, requiredAdvanced proficiency in C++/Python, ROS2, and high-performance robotic software development. Upon Hire, requiredStrong foundation in multi-agent fleet planning, reinforcement learning-based decision-making, and real-time control. Upon Hire, requiredAdditional Requirements:Proven leadership in large-scale robotic motion planning. Upon Hire, requiredStrong research background with experience in industry robotics advancements. Upon Hire, requiredExperience deploying robotic systems in real-world industrial or logistics environments. Upon Hire, preferredExperience designing Behavior Trees (BTs) for high-level decision-making in autonomous systems. Upon Hire, preferredUnderstanding of perception integration for planning in dynamic environments. Upon Hire, requiredStrong mathematical foundation in optimization, graph theory, and control systems. Upon Hire, requiredCompetencies:Collaboration and Communication - VauxExecution and Ownership - VauxImpact - VauxTechnical Leadership - VauxTechnical Skills - Vaux Other Details Work Hours:Generally, 8:00 am - 5:00 pm with occasional irregular hours depending on workload.Travel Requirements:Occasional (25%-50%) Potential testing and data collection at customer sites.Compensation:This is a salary position paid biweekly. About UsArcBest® (Nasdaq: ARCB) is a multibillion-dollar integrated logistics company that helps keep the global supply chain moving. Founded in 1923 and now with 14,000 employees across 250 campuses and service centers, the company is a logistics powerhouse, using its technology, expertise and scale to connect shippers with the solutions they need — from ground, air and ocean transportation to fully managed supply chains. ArcBest has a long history of innovation that is enriched by deep customer relationships. With a commitment to helping customers navigate supply chain challenges now and in the future, the company continues to invest in purpose-built technology such as ArcBest View™, its digital logistics platform that brings quoting, booking, shipment visibility and reporting into one connected experience.

ArcBest
Verified Sep 23, 2026Posted 20 days ago