QA Engineer with AI

infoyaNavalur, Indiafull timeMid Level
Active

Job description

Job SummaryWe are seeking a QA Engineer – AI with 3–7 years of experience to validate AI-powered applications, automation workflows, and intelligent systems. The ideal candidate should have strong expertise in manual and automation testing, API testing, and experience validating Generative AI/LLM-based applications. You will work closely with developers, AI engineers, and product teams to ensure the quality, reliability, and performance of AI solutions.Key ResponsibilitiesDesign, develop, and execute comprehensive test plans, test cases, and test scenarios for AI-enabled applications.Perform functional, regression, integration, system, and end-to-end testing.Validate AI/LLM outputs for accuracy, consistency, hallucinations, bias, and edge cases.Develop and maintain automation frameworks for web and API testing.Perform REST API testing using Postman, Rest Assured, or similar tools.Create and execute test data strategies for AI model validation.Work with developers to identify, reproduce, and resolve defects.Validate prompt engineering scenarios and AI workflow integrations.Execute performance and reliability testing for AI-powered applications.Participate in Agile ceremonies, sprint planning, and defect triage meetings.Maintain test documentation, defect reports, and quality metrics using JIRA or Azure DevOps.Mandatory Skills3–7 years of experience in Software Testing/QA.Strong experience in Manual Testing and Automation Testing.Hands-on experience with Selenium WebDriver.Programming knowledge in Java or Python.Experience with TestNG/JUnit and automation frameworks.Strong understanding of API Testing using Postman and/or Rest Assured.Knowledge of SQL and database validation.Hands-on experience with Git and version control.Experience working in Agile/Scrum environments.Exposure to Generative AI, LLMs (ChatGPT, Gemini, Claude, etc.), prompt testing, or AI application validation.Experience with defect tracking tools such as JIRA.Preferred SkillsExperience testing applications built on OpenAI, Azure OpenAI, Google Vertex AI, AWS Bedrock, or similar AI platforms.Knowledge of Python scripting for test automation.Experience with Playwright or Cypress.Exposure to CI/CD tools such as Jenkins, GitHub Actions, or Azure DevOps.Understanding of Docker and basic Kubernetes concepts.Experience with performance testing tools such as JMeter.Familiarity with AI evaluation metrics, prompt engineering, Retrieval-Augmented Generation (RAG), and vector databases is an added advantage.QualificationsBachelor's degree in Computer Science, Information Technology, Engineering, or a related field.Soft SkillsStrong analytical and problem-solving abilities.Excellent communication and collaboration skills.Ability to work independently and in cross-functional teams.Attention to detail with a quality-first mindset.Eagerness to learn emerging AI technologies and testing methodologies.Job SummaryWe are seeking a QA Engineer – AI with 3–7 years of experience to validate AI-powered applications, automation workflows, and intelligent systems. The ideal candidate should have strong expertise in manual and automation testing, API testing, and experience validating Generative AI/LLM-based applications. You will work closely with developers, AI engineers, and product teams to ensure the quality, reliability, and performance of AI solutions.Key ResponsibilitiesDesign, develop, and execute comprehensive test plans, test cases, and test scenarios for AI-enabled applications.Perform functional, regression, integration, system, and end-to-end testing.Validate AI/LLM outputs for accuracy, consistency, hallucinations, bias, and edge cases.Develop and maintain automation frameworks for web and API testing.Perform REST API testing using Postman, Rest Assured, or similar tools.Create and execute test data strategies for AI model validation.Work with developers to identify, reproduce, and resolve defects.Validate prompt engineering scenarios and AI workflow integrations.Execute performance and reliability testing for AI-powered applications.Participate in Agile ceremonies, sprint planning, and defect triage meetings.Maintain test documentation, defect reports, and quality metrics using JIRA or Azure DevOps.Mandatory Skills3–7 years of experience in Software Testing/QA.Strong experience in Manual Testing and Automation Testing.Hands-on experience with Selenium WebDriver.Programming knowledge in Java or Python.Experience with TestNG/JUnit and automation frameworks.Strong understanding of API Testing using Postman and/or Rest Assured.Knowledge of SQL and database validation.Hands-on experience with Git and version control.Experience working in Agile/Scrum environments.Exposure to Generative AI, LLMs (ChatGPT, Gemini, Claude, etc.), prompt testing, or AI application validation.Experience with defect tracking tools such as JIRA.Preferred SkillsExperience testing applications built on OpenAI, Azure OpenAI, Google Vertex AI, AWS Bedrock, or similar AI platforms.Knowledge of Python scripting for test automation.Experience with Playwright or Cypress.Exposure to CI/CD tools such as Jenkins, GitHub Actions, or Azure DevOps.Understanding of Docker and basic Kubernetes concepts.Experience with performance testing tools such as JMeter.Familiarity with AI evaluation metrics, prompt engineering, Retrieval-Augmented Generation (RAG), and vector databases is an added advantage.QualificationsBachelor's degree in Computer Science, Information Technology, Engineering, or a related field.Soft SkillsStrong analytical and problem-solving abilities.Excellent communication and collaboration skills.Ability to work independently and in cross-functional teams.Attention to detail with a quality-first mindset.Eagerness to learn emerging AI technologies and testing methodologies.

Job Summary

We are seeking a QA Engineer – AI with 3–7 years of experience to validate AI-powered applications, automation workflows, and intelligent systems. The ideal candidate should have strong expertise in manual and automation testing, API testing, and experience validating Generative AI/LLM-based applications. You will work closely with developers, AI engineers, and product teams to ensure the quality, reliability, and performance of AI solutions.

We are seeking a QA Engineer – AI with 3–7 years of experience to validate AI-powered applications, automation workflows, and intelligent systems. The ideal candidate should have strong expertise in manual and automation testing, API testing, and experience validating Generative AI/LLM-based applications. You will work closely with developers, AI engineers, and product teams to ensure the quality, reliability, and performance of AI solutions.We are seeking a QA Engineer – AI with 3–7 years of experience to validate AI-powered applications, automation workflows, and intelligent systems. The ideal candidate should have strong expertise in manual and automation testing, API testing, and experience validating Generative AI/LLM-based applications. You will work closely with developers, AI engineers, and product teams to ensure the quality, reliability, and performance of AI solutions.We are seeking a QA Engineer – AI with 3–7 years of experience to validate AI-powered applications, automation workflows, and intelligent systems. The ideal candidate should have strong expertise in manual and automation testing, API testing, and experience validating Generative AI/LLM-based applications. You will work closely with developers, AI engineers, and product teams to ensure the quality, reliability, and performance of AI solutions.QA Engineer – AI3–7 years of experience

Key Responsibilities

  • Design, develop, and execute comprehensive test plans, test cases, and test scenarios for AI-enabled applications.

Design, develop, and execute comprehensive test plans, test cases, and test scenarios for AI-enabled applications.

Design, develop, and execute comprehensive test plans, test cases, and test scenarios for AI-enabled applications.Design, develop, and execute comprehensive test plans, test cases, and test scenarios for AI-enabled applications.
  • Perform functional, regression, integration, system, and end-to-end testing.

Perform functional, regression, integration, system, and end-to-end testing.

Perform functional, regression, integration, system, and end-to-end testing.Perform functional, regression, integration, system, and end-to-end testing.
  • Validate AI/LLM outputs for accuracy, consistency, hallucinations, bias, and edge cases.

Validate AI/LLM outputs for accuracy, consistency, hallucinations, bias, and edge cases.

Validate AI/LLM outputs for accuracy, consistency, hallucinations, bias, and edge cases.Validate AI/LLM outputs for accuracy, consistency, hallucinations, bias, and edge cases.
  • Develop and maintain automation frameworks for web and API testing.

Develop and maintain automation frameworks for web and API testing.

Develop and maintain automation frameworks for web and API testing.Develop and maintain automation frameworks for web and API testing.
  • Perform REST API testing using Postman, Rest Assured, or similar tools.

Perform REST API testing using Postman, Rest Assured, or similar tools.

Perform REST API testing using Postman, Rest Assured, or similar tools.Perform REST API testing using Postman, Rest Assured, or similar tools.
  • Create and execute test data strategies for AI model validation.

Create and execute test data strategies for AI model validation.

Create and execute test data strategies for AI model validation.Create and execute test data strategies for AI model validation.
  • Work with developers to identify, reproduce, and resolve defects.

Work with developers to identify, reproduce, and resolve defects.

Work with developers to identify, reproduce, and resolve defects.Work with developers to identify, reproduce, and resolve defects.
  • Validate prompt engineering scenarios and AI workflow integrations.

Validate prompt engineering scenarios and AI workflow integrations.

Validate prompt engineering scenarios and AI workflow integrations.Validate prompt engineering scenarios and AI workflow integrations.
  • Execute performance and reliability testing for AI-powered applications.

Execute performance and reliability testing for AI-powered applications.

Execute performance and reliability testing for AI-powered applications.Execute performance and reliability testing for AI-powered applications.
  • Participate in Agile ceremonies, sprint planning, and defect triage meetings.

Participate in Agile ceremonies, sprint planning, and defect triage meetings.

Participate in Agile ceremonies, sprint planning, and defect triage meetings.Participate in Agile ceremonies, sprint planning, and defect triage meetings.
  • Maintain test documentation, defect reports, and quality metrics using JIRA or Azure DevOps.

Maintain test documentation, defect reports, and quality metrics using JIRA or Azure DevOps.

Maintain test documentation, defect reports, and quality metrics using JIRA or Azure DevOps.Maintain test documentation, defect reports, and quality metrics using JIRA or Azure DevOps.

Mandatory Skills

  • 3–7 years of experience in Software Testing/QA.

3–7 years of experience in Software Testing/QA.

3–7 years of experience in Software Testing/QA.3–7 years of experience in Software Testing/QA.
  • Strong experience in Manual Testing and Automation Testing.

Strong experience in Manual Testing and Automation Testing.

Strong experience in Manual Testing and Automation Testing.Strong experience in Manual Testing and Automation Testing.
  • Hands-on experience with Selenium WebDriver.

Hands-on experience with Selenium WebDriver.

Hands-on experience with Selenium WebDriver.Hands-on experience with Selenium WebDriver.Selenium WebDriver
  • Programming knowledge in Java or Python.

Programming knowledge in Java or Python.

Programming knowledge in Java or Python.Programming knowledge in Java or Python.Java or Python
  • Experience with TestNG/JUnit and automation frameworks.

Experience with TestNG/JUnit and automation frameworks.

Experience with TestNG/JUnit and automation frameworks.Experience with TestNG/JUnit and automation frameworks.TestNG/JUnit
  • Strong understanding of API Testing using Postman and/or Rest Assured.

Strong understanding of API Testing using Postman and/or Rest Assured.

Strong understanding of API Testing using Postman and/or Rest Assured.Strong understanding of API Testing using Postman and/or Rest Assured.API Testing
  • Knowledge of SQL and database validation.

Knowledge of SQL and database validation.

Knowledge of SQL and database validation.Knowledge of SQL and database validation.SQL
  • Hands-on experience with Git and version control.

Hands-on experience with Git and version control.

Hands-on experience with Git and version control.Hands-on experience with Git and version control.Git
  • Experience working in Agile/Scrum environments.

Experience working in Agile/Scrum environments.

Experience working in Agile/Scrum environments.Experience working in Agile/Scrum environments.Agile/Scrum
  • Exposure to Generative AI, LLMs (ChatGPT, Gemini, Claude, etc.), prompt testing, or AI application validation.

Exposure to Generative AI, LLMs (ChatGPT, Gemini, Claude, etc.), prompt testing, or AI application validation.

Exposure to Generative AI, LLMs (ChatGPT, Gemini, Claude, etc.), prompt testing, or AI application validation.Exposure to Generative AI, LLMs (ChatGPT, Gemini, Claude, etc.), prompt testing, or AI application validation.Generative AILLMs (ChatGPT, Gemini, Claude, etc.)
  • Experience with defect tracking tools such as JIRA.

Experience with defect tracking tools such as JIRA.

Experience with defect tracking tools such as JIRA.Experience with defect tracking tools such as JIRA.JIRA

Preferred Skills

  • Experience testing applications built on OpenAI, Azure OpenAI, Google Vertex AI, AWS Bedrock, or similar AI platforms.

Experience testing applications built on OpenAI, Azure OpenAI, Google Vertex AI, AWS Bedrock, or similar AI platforms.

Experience testing applications built on OpenAI, Azure OpenAI, Google Vertex AI, AWS Bedrock, or similar AI platforms.Experience testing applications built on OpenAI, Azure OpenAI, Google Vertex AI, AWS Bedrock, or similar AI platforms.OpenAI, Azure OpenAI, Google Vertex AI, AWS Bedrock
  • Knowledge of Python scripting for test automation.

Knowledge of Python scripting for test automation.

Knowledge of Python scripting for test automation.Knowledge of Python scripting for test automation.Python scripting
  • Experience with Playwright or Cypress.

Experience with Playwright or Cypress.

Experience with Playwright or Cypress.Experience with Playwright or Cypress.Playwright
  • Exposure to CI/CD tools such as Jenkins, GitHub Actions, or Azure DevOps.

Exposure to CI/CD tools such as Jenkins, GitHub Actions, or Azure DevOps.

Exposure to CI/CD tools such as Jenkins, GitHub Actions, or Azure DevOps.Exposure to CI/CD tools such as Jenkins, GitHub Actions, or Azure DevOps.CI/CD
  • Understanding of Docker and basic Kubernetes concepts.

Understanding of Docker and basic Kubernetes concepts.

Understanding of Docker and basic Kubernetes concepts.Understanding of Docker and basic Kubernetes concepts.Docker
  • Experience with performance testing tools such as JMeter.

Experience with performance testing tools such as JMeter.

Experience with performance testing tools such as JMeter.Experience with performance testing tools such as JMeter.
  • Familiarity with AI evaluation metrics, prompt engineering, Retrieval-Augmented Generation (RAG), and vector databases is an added advantage.

Familiarity with AI evaluation metrics, prompt engineering, Retrieval-Augmented Generation (RAG), and vector databases is an added advantage.

Familiarity with AI evaluation metrics, prompt engineering, Retrieval-Augmented Generation (RAG), and vector databases is an added advantage.Familiarity with AI evaluation metrics, prompt engineering, Retrieval-Augmented Generation (RAG), and vector databases is an added advantage.

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

Soft Skills

  • Strong analytical and problem-solving abilities.

Strong analytical and problem-solving abilities.

Strong analytical and problem-solving abilities.Strong analytical and problem-solving abilities.
  • Excellent communication and collaboration skills.

Excellent communication and collaboration skills.

Excellent communication and collaboration skills.Excellent communication and collaboration skills.
  • Ability to work independently and in cross-functional teams.

Ability to work independently and in cross-functional teams.

Ability to work independently and in cross-functional teams.Ability to work independently and in cross-functional teams.
  • Attention to detail with a quality-first mindset.

Attention to detail with a quality-first mindset.

Attention to detail with a quality-first mindset.Attention to detail with a quality-first mindset.
  • Eagerness to learn emerging AI technologies and testing methodologies.

Eagerness to learn emerging AI technologies and testing methodologies.

Eagerness to learn emerging AI technologies and testing methodologies.Eagerness to learn emerging AI technologies and testing methodologies.I'm interested{{criteriaIndex}} {{field}} {{captialize(condition)}} ( ) {{cxPropHelpText}} {{cxPropField.consent_details.description}} {{record.Posting_Title}} {{record.Posting_Title}} {{record.Posting_Title}} {{candidate.Email}} {{topMessage}} Job Details {{topMessage}} previous next {{title}} {{score}}% Job Description {{unescape(sanitizeHTML(descriptionHTML))}} {{message}} Step {{curStepInMandatorySecPrompt}}/{{totalNumOfStepsInMandatorySecPrompt}} For privacy and security purposes, please go through the following points and provide consent. Accept Decline {{getI18n("zr.careers.publicpage.meta.joblisting")}} {{getI18n("zr.careers.publicpage.meta.joblisting")}} {{cxPropAssessment.name}} {{getI18n("zr.questionnaire.question.information.heading")}} {{getI18n("zr.cw.autofill.head")}} {{cxPropBodyMessage}} {{getI18n("zr.careers.autopopulate.success")}} {{getI18n("zr.cw.apply.sign",cxPropCompanyInfo.name)}} {{if(cxPropDetails.applyWithSeekButton,cxPropDetails.applyWithSeekButton.buttonLabel,getI18n("zr.quickapply.apply.toggle","Seek"))}} {{getI18n('zr.eeo.questionnaire.portal.maintitle')}} {{botName}} {{getI18n("zr.zia.sb.consent.msg1")}}{{criteriaIndex}}{{criteriaIndex}}{{field}} {{captialize(condition)}}{{field}}{{captialize(condition)}}( )(){{cxPropHelpText}}{{cxPropHelpText}}{{cxPropField.consent_details.description}}

{{cxPropField.consent_details.description}}

{{record.Posting_Title}}{{record.Posting_Title}}{{record.Posting_Title}}

{{record.Posting_Title}}

{{record.Posting_Title}}{{record.Posting_Title}}

{{record.Posting_Title}}

{{record.Posting_Title}}
  • {{record.Posting_Title}}

{{record.Posting_Title}}

{{record.Posting_Title}}{{candidate.Email}}{{candidate.Email}}{{candidate.Email}}

{{candidate.Email}}

{{topMessage}}Job DetailsJob DetailsJob DetailsJob Details{{topMessage}}previousnext{{title}} {{score}}% Job Description {{unescape(sanitizeHTML(descriptionHTML))}}{{title}} {{score}}% Job Description {{unescape(sanitizeHTML(descriptionHTML))}}{{title}} {{score}}%

{{title}}

{{title}}{{score}}%Job Description {{unescape(sanitizeHTML(descriptionHTML))}}

Job Description

{{message}}

Step {{curStepInMandatorySecPrompt}}/{{totalNumOfStepsInMandatorySecPrompt}}

For privacy and security purposes, please go through the following points and provide consent.Accept DeclineAccept DeclineAcceptDecline{{getI18n("zr.careers.publicpage.meta.joblisting")}}{{getI18n("zr.careers.publicpage.meta.joblisting")}}
  • {{getI18n("zr.careers.publicpage.meta.joblisting")}}
{{getI18n("zr.careers.publicpage.meta.joblisting")}}{{getI18n("zr.careers.publicpage.meta.joblisting")}}{{getI18n("zr.careers.publicpage.meta.joblisting")}}
  • {{getI18n("zr.careers.publicpage.meta.joblisting")}}
{{getI18n("zr.careers.publicpage.meta.joblisting")}}{{cxPropAssessment.name}} {{getI18n("zr.questionnaire.question.information.heading")}}{{cxPropAssessment.name}} {{getI18n("zr.questionnaire.question.information.heading")}}{{cxPropAssessment.name}}

{{getI18n("zr.questionnaire.question.information.heading")}}

{{getI18n("zr.cw.autofill.head")}} {{cxPropBodyMessage}} {{getI18n("zr.careers.autopopulate.success")}}

{{getI18n("zr.cw.autofill.head")}}

{{cxPropBodyMessage}}

{{getI18n("zr.careers.autopopulate.success")}}

{{getI18n("zr.cw.apply.sign",cxPropCompanyInfo.name)}}

{{getI18n('zr.eeo.questionnaire.portal.maintitle')}}{{botName}}{{botName}}{{getI18n("zr.zia.sb.consent.msg1")}}{{getI18n("zr.zia.sb.consent.msg1")}}{{getI18n("zr.zia.sb.consent.msg1")}}{{getI18n("zr.zia.sb.consent.msg1")}}{{getI18n("zr.zia.sb.consent.msg1")}}{{getI18n("zr.zia.sb.consent.msg1")}}{{getI18n("zr.zia.sb.consent.msg1")}}