Job Title:  T&T| Customer| S&S| Consultant | AI Tester | Bangalore

The team

Customer has to do much more than keep the wheels turning; it is the engine that drives functional excellence and the enabler of innovation and long-term growth. Learn more about: Customer

Your work profile

As a Consultant in our Consulting team, you’ll work with teams and clients to ensure the quality, reliability, accuracy, and safety of AI-powered solutions.

• Design and execute test plans, test cases, and test scenarios for AI/ML applications.
• Validate functional, performance, reliability, and accuracy aspects of Generative AI, LLM, chatbot, and conversational AI solutions.
• Evaluate AI responses for accuracy, relevance, consistency, factual correctness, and adherence to business requirements.
• Perform prompt testing, prompt validation, and regression testing for LLM-based applications.
• Identify and document defects, hallucinations, bias, inconsistencies, and AI-specific edge cases.
• Validate data quality, input/output behaviour, and model performance across different datasets and user scenarios.
• Collaborate with developers, data scientists, ML engineers, and business teams to resolve issues and improve solution quality.
• Prepare test plans, test reports, defect reports, and other project documentation.
• Stay updated with emerging AI/ML and Generative AI trends and apply relevant testing practices.

Key skills required: 

• 2–4 years of experience in Software Testing, QA, AI/ML Testing, or related areas.
• Hands-on experience testing AI/ML applications, Generative AI, LLMs, chatbots, or conversational AI.
• Strong understanding of testing methodologies, SDLC/STLC, Agile, and QA processes.
• Experience in prompt testing, LLM response evaluation, regression testing, and defect management.
• Strong analytical, problem-solving, communication, and stakeholder management skills.
• Knowledge of Python, SQL, API testing, automation, or AI evaluation tools will be an added advantage.

Desired Qualifications: 

• 2–4 years of relevant experience in AI/ML Testing or QA.
• Experience in at least one end-to-end AI/ML or Generative AI implementation.
• Graduate degree in Computer Science, IT, Engineering, Data Science, AI, or a related discipline.
  
  

Location and way of working: 

• Base location: Bangalore 
• Willingness to travel for short- and long-term durations