Job Title: Gen AI Automation Tester (0–2 Years Experience)

Location

Hyderabad

Experience

0–2 Years

Job Summary

We are looking for a Gen AI Automation Tester with 0–2 years of experience who is passionate about software testing, automation, and emerging AI technologies. The ideal candidate will be responsible for validating Gen AI applications, LLM-based workflows, APIs, chatbots, copilots, and intelligent automation systems to ensure quality, reliability, performance, and accuracy.

This role is ideal for candidates with a foundation in QA automation and an interest in testing AI/ML and Generative AI systems.

Key Responsibilities

• Design, develop, and execute test cases for Gen AI applications, AI copilots, chatbots, and LLM-based workflows.
• Perform functional, regression, integration, and API testing for AI-enabled systems.
• Build and maintain automation test scripts using tools/frameworks such as Selenium, Playwright, Cypress, or similar.
• Validate prompt-response behavior, output consistency, relevance, and edge-case handling in Gen AI applications.
• Test REST APIs / microservices supporting Gen AI solutions using tools like Postman, REST Assured, or similar.
• Identify and report functional defects, hallucinations, response inconsistencies, latency issues, and data handling risks.
• Assist in testing RAG-based applications, prompt workflows, and LLM integrations with enterprise systems.
• Work closely with developers, business analysts, product owners, and AI engineers to understand requirements and define test coverage.
• Support test data preparation, environment validation, and defect triage.
• Contribute to test automation framework enhancements and CI/CD pipeline integration.
• Participate in quality assurance for AI outputs, including relevance, factual consistency, toxicity/basic bias checks, and formatting validation.
• Maintain clear test documentation, execution reports, and defect logs.

Required Skills

• 0–2 years of experience in Software Testing / QA Automation / API Testing
• Basic knowledge of test automation tools such as:
• Selenium / Playwright / Cypress
• Postman / REST Assured
• Basic programming/scripting knowledge in at least one language:
• Java / Python / JavaScript
• Understanding of:
• STLC / SDLC
• Functional testing and regression testing
• API testing concepts
• Defect lifecycle and bug reporting
• Basic understanding of Generative AI / LLM concepts such as:
• Prompts and prompt testing
• Chatbot / Copilot validation
• Response quality checks
• Hallucination and output variability
• Familiarity with Git, Jira, Test Management tools
• Good analytical and problem-solving skills
• Strong communication and documentation skills

Good to Have Skills

• Exposure to Gen AI tools/platforms such as:
• OpenAI / Azure OpenAI
• Google Gemini
• Claude
• LangChain / LlamaIndex
• Basic understanding of:
• Prompt Engineering
• RAG (Retrieval-Augmented Generation)
• Vector databases / embeddings (high level)
• Exposure to CI/CD tools such as Jenkins, GitHub Actions, or Azure DevOps
• Knowledge of performance or security testing basics for AI APIs
• Experience in validating chatbot conversations or workflow automation tools

Educational Qualification

• Bachelor’s degree in Computer Science, IT, Engineering, or related field
• Relevant certifications in Testing / Automation / AI fundamentals are a plus