• Job Description

  Req#: CREQ221847
  Experience Level 5 to 8 years
  Primary Skills Functional Testing UI Testing Integration Testing and Performance Testing
  
  Key Responsibilities
  Design develop and execute test strategies and test cases for GenAI based applications
  Test LLM driven functionalities, including prompt based responses semantic search and AI-generated content
  Validate data pipelines and backend logic involving PostgreSQL and GCP services BigQuery Vertex AI Cloud Functions etc
  Develop robust test cases for API UI functional integration and performance testing
  Ensure quality of AI model integration e.g., Google Gemini through test coverage of edge cases, bias handling, and content validation
  Collaborate with developers data engineers and AI and ML teams to understand application logic and deliver end to end QA coverage
  Implement test automation tools e.g., PyTest, Selenium, Postman REST Assured and CI/CD pipeline integrations
  Analyze test results track defects and participate in root cause analysis and defect triaging
  Ensure compliance with responsible AI practices and validate model outputs against business requirements
  
  Required Skills and Qualifications
  5 plus years of QA/testing experience with at least 2 years in AI/ML or GenAI application testing
  Experience with Google Cloud Platform (GCP) services and cloud-native testing approaches
  Strong knowledge of PostgreSQL, including writing queries for validation and data integrity testing
  Familiarity with Generative AI, LLMs, or prompt-based systems like Google Gemini
  Hands-on experience in API and UI testing
  Experience with test management tools (e.g., JIRA, TestRail) and version control (e.g., Git)
  Proficiency in scripting and automation using Python, JavaScript, or Java is preferrable
  Strong analytical and debugging skills
  
  Preferred Qualifications
  Understanding of RAG (Retrieval-Augmented Generation), embeddings, and vector search testing
  Experience with tools like LangChain, Vertex AI, or other LLM orchestration frameworks
  Familiarity with AI performance testing and content validation frameworks
  Experience in validating data privacy, ethical AI, and hallucination detection in GenAI systems
  

• About the company

  Virtusa Corporation is an American information technology services company founded in 1996 in Sri Lanka and has its headquarters in Southborough, Massachusetts, United States.

Notice