Senior Quality Assurance Analyst (GenAI)

Work Location: Vancouver, BC - 100% onsite Responsibility: - Test POC for a product area and/or hi-priority projects - Proactively identifies and implements test process and practices - Defines, manages and meets project schedules; prioritizes and works multiple tasks across projects - Works effectively and efficiently with minimal supervision - Mentors other QA analysts or may lead them on a project - Communicate plan / updates / status of product effectively to all stakeholders Qualification: - 10 years of experience in testing domain - Familiarity with testing life cycle processes, test case planning, test case designing and test execution - Experience creating test plan and test strategy. - Able to identify best test practices and processes to be followed in the Services - Experience with handling daily/ weekly test report preparations, review test results and defect reports - Expertise to manage and coordinate a 7 member team (preferred) - Experience working in agile methodology and framework - Experience in the delivery of status reporting, capturing project and test metrics. - Well Experienced in creating and planning estimates, test planning, test reporting, scheduling tasks - Good communication, reporting and coordination skill GenAI-Specific Skills: Prompt Engineering: Craft effective prompts to elicit desired responses from LLMs. Conversational Flow Understanding: Analyze and test dialogue flows, including context switching and multi-turn conversations. LLM Interaction: Experience with chatting with LLMs, understanding limitations, and identifying potential biases or errors. Creative Thinking: Develop innovative test cases and scenarios that challenge GenAI systems. Adaptability: Learn and adapt quickly to new AI models, tools, and processes in the rapidly evolving field of GenAI. Domain Knowledge: Familiarity with GenAI Applications: Understand various GenAI applications, such as chatbots, virtual assistants, and content generation tools. Knowledge of AI-Generated Content: Familiarity with types of AI-generated content, including text, images, videos, and audio. Understanding of AI Policies: Familiarity with AI policies, including guidelines on content generation, safety, and bias. Testing and Evaluation: Harmful Content Detection : Identify and flag potentially harmful or policy-violating content generated by GenAI systems. Bias Assessment : Assess and identify biases in GenAI-generated content, including political leanings, stereotypes, and discriminatory language. Exploratory Testing : Explore and test edge cases, including unusual or unexpected inputs, to identify potential issues and vulnerabilities. Adversarial Testing : Design and execute adversarial tests to simulate malicious or unintended uses of GenAI systems.

Location: Greater Vancouver, CA

Posted Date: 4/18/2025