QA Engineer (GenAI)
Job description
Job Summary:
Dexian is seeking a QA Engineer (GenAI) for an opportunity with a client located in Chicago, IL.
Responsibilities:
-
Develop and implement comprehensive test plans, test cases, and automated tests for GenAI models and systems, encompassing functionality, performance, accuracy, and ethical considerations
-
Verify the quality and performance of GenAI models, including evaluating accuracy, identifying biases, and assessing the reliability of generated outputs
-
Ensure the quality of training data for AI models and collaborate with data scientists to preprocess and validate data
-
Work closely with data scientists, ML engineers, product managers, and other stakeholders to define testing requirements, identify potential risks, and integrate testing into the development life cycle
-
Develop and maintain automated test suites for AI/ML pipelines, APIs, and user interfaces
-
Identify, document, and track defects, collaborating with developers to ensure timely resolution and prevent regressions
-
Ensure that GenAI models are developed and deployed ethically, addressing issues like bias, fairness, and responsible AI usage
-
Conduct load, stress, and security testing to ensure the reliability and robustness of AI systems
- Contribute to the continuous improvement of testing methodologies, tools, and processes
- Bachelor’s degree in Computer Science, Software Engineering, or a related field
- 3+ years of experience in QA engineering, with a focus on AI/ML systems
- Strong programming skills in Python, Java, or other relevant languages; experience with testing frameworks and tools (e.g., Selenium, Cypress, JUnit, pytest); knowledge of AI/ML concepts and techniques; experience with cloud platforms (e.g., AWS, Azure, GCP)
- Excellent communication, collaboration, problem-solving, and analytical skills
- Understanding of the unique challenges and considerations in testing generative AI systems
- Remote with 20% travel
- Contract to end of year, potential extensions
- Must be US Citizen
- 40 hours per week and looking to start asap
Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian’s platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.
Dexian’s brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.
Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.
