P
Quality Assurance Analyst - Conversational AI Testing
Priwils
8h ago
0DevRemote, USjobspy_indeed
remoteindeed
Job Description
**Summary**
We are seeking a skilled Quality Assurance Analyst to join our team and support testing activities for Kore AI's conversational AI platform. The ideal candidate will have a strong background in software testing, with a focus on AI and natural language processing technologies. The resource will report to the Senior Director, Analysis, Change \& Quality and will follow the best practices and standard operating procedures established by the quality assurance team.
**Responsibilities*** Define functional and non\-functional test strategies for the conversational AI platform.
* Collaborate with AI developers and product owner to design comprehensive test cases covering various user scenarios, edge cases, and potential failure points.
* This is a Remote (work from home) position.
* Conduct rigorous testing of conversational AI models, including:
+ Functional testing to verify correct behavior, assess the accuracy, relevance, and coherence of AI\-generated responses.
* + Performance testing to evaluate response times, system load, and resource utilization.
+ Usability testing to assess the user experience and identify areas for improvement.
+ Coordinate security testing with the Information Technology Security team to identify and mitigate potential vulnerabilities.
+ Integration testing to ensure the product is integrated with various platforms and that data integrity is maintained between various back\-end systems.
+ Coordinate with cross\-functional quality assurance resources to conduct end to end testing between other systems/platforms.
* Generate detailed reports on test executions, including bug reports, performance metrics, and user experience insights.
* Analyze test results to identify trends, patterns, and areas requiring improvement and work with the product owner for prioritization in the product backlog.
* Track and manage bug resolution and feature enhancements.
* Provide actionable feedback to AI developers to improve model performance, accuracy, and user satisfaction.
* Collaborate with the team to refine training data, adjust model parameters, and optimize algorithms.
* Own User Acceptance Testing (UAT) and facilitate by providing demos and test data of the product to the UAT testers.
* Keep up to date with the latest developments in conversational AI, natural language processing, and machine learning.
* Research and explore new testing methodologies and tools to enhance the QA process.
**Requirements*** Bachelor’s degree in computer science, information technology, or related field.
* At least 5 years of experience in software testing and quality assurance methodologies.
* Knowledge of AI and machine learning concepts, particularly in natural language processing.
* Expertise in testing conversational AI or chatbot systems.
* Excellent analytical and problem\-solving abilities.
* Strong communication and collaboration skills.
**Preferred Qualifications*** Experience in testing Chatbots such as Micro
