We are seeking a meticulous, analytical, and tech-savvy Online AI Quality Analyst to evaluate, test, and enhance the performance of artificial intelligence models and machine learning outputs. In this remote role, you will review AI-generated responses, identify inaccuracies or biases, execute rigorous quality assurance testing protocols, and collaborate with engineering teams to improve model accuracy and user experience.
Job Overviw
Job type: Full-time / Remote
Work setting: Work from home
Location: Remote
Salary: $25 – $35/per hour
Responsibilities
Model Evaluation: Assess, test, and rate AI model outputs for accuracy, safety, relevance, tone, and adherence to established guidelines.
Quality Assurance: Identify edge cases, factual errors, or algorithmic biases, and document detailed bug reports to support engineering refinements.
Data Analysis: Analyze evaluation metrics and performance trends to help fine-tune generative AI datasets and improve response quality.
Requirements
Qualifications: Relevant degree in Computer Science, Data Analytics, Linguistics, Cognitive Science, Philosophy, or a related field.
Experience: Proven professional experience working as an AI trainer, quality assurance analyst, data annotator, or software tester in a tech or digital environment.
Skills: Strong attention to detail, exceptional analytical and critical thinking capabilities, familiarity with generative AI systems, and excellent written communication skills.