AI Quality Analyst (Portuguese) – Remote, $15.3/hr

About the role

We are looking for a detail‑oriented AI Quality Analyst fluent in Portuguese to join our remote team on a short‑term contract. You will help ensure that conversational AI systems generate personalized, accurate, and helpful responses for Portuguese‑speaking users.

Key responsibilities

• Design and execute conversational prompts to evaluate personalized AI interactions.
• Assess how effectively AI models use personal context to generate relevant responses.
• Evaluate model outputs for grounding, personalization accuracy, integration quality, and overall helpfulness.
• Compare and rank AI‑generated responses side‑by‑side using predefined evaluation criteria.
• Identify hallucinations, flawed inferences, incorrect personalization, and unnatural response behavior.
• Write clear, structured rationales supporting evaluation decisions.
• Review model debug information and verify proper utilization of available data sources.
• Maintain data quality standards and follow project guidelines throughout the evaluation process.

Required profile

• Professional proficiency in reading and writing Portuguese.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking and attention to detail.
• Excellent written communication skills.
• Ability to evaluate nuanced and ambiguous AI responses objectively.
• Comfortable working independently in a remote environment with a stable internet connection.

Required skills

• Experience with AI evaluation, annotation, content review, or localization projects.
• Understanding of personalization concepts and AI‑generated content evaluation.
• Familiarity with prompt creation and conversational AI systems.

What we offer

• Short‑term contract (2 months) with a rate of $15.3 per hour.
• Full‑time remote work (30‑40 hours per week) with a required 4‑hour overlap with PST.
• Opportunity to contribute to cutting‑edge AI personalization research.