Portuguese AI Quality Analyst – Remote (Full‑time)

About the role

We are looking for a Portuguese Language Expert to join our AI Quality team on a short‑term contract. You will work remotely, evaluating how well conversational AI models use personal context to generate relevant, helpful responses in Portuguese.

Key responsibilities

• Design and execute conversational prompts to assess personalized AI interactions.
• Evaluate model responses for grounding, personalization accuracy, integration quality, and overall helpfulness.
• Compare and rank AI‑generated responses side‑by‑side using predefined evaluation criteria.
• Identify hallucinations, flawed inferences, incorrect personalization, and unnatural response behavior.
• Write clear, structured rationales supporting evaluation decisions.
• Review model debug information and verify proper utilization of available data sources.
• Maintain data quality standards and follow project guidelines throughout the evaluation process.

Required profile

• Professional proficiency in reading and writing Portuguese.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking and attention to detail.
• Excellent written communication skills.
• Ability to work independently in a remote environment with full‑time availability (30‑40 hours per week) and a 4‑hour overlap with PST.

Required skills

• Proficiency in Portuguese language.
• Experience with data annotation and AI evaluation tasks.
• Analytical assessment of nuanced and ambiguous AI responses.

What we offer

• Competitive hourly rate of $15 USD.
• Fully remote work with flexible scheduling.
• Opportunity to contribute to cutting‑edge conversational AI technologies.