AI Quality Analyst – Portuguese (Remote, $15.3/hr)

About the role

We are looking for a Portuguese‑speaking AI Quality Analyst to join our remote team on a short‑term contract. You will evaluate how well AI models personalize responses and ensure the output is accurate, helpful, and grounded in context.

Key responsibilities

• Design and execute conversational prompts to test personalized AI interactions.
• Assess AI model usage of personal context and rank responses using predefined criteria.
• Identify hallucinations, flawed inferences, incorrect personalization, and unnatural behavior.
• Write clear, structured rationales supporting evaluation decisions.
• Review model debug information and verify proper data source utilization.
• Maintain data quality standards throughout the evaluation process.

Required profile

• Professional proficiency in reading and writing Portuguese.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking, attention to detail, and excellent written communication.
• Ability to work independently in a remote environment with full‑time availability (30‑40 hours/week, including 4 hours overlap with PST).

Required skills

What we offer

• Competitive hourly rate of $15.3 USD.
• Short‑term contract (2 months) with the possibility of extension.
• Fully remote work setup – use your own desktop or laptop with a stable internet connection.