Portuguese AI Quality Analyst – Remote, $15.3/hr

About the role

We are seeking a Portuguese Language Specialist to join our AI evaluation team on a short‑term contract. You will work remotely, reviewing and rating AI‑generated conversational responses to ensure they are personalized, accurate, and helpful.

Key responsibilities

• Design and execute prompts to test personalized AI interactions.
• Assess how well AI models use personal context to generate relevant replies.
• Evaluate model outputs for grounding, personalization accuracy, integration quality, and overall usefulness.
• Compare and rank AI responses side‑by‑side using predefined criteria.
• Identify hallucinations, flawed inferences, incorrect personalization, and unnatural behavior.
• Write clear, structured rationales supporting evaluation decisions.
• Review model debug information and verify proper use of data sources.
• Maintain data quality standards and follow project guidelines throughout.

Required profile

• Professional proficiency in reading and writing Portuguese.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking and attention to detail.
• Excellent written communication skills.
• Ability to evaluate nuanced and ambiguous AI responses objectively.
• Comfortable working independently in a remote environment with a stable internet connection.

Required skills

• Professional proficiency in Portuguese (reading and writing).

What we offer

• Hourly rate of $15.3 USD.
• Full‑time remote contract for 2 months (30‑40 hours per week).
• Flexible schedule with a required 4‑hour overlap with Pacific Standard Time.