Portuguese AI Content Analyst – Remote, $15.3/hr

About the role

We are looking for a Portuguese‑speaking AI Content Analyst to join our short‑term project team. You will work remotely, evaluating how well AI models personalize responses and maintain conversational quality.

Key responsibilities

• Design and run conversational prompts to test personalized AI interactions.
• Assess AI responses for relevance, grounding, personalization accuracy, and overall helpfulness.
• Compare and rank multiple AI‑generated answers using predefined criteria.
• Identify hallucinations, flawed inferences, incorrect personalization, and unnatural response behavior.
• Write clear, structured rationales supporting each evaluation decision.
• Review model debug information to verify proper use of data sources.
• Maintain data quality standards and follow project guidelines throughout the evaluation process.

Required profile

• Professional proficiency in reading and writing Portuguese.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking, attention to detail, and excellent written communication.
• Ability to evaluate nuanced and ambiguous AI responses objectively.
• Comfortable working independently in a remote environment with a stable internet connection.

Required skills

What we offer

• Short‑term contract (2 months) with full‑time hours (30‑40 h/week) and a $15.3 per hour rate.
• Remote work with flexible scheduling, requiring a 4‑hour overlap with Pacific Standard Time.