AI Quality Analyst – Portuguese (Remote, $15.3/hr)

About the role

We are seeking a Portuguese‑speaking AI Quality Analyst to evaluate and improve personalized AI interactions. This remote, full‑time position runs for two months and offers $15.3 per hour.

Key responsibilities

• Design and execute conversational prompts to assess personalized AI interactions.
• Evaluate how effectively AI models use personal context to generate relevant, helpful responses.
• Check model outputs for grounding, personalization accuracy, integration quality, and overall helpfulness.
• Compare and rank AI‑generated responses using predefined criteria.
• Identify hallucinations, flawed inferences, incorrect personalization, and unnatural response behavior.
• Write clear, structured rationales supporting evaluation decisions.
• Review model debug information and verify proper use of available data sources.
• Maintain data‑quality standards and follow project guidelines throughout the evaluation process.

Required profile

• Professional proficiency in reading and writing Portuguese.
• Experience in data annotation, AI quality evaluation, content moderation, or related fields.
• Strong analytical thinking, attention to detail, and excellent written communication.
• Ability to evaluate nuanced and ambiguous AI responses objectively.
• Comfortable working independently in a remote environment.
• Desktop or laptop with a stable internet connection.
• Full‑time availability (30‑40 hours per week) with at least 4 hours overlap with PST.

Required skills