Portuguese AI Quality Analyst – Remote, $11/hr

About the role

We are looking for a Portuguese‑speaking AI Quality Analyst to evaluate a personalization feature for Gemini. This short‑term, part‑time contract (30–40 hrs/week) focuses on assessing how well the model leverages personal context to generate relevant, accurate responses.

Key responsibilities

• Design and execute multi‑turn conversational prompts that require the AI to use personal context.
• Assess the model’s ability to incorporate past conversation data and activity into its replies.
• Evaluate responses for intent alignment, grounding issues, flawed inferences, or hallucinations.
• Perform side‑by‑side comparisons and rank model outputs based on usefulness, clarity, and overall experience.
• Write clear rationales for rankings, referencing specific conversation turns.
• Extract and verify debug information to confirm correct use of summaries and data sources.
• Maintain data hygiene by deleting evaluation conversations after completion.

Required profile

• Experience in data annotation, AI quality evaluation, content moderation, or related roles.
• Fluency in Portuguese (reading and writing).
• Willingness to use a personal Google account and enable personal data sources for assessment.
• Strong analytical thinking and attention to detail.

Required skills

• Creative prompt engineering.
• Understanding of personalization concepts in LLMs.

What we offer

• Competitive hourly rate of $11 USD.
• Fully remote work with flexible scheduling.
• Opportunity to contribute to cutting‑edge AI personalization research.