Portuguese LLM Quality Analyst (Remote)

About the role

We are looking for a Portuguese‑speaking LLM Quality Analyst to evaluate a new personalization feature for Gemini. Working remotely, you will assess how the model leverages information from past Gemini conversations, Gmail, Google Search and YouTube activity to deliver more relevant and helpful responses.

Key responsibilities

• Design and execute multi‑turn conversational prompts (1‑5 turns) that require the AI to use personal context.
• Review side‑by‑side model responses and rate them on grounding, integration and helpfulness.
• Identify incorrect personalization, poor inferences or forced connections.
• Write clear, concise rationales for each ranking, referencing specific turn numbers.
• Provide detailed annotations and constructive feedback to improve the system.

Required profile

• Fluent reading and writing proficiency in Portuguese.
• Full‑time availability in your local time zone to support a 24‑hour global operations team.
• Strong analytical thinking and meticulous attention to detail.
• Self‑motivated, able to work independently in a remote environment.
• Excellent written communication and collaboration skills.

Required skills

• Experience designing creative, multi‑turn prompts based on personal context.
• Understanding of personalization concepts and ability to evaluate AI responses.