Software Engineer Annotator (Remote)

About the role

We are looking for a Software Engineer Annotator to evaluate and label software engineering datasets that train AI models and large language models. The role is fully remote and involves reviewing AI‑generated code, ensuring its correctness, efficiency, readability and security, and providing structured feedback to improve model performance.

Key responsibilities

• Annotate and review code datasets used for AI training, covering code completion, debugging, refactoring and optimization tasks.
• Assess AI‑generated code for correctness, efficiency, readability, and security.
• Label datasets and rank multiple AI responses based on accuracy and usefulness.
• Provide detailed feedback to AI trainers and data teams to enhance model outputs.
• Maintain adherence to annotation guidelines and quality standards.

Required profile

• Bachelor’s degree in Computer Science, Software Engineering or a related field.
• 3–5 years of professional software engineering experience.
• Experience with data annotation, AI training or code review is a plus.
• Strong understanding of software engineering principles, data structures and algorithms.
• Familiarity with the software development lifecycle and best coding practices.

Required skills

• Proficiency in Python, Java, JavaScript, C++ or Go.
• Ability to evaluate and annotate code datasets accurately.
• Knowledge of APIs, backend systems and web technologies.
• Basic understanding of AI/ML concepts and large language models.