Data Annotator – French AI Evaluation

About the role

We are looking for a detail‑oriented Data Annotator to evaluate AI‑generated responses in French. The position involves side‑by‑side comparison of outputs from different models across a variety of real‑world scenarios, helping improve the accuracy and relevance of AI systems.

Key responsibilities

• Perform side‑by‑side (SBS) comparisons of AI‑generated responses.
• Assess outputs for accuracy, relevance, clarity, and instruction‑following.
• Identify nuances in tone, meaning, and cultural context specific to French.
• Apply detailed, scenario‑specific annotation guidelines consistently.
• Maintain high‑quality evaluations and documentation.

Required profile

• Native or professional fluency in French.
• Strong English reading comprehension for guideline interpretation.
• Prior experience with side‑by‑side labeling or annotation.
• Excellent analytical thinking and meticulous attention to detail.
• Ability to quickly understand and apply structured evaluation frameworks.

Required skills

• Side‑by‑side (SBS) annotation.
• Data annotation tools.
• Analytical evaluation of AI outputs.

What we offer

• Competitive hourly compensation aligned with local Colombian market (COP 46,900–53,400).
• Full‑time monthly equivalent (COP 7,506,000–8,541,000) based on experience.
• Structured onboarding, training, and calibration sessions.
• Locally compliant benefits through an Employer of Record.
• Opportunity to work on cutting‑edge AI systems within a global multilingual team.