AI Evaluation Engineer – Business & Operations Domain
Gramian Consulting · Colombie
Descripcion del puesto
About the role
Gramian Consultancy seeks an analytical professional to design and evaluate AI benchmark tasks that reflect real‑world business and operational workflows. You will create multi‑step scenarios that test AI systems on process optimization, decision‑making, and reporting challenges across diverse business environments.
Key responsibilities
- Design realistic business and operational workflow scenarios for AI evaluation.
- Create structured tasks involving analytics, reporting, operational reasoning, and process optimization.
- Develop clear specifications, expected outcomes, and validation logic for each task.
- Identify edge cases, bottlenecks, and failure scenarios within workflows.
- Assess AI‑generated outputs for reasoning quality, usefulness, and accuracy.
- Collaborate with reviewers and researchers to refine benchmark scenarios.
Required profile
- 3–10 years of experience in operations, analytics, consulting, or related business systems.
- Strong analytical thinking and problem‑solving skills in operational contexts.
- Hands‑on experience with operational workflows, reporting systems, CRM tools, or business analytics.
- Proficiency in documenting tasks, specifications, and evaluation criteria.
Required skills
- Spreadsheets
- Dashboards
- Operational reporting
- Workflow automation
- CRM tools
- Exposure to AI systems or automation platforms
Questions fréquentes
Por que reporta esta oferta?
Postula en 30 segundos
Ingresa tu email para postular. Se creara una cuenta automaticamente.
Al continuar, aceptas nuestras condiciones de uso.
Ya tienes cuenta? Iniciar sesion
Publicado hace 9 horas
Expira en 1 mes
5 vistas · 0 candidaturas
Aumenta tus posibilidades
Sube tu CV: te propondremos las ofertas que coinciden con tu perfil.
Analizando tu CV...
Gramian Consulting
Colombie