AI Evaluation Consultant (m/w/d)

Show number of applicants

Period 16.03.2026 - 13.05.2026

Capacity from 95%

Daily rate 440 - 480€

Remote from 95%

Languages

English (Advanced)

Industries

Information Technology

Business areas

Audit Quality Assurance

Description

We are seeking an analytical and technically-minded professional to:

Evaluate AI outputs and processes
Ensure quality, accuracy, and reliability
Identify logical errors, risks, and structural inconsistencies
Provide actionable insights and recommendations to the team

Ideal candidates:

Consultants, auditors, analysts, data researchers, or business/technical analysts with strong reasoning skills
Professionals curious about AI, process improvement, and quality evaluation
Problem-solvers who enjoy analyzing complex systems, logic, and scenarios

Key Responsibilities:

Lead evaluation of AI outputs and related processes
Review tasks against expected/ideal scenarios; identify gaps and risks
Provide structured, actionable recommendations to engineers, domain experts, and managers
Maintain and improve evaluation guidelines, checklists, SOPs
Suggest new approaches, tools, and processes to enhance AI evaluation

Requirements

Scenario validation, data analysis, auditing, or consulting experience
Analytical work in research, technical/business analysis, or risk evaluation

Knowledge & Skills:

Strong analytical and critical thinking
Attention to detail, reliability, and an ownership mindset
Technical understanding: JSON/YAML, basic Git/GitHub
Independent, proactive mindset

Nice to Have:

Scenario-based testing, annotation workflows, AI/LLM evaluation
Experience in cross-functional teams

Frequently asked questions

What is the duration of the project?

The project preferably starts in March 2026 and is planned to end in May 2026 (2 months).

What is the expected workload for the project?

The project requires a commitment of 95 - 100% capacity (full-time).

What is the remote work policy for the project?

The project offers 95 - 100% remote work.

What is the daily rate for the project?

The project offers a daily rate of 440 - 480€ which breaks down to an hourly rate of 55 - 60€/h.

What language skills are required for the project?

The project requires the following languages: English (Advanced).

Which industries is the project related to?

The project is related to the following industry: Information Technology.

Which business areas does the project cover?

The project covers the following business areas: Audit and Quality Assurance.

Not available? Can I still benefit from the project?

Yes! Recommend a freelancer for the project and earn 30% of FRATCH's profits every time they get placed — for the duration of that project. Simply share your invite link with a colleague to get started.

How to apply for the project?

To apply for the project, click the Apply button on the project page to submit your profile for review. We will forward your resume to the client and get back to you within a few days.