Ilya Andriunkin - Medical AI Evaluation Specialist

🚀 FRATCH GPT 2.0 - Find freelancers with a single prompt. Now including price benchmarking.

Recommended expert

Available

Ukraine

Check rate

Experience

Oral & Maxillofacial Surgery Nurse

Clinical Hospital

Assisted in oral and maxillofacial surgical procedures, including trauma and reconstructive cases.
Prepared patients and surgical environments according to perioperative safety standards.
Supported intraoperative patient monitoring and postoperative patient care.
Assisted clinical teams during surgical procedures and maintained appropriate patient-care protocols.

AI Evaluation Specialist & Quality Reviewer

Global AI Evaluation Projects

Evaluated large volumes of AI-generated content across ASR, machine translation, LLM, and other AI evaluation tasks, applying detailed project-specific guidelines and quality standards.
Reviewed 10,000+ machine-generated ASR transcriptions, identifying semantic, grammatical, formatting, pronunciation, and meaning-related errors.
Evaluated machine-generated translations across English, Ukrainian, and Russian, including English → Ukrainian, Ukrainian → English, Russian → English, and other multilingual language pairs.
Performed complete source-target comparisons to identify mistranslations, omissions, additions, repetitions, terminology inconsistencies, fluency problems, stylistic issues, and locale-specific errors.
Assigned Acceptability Scores on a 0–100 scale, assessing whether translations accurately conveyed source meaning and met linguistic quality requirements.
Applied structured translation error taxonomies, including Accuracy, Fluency, Terminology, Omission, Addition, Repetition, Style, and Locale-related issues.
Validated other evaluators' Score Justifications, determining whether comments accurately reflected the source–translation relationship and whether assigned scores were reasonable.
Reviewed individual evaluation findings for factual validity, category accuracy, and severity, including Critical, Major, Minor, and informational classifications.
Identified incorrectly classified, overstated, understated, or overlooked translation errors and provided evidence-based rationales with corrected scores or classifications when required.
Distinguished objective linguistic errors from acceptable alternative translations and subjective stylistic preferences, avoiding unjustified penalties.
Performed secondary quality audits to improve annotation consistency and evaluator agreement across multilingual projects.
Conducted large-scale audio segmentation for voice-assistant interactions, identifying trigger phrases, interaction boundaries, overlapping speech, background audio, and edge-case scenarios.
Applied semantic consistency scoring, evaluating keyword preservation, meaning retention, natural language quality, and overall comprehensibility.
Categorized transcription errors involving Proper Nouns, Hot Words, Function Words, Affixes, punctuation, formatting, pronunciation, and semantic consistency.
Followed project-specific SOPs, evaluation rubrics, quality standards, and delivery requirements.
Contributed to quality improvement through reviewer feedback, consistency checks, and secondary quality assurance.

Medical AI Subject Matter Expert (SME)

Healthcare LLM Evaluation & AI Validation Projects

Evaluated 5,000+ AI-generated medical responses across clinical reasoning and healthcare AI evaluation tasks.
Assessed AI-generated differential diagnoses, treatment recommendations, clinical explanations, and medical reasoning for factual accuracy, completeness, and clinical safety.
Identified hallucinations, unsupported claims, incomplete reasoning, unsafe medical recommendations, and inconsistencies with evidence-based medical practice.
Evaluated whether AI responses correctly interpreted clinical information and reached medically defensible conclusions.
Verified clinical information using PubMed, ADA, NICE, and internationally recognized medical references.
Applied structured evaluation rubrics covering helpfulness, factual correctness, reasoning quality, completeness, clinical appropriateness, and evidence alignment.
Performed evidence-based fact-checking of AI-generated medical claims and identified unsupported or misleading statements.
Assessed differential diagnosis reasoning and whether proposed diagnoses were appropriately supported by the clinical information provided.
Evaluated medical AI responses for potential safety issues and clinically inappropriate recommendations.
Contributed subject-matter expertise as a Doctor of Dental Medicine to healthcare-focused AI evaluation and validation workflows.

General Dentist

Private Practice

Interpreted 2,000+ CBCT and 2D radiographic studies for diagnostic and treatment-planning purposes.
Developed evidence-based treatment plans integrating clinical examination and radiographic findings.
Diagnosed complex dental and maxillofacial conditions using modern imaging techniques.
Performed comprehensive patient examinations and maintained clinical documentation.
Applied clinical reasoning and evidence-based decision-making across routine and complex dental cases.

Summary

Doctor of Dental Medicine with professional experience in AI evaluation, multilingual linguistic quality assurance, machine translation, ASR, LLM, and Computer Vision projects. Specialized in evaluating AI-generated content, validating human evaluations, linguistic annotation, transcription auditing, and quality assurance for large-scale multilingual datasets.

Experienced in machine translation quality assessment across English, Ukrainian, and Russian, including source-target semantic comparison, acceptability scoring, translation error detection, evaluator justification validation, and error severity assessment.

Additional expertise in ASR evaluation, audio segmentation, semantic consistency analysis, and multilingual transcription quality. Medical AI experience includes evaluation of AI-generated clinical responses, clinical reasoning validation, hallucination detection, evidence-based medical fact-checking, and guideline-based assessment.

Strong ability to work with detailed evaluation rubrics, identify objective errors without over-penalizing acceptable alternatives, assess evaluator consistency, and provide evidence-based quality judgments in accordance with project-specific guidelines.

Skills

Ai Evaluation & Quality Assurance

Ai Output Evaluation
Ai Quality Assurance
Secondary Quality Review
Annotation Auditing
Evaluator Performance & Consistency Review
Evaluation Rubric Application
Rubric-Based Quality Assessment
Error Taxonomy & Classification
Severity Assessment
Guideline & Sop Compliance
Edge-Case Analysis
Quality Control
Human-In-The-Loop Ai Evaluation

Machine Translation Evaluation

Multilingual Machine Translation Evaluation
Translation Quality Assessment
Acceptability Scoring (0-100)
Source-Target Semantic Comparison
Translation Error Detection
Translation Evaluation Validation
Evaluation Justification Validation
Finding & Error Severity Validation
Accuracy / Fluency / Terminology Assessment
Omission & Addition Detection
Repetition Detection
Style & Locale Evaluation
Multilingual Linguistic Qa

Asr & Linguistic Evaluation

Asr Evaluation
Transcription Auditing
Audio Segmentation
Semantic Consistency Analysis
Homophone & Pronunciation Error Detection
Proper Noun Evaluation
Hot Word Evaluation
Function Word Evaluation
Affix Error Identification
Trigger Phrase Detection
Speech Boundary Identification
Overlapping Speech Analysis
Background Audio Identification
Multilingual Annotation

Llm & Medical Ai

Llm Response Evaluation
Prompt Evaluation
Instruction-Following Assessment
Rlhf Evaluation
Medical Ai Validation
Clinical Reasoning Evaluation
Hallucination Detection
Medical Response Evaluation
Differential Diagnosis Assessment
Treatment Recommendation Evaluation
Evidence-Based Fact-Checking
Pubmed Verification
Ada & Nice Guideline Validation

Technical & Clinical

Dicom
Pacs
Cbct Interpretation
2d Radiographic Analysis
Enterprise Annotation Platforms
Microsoft Office
Google Workspace

Additional Expertise

Multilingual Ai Data Evaluation
Linguistic Quality Assurance
Machine Translation Quality
Speech Recognition Evaluation
Llm Evaluation
Medical Ai & Healthcare Ai
Human Evaluation Of Ai-Generated Content
Large-Scale Annotation Workflows
Quality Control & Secondary Review
Evidence-Based Evaluation
Clinical & Linguistic Error Analysis

Languages

Russian

Native

Ukrainian

Native

English

Advanced

Education

Oct 2019 - Jun 2024

Ivano-Frankivsk National Medical University

Doctor of Dental Medicine · Dental Medicine · Ivano-Frankivs'k, Ukraine

Statistics

Experience

Total positions 4

Qualifications

Highest degree Doctorate

Profile

Member since

September 2026

Need a freelancer? Find your match in seconds.

Try FRATCH GPT

Frequently asked questions

Have questions? Find more information here.

Ilya speaks the following languages: Russian (Native), Ukrainian (Native), English (Advanced).

Based on recent experience, Ilya would be well-suited for roles such as: Oral & Maxillofacial Surgery Nurse, AI Evaluation Specialist & Quality Reviewer, Medical AI Subject Matter Expert (SME).

Ilya's most recent position is Oral & Maxillofacial Surgery Nurse at Clinical Hospital.

Ilya holds a Doctorate in Dental Medicine from Ivano-Frankivsk National Medical University.

Ilya is immediately available for suitable projects.