Anita B.-AI Operations & Evaluation Systems Specialist

Check rate
Experience
Generalist Task Writer
Fleet AI, INC.
- Developed complex edge-case testing structures and executed advanced quality assurance protocols to optimize model alignment and instruction-following behavior.
RLHF Trainer & Prompt Specialist
Invisible Technologies
- Managed comparative reasoning and preference evaluation systems (RLHF) by isolating high-signal audio events within multimodal datasets.
- Conducted structural optimization for expert-level prompt upleveling pipelines, improving LLM responsiveness to complex instruction parameters.
- Engineered and calibrated localized Italian prompt datasets for safety and alignment workflows supporting a major enterprise client.
- Supervised and validated dialogue generation for conversational AI personalization projects, ensuring behavior consistency and output stability.
AI Response Evaluator
DataAnnotation
- Executed concurrent multi-model pairwise and matrix evaluations (2 to 4 models simultaneously), validating outputs against strict factual accuracy, logical syntax, and multi-layered rubric criteria.
- Systematically documented evaluation reasoning to stabilize preference data collection for Italian-language model training pipelines.
AI Data Annotator & Evaluator
Outlier AI
- Validated multi-dimensional acoustic parameters for generative audio pipelines using robust comparative judgment and preference tracking protocols.
- Executed high-volume, long-form data processing workflows under rigorous structure and formatting parameters, maintaining stable accuracy baselines.
- Formulated dense semantic and localized descriptions for computer vision datasets to support multimodal AI training pipelines.
- Categorized and isolated recurring failure patterns in ambient noise and non-speech vocalizations for Speech-to-Text performance tracking.
TTS Model Evaluator
Firstsource
- Coordinated comparative evaluation pipelines for synthetic voice models to optimize expressive naturalness and phonetic accuracy parameters.
- Provided structured data matrices and qualitative feedback documentation to maintain system calibration workflows.
Speech-to-Text Evaluator & Transcriber
Centific
- Audited and stabilized quality consistency inside automated speech recognition (ASR) pipelines, enforcing strict compliance with stylistic and phonetic guidelines.
- Resolved highly ambiguous linguistic evaluation scenarios resulting from model low-confidence intervals through manual high-fidelity transcription workflows.
- Maintained calibration stability and performed formal quality reviews of peer transcription pipelines as a designated QA Reviewer.
Tester
TestIO | uTest | BetaTesting
- Executed functional and exploratory testing sprints across mobile and web ecosystems, producing structured bug documentation and usability assessment reports.
Multilingual Audio Accent Evaluator
Welocalize
- Interpreted and applied complex 7-point evaluation rubrics to monitor and standardize prosodic authenticity, intonation, and native speaker alignment in speech synthesis datasets.
- Led high-density quality consistency analysis loops to isolate acoustic failure patterns, assessing script adherence and artifact presence across competing models.
- Authored precise phonetic calibration reports to drive iterative performance improvements for Text-to-Speech (TTS) engine optimization.
- Initiated proactive project escalation protocols upon detecting systemic model degradation trends.
Linguistic & Cultural Mediator (PROGRESSI Project)
I.C.S. "Oliena"
- Managed linguistic calibration and cross-cultural framework adaptation for French-language educational workflows within the lower secondary school system.
- Resolved communicative friction and optimized inclusion structures to align student performance metrics with institutional pedagogical rubrics.
ASR Transcriber & QA Reviewer
United Language Solutions
- Resolved structural and acoustic ambiguities stemming from regional accent variations (Sardinian) within a large-scale data evaluation ecosystem.
- Monitored inter-annotator agreement baselines and generated calibration data to align team-wide quality metrics.
- Maintained repeatable evaluation benchmarks across 100+ hours of speech datasets inside a deadline-driven, high-volume environment.
Substitute Teacher (Primary & Pre-School)
I.C.S. Orani-Orotelli "Francesco Delitala"
- Maintained operational stability and instructional continuity across multiple classroom environments, interpreting and adapting core educational guidelines under dynamic requirements.
Intercultural Mediator (Inclusion & Literacy Project)
I.C.S. Orani-Orotelli "Francesco Delitala"
- Designed and executed operational workflows for the integration and linguistic literacy of foreign-national students within the Ottana lower secondary school branch.
- Resolved highly ambiguous cultural scenarios and established functional communication loops to minimize learning gaps and calibrate educational inclusion.
Voice Recording & Image Annotation
Appen | Remotasks
- Supported foundational computer vision and voice-assistant training cycles through targeted object segmentation and acoustic generation workflows.
Industry experience
See where this freelancer has spent most of their professional time.
Experienced in Information Technology and Education.
Business area experience
See which departments and functions this freelancer has contributed to most.
Experienced in Information Technology, Research and Development, and Quality Assurance.
Summary
Language professional with 3+ years of experience in AI data annotation, RLHF alignment workflows, ASR/TTS calibration management, and multimodal evaluation frameworks across enterprise pipelines for major global technology companies. Specialized in ambiguity handling, cross-cultural mediation, and executing complex rubric systems at scale.
Skills
Ambiguity Resolution & Subjective System Alignment
Comparative Reasoning & Preference Evaluation (Rlhf)
Linguistic, Phonetic & Cross-Cultural Calibration
Structural Bias & Failure Pattern Recognition
Rubric Interpretation & Educational Framework Adaptation
Calibration Management & Escalation Logic Execution
Label Studio
Feather
Accunai
Multimango
Meridial Marketplace
Crowdcompute Workbench
Siri Grading Portal
Testio
Utest
Betatesting
Omegat
Google Workspace
Languages
Education
University of Sassari
MA · Foreign Literatures and Languages for Cultural Mediation · Sassari, Italy
University of Sassari
BA · Linguistic and Cultural Mediation · Sassari, Italy
Certifications & licenses
Google AI Essentials
Cross-Cultural Communication & Management
Statistics
Experience
Expertise
Qualifications
Profile
Frequently asked questions
Have questions? Find more information here.
Anita is based in Province of Nuoro, Italy and prefers 100% remote projects.
Anita speaks the following languages: Italian (Native), English (Advanced), French (Intermediate).
Anita has at least 4 years of experience. During this time, Anita has worked in at least 13 different roles and for 12 different companies. The average length of individual experience is 4 months. Note that Anita may not have shared all experience and actually has more experience.
Based on recent experience, Anita would be well-suited for roles such as: Generalist Task Writer, RLHF Trainer & Prompt Specialist, AI Response Evaluator.
Anita's most recent position is Generalist Task Writer at Fleet AI, INC..
In recent years, Anita has worked for Fleet AI, INC., Invisible Technologies, DataAnnotation, Outlier AI, and Firstsource.
Anita is most experienced in industries like Information Technology and Education.
Anita is most experienced in business areas like Information Technology, Research and Development, and Quality Assurance. Anita also has some experience in Operations.
Anita holds a Master in Foreign Literatures and Languages for Cultural Mediation from University of Sassari and a Bachelor in Linguistic and Cultural Mediation from University of Sassari.
Anita has 2 certificates. These include: Google AI Essentials and Cross-Cultural Communication & Management.
Anita is immediately available part-time for suitable projects.
Daily rate distribution
The rates shown represent the typical market range for freelancers in this position based on recent contracts on our platform.
Average rates for similar positions
Rates are based on recent contracts and do not include FRATCH margin.
The average daily rate is the mean of all daily rates from recent contracts of comparable freelancers on our platform.
The median daily rate is the middle value of all daily rates — half of comparable freelancers charge less, half charge more. Unlike the average, it is barely affected by outliers.
Calculated based on our freelancers’ daily rates as of 18 Sep 2026. Actual rates may vary depending on seniority level, experience, skill specialization, project complexity, and engagement length.
Similar freelancers
Discover other experts with similar qualifications and experience
Experts recently working on similar projects
Freelancers with hands-on experience in comparable project as a Generalist Task Writer
Nearby freelancers
Professionals working in or nearby Province of Nuoro, Italy
