Human-in-the-Loop Experts in Germany

• Claude Code subagents, MCP, Pydantic V2, pytest, bandit

• Designed and shipped 3 specialized agents that hand work down a line: a research agent writes a cited implementation spec, a coding agent builds the modular code and its tests, a review agent ranks findings by severity and applies the fixes. Each handoff is a structured document, so no stage depends on another agent's context window.

• Connected the research agent to an academic-research MCP server (Semantic Scholar, ArXiv, Hugging Face Hub, citation snowballing) so every reference traces to a tool result rather than the model. Gated commits behind ruff, mypy, pytest and bandit, required human sign-off before installs and commits, and persisted session state on disk so long runs survive a context reset.

Workflow-automation SaaS for operations teams (Berlin, 120 people); full-time freelance engagement reporting to the CEO: an initial 12-month interim mandate, extended twice through the AI build-out; owned product for one squad and coached the other product managers on process.

• Led generative AI (LLM) integration into the core product: from LLM-powered steps to natural-language workflow authoring and step-level automation suggestions, plus AI-managed dynamic workflows, shipped behind eval gates with human-in-the-loop fallbacks: AI-drafted workflows grew to 31% of all new workflows, and median time-to-first-workflow fell from 3 days to 4 hours.
• Packaged the AI capabilities as a usage-based add-on priced on executed automation steps, working with sales and marketing on positioning: ~€800K added ARR in the first year, and adopting accounts churned 1.8 pp less.
• Owned the roadmap end to end: replaced feature-request-driven quarterly planning with an outcome-based rolling roadmap built on quarterly bets and explicit kill criteria, presented monthly to the executive team and quarterly to the board.
• Rebuilt the product-management operating system: weekly customer-discovery cadence incl. workshop facilitation, RFC/decision-doc reviews and a single quarterly metrics narrative; coached four product managers, one promoted to senior during the engagement.
• Closed the engagement as scoped: hired and onboarded the permanent VP Product, handed over the process playbook and roadmap, and exited on schedule in June 2026.

• Team leadership: Prioritization and coordination of four cross-functional teams.
• Platform strategy: Development and implementation of strategies to optimize existing IT platforms.
• Stakeholder management: Active management of expectations and communication with internal and external stakeholders.
• Program and innovation management: Prioritization and coordination of cross-department projects as well as innovation initiatives.
• Product Owner consulting: Advising Product Owners with a focus on product development and continuous product improvement.
• Organizational development: Improving communication and decision-making structures across all organizational levels.
• Change management: Implementing best-practice change management methods to ensure continuous optimization and innovation.
• Quality assurance: Ensuring high quality standards in processes, services, and deliverables.

Seitenkumpel — agents build websites for trade businesses, unattended. Own product, live.

• Agents research public company data and build complete websites from it, with nobody watching
• A validation layer makes sure extraction errors fail loudly instead of passing quietly
• Acquisition runs through a postcard funnel with a screenshot and a QR code, subscription model from 79 euros a month
• Result: several hundred websites built, running unattended
• Honest limit: there are no paying subscriptions yet — the funnel is built, the revenue is not there

Stack: agent workflows built directly without a framework, Claude and OpenAI APIs, TypeScript, Node.js, PostgreSQL, Cloudflare Workers, web scraping, data enrichment

Designing AI-native digital products by combining product strategy, UX research, interaction design, software engineering, and modern AI workflows. Leading projects from discovery to implementation while integrating AI throughout the entire product development lifecycle.

Key responsibilities

• → Product discovery, stakeholder workshops, Jobs-to-be-Done and user research
• → User journey mapping, information architecture and interaction design
• → Wireframes, high-fidelity UI, prototypes and scalable design systems in Figma and Penpot
• → AI-assisted interface generation and rapid concept exploration using Figma AI, Figma Make and generative design workflows
• → Design-to-code workflows with AI-supported frontend generation and engineering collaboration
• → Building accessible interfaces following WCAG 2.2 and enterprise design standards
• → Usability testing, iterative validation and KPI-driven product optimization
• → Development of AI knowledge systems, MCP-powered design workflows and human-in-the-loop review processes
• → Close collaboration with engineering teams to ensure production-ready implementation

• Leading end-to-end UX for two AI SaaS products in closed beta, including LLM-interaction design, prompt-UX, and human-in-the-loop patterns with commercial distribution signed for launch in Q3 2026
• Built a self-built LLM reframing and RAG-correction pipeline powering multi-profile CV and case-study generation in production use
• Shipping real code alongside research, including Three.js/GLSL portfolio work, Figma-API tooling, and a Chrome MV3 extension for session-sync automation

• Own full-stack development of an AI-native enterprise platform built on TypeScript, React, Vite, tRPC, Hono, and PostgreSQL, delivering AI-powered consulting workflows to B2B clients.
• Designed and shipped a multi-agent AI system using ReAct framework and Claude skills-style workflow patterns, including an intelligent PM assistant with rich system prompts, slash commands, tool integrations, and streaming chat UI.
• Architected an LLM evaluation framework: rubric-based LLM-as-judge, golden datasets, regression testing, and automated quality gating — ensuring consistent AI output quality at scale.
• Integrated LangFuse for end-to-end LLM tracing, conversation replays, and evaluation pipelines, enabling data-driven prompt optimisation that reduced token costs and response variance.
• Built with Drizzle ORM, pgvector, and knowledge graphs for structured data access, semantic search, and relationship-aware AI reasoning across the platform.
• Led TanStack React Query migration across the application — replacing manual state management with centralised caching and automatic refetching, reducing data-fetching boilerplate significantly.
• Practiced AI-native development throughout: Claude Code, Codex, Perplexity SDK, and LLM-assisted testing across the full development lifecycle. Deployed on Vercel + Azure ACA with Biome for linting/formatting.

Independent engineering practice focused on custom AI systems, production delivery, and fractional technical leadership.

Selected client engagement: Scalutions

• Role: Serve as fractional CTO and hands-on technical lead, responsible for the architecture and agentic infrastructure behind its managed B2B outbound operation.

• Product: Designed and built OutboundLoop, an agentic SDR operating system for research, qualification, personalized outreach, campaign management, human approvals, measurement, and continuous improvement.

• Scope: Own the full system lifecycle—from business processes and agent behavior to context design, model routing, integrations, evaluation, telemetry, reliability, cost control, and production operations.

• Project-based work in marketing automation, process optimization, and content.
• On-site operational assignments in fully English-speaking teams.
• Focus on self-organized work, changing locations, quick onboarding, and a high level of personal responsibility.
• Remote projects for Spartan Race Australia & DMC Europe, among others.

• Expert-supervised AI systems for scientific reasoning, model evaluation, and research workflows.
• Built the IAS Problem Solver, an orchestrated system for difficult mathematical reasoning; it achieved 84% in one submitted answer set on the Leipzig mathematics benchmark.
• Built a resumable state-machine pipeline for research-grade mathematics benchmark generation: source selection, LLM-agent-based phenomenon discovery, task synthesis, gold-answer and certificate generation and validation, probing, repair, human feedback, and quality gates, targeting tasks that are difficult, natural, verifiable, and cost-effective.
• Current work extends this into budget-aware AI research workflows for real scientific problems with expert review.

Tech stack: Python, OpenAI/OpenRouter-compatible APIs, embeddings, RAG, SQLite.

• Designed and deployed enterprise Retrieval-Augmented Generation (RAG) applications using LangChain, LangGraph, vector databases, embeddings, and open-source LLMs served through vLLM on GCP GPU infrastructure.
• Built agentic AI workflows using LangGraph with planning, reasoning, tool execution, persistent memory, session management, and Human-in-the-Loop approval mechanisms.
• Developed LLM-powered automation systems integrating BigQuery, SQL pipelines, and external advertising APIs including Meta, TikTok, Amazon, Snapchat, Google, and Pinterest, reducing manual operational workflows.
• Architected multi-agent AI systems for enterprise analytics and decision-support workflows, enabling autonomous task execution and intelligent data interactions.
• Implemented retrieval optimization strategies including multi-retriever architectures, semantic search, context optimization, and query improvement techniques, improving response relevance by approximately 40%.
• Engineered structured prompting strategies, function-calling schemas, and validation workflows to improve reliability of multi-step LLM applications.
• Designed scalable AI services using Python, FastAPI, Cloud Run, Pub/Sub, BigQuery, Docker, and cloud-native deployment architectures.

• Provided technical leadership for a 4-engineer team delivering 3 major client platforms in 12 months with microservices architecture and scalability solutions — 100% of scoped majors shipped ahead of schedule vs. planned milestones (baseline: prior releases often slipped 1–2 sprints).
• Ran AI model evaluation and model outputs evaluation on LLM/AI vendor APIs: safety, completeness, instruction adherence, and groundedness review before go-live; cut escaped bad outputs in AI-integrated release checklists from recurring UAT findings to near-zero on final promote.
• Drove API development and performance optimization for payment, exchange, and AI services; fail-closed error handling and payload validation reduced integration rework cycles by ~35% vs. the first AI integration pass.
• Applied software testing, testing frameworks, code quality assurance, and code refactoring with continuous integration gates; first-pass PR acceptance improved across the team and production hotfixes on AI adapters dropped noticeably after review standards landed.
• Owned DevOps practices: Docker, GitHub Actions, Jenkins-compatible pipelines, and version control workflows — cut deployment time ~50% vs. pre-automation baseline and stabilized releases across 3 client environments.
• Implemented verifier/oracle-style pass-fail checks in container sandboxes (Harbor/Terminal-Bench aligned); wrote technical documentation so failures cleared in one review cycle.
• Led cross-functional collaboration with product and client stakeholders; translated AI evaluation scores and risk findings into plain-language briefs for non-technical partners, unblocking go/no-go decisions without extra engineering meetings.
• Used agile methodologies for sprint planning and backlog ownership; mentored engineers so mid-level contributors owned AI adapter modules independently by mid-engagement.

Conventional Paradigm Test (CPT) – AI Evaluation & LLM Research

Development of an experimental evaluation approach to examine “paradigmatic closure” in Large Language Models — that is, the question of how far LLMs can recognize the basic assumptions, values, and limits of the paradigms within which they generate answers.

Design and testing of an additional approach to classic AI benchmarks that does not primarily measure factual correctness or task performance, but instead examines a model’s ability to recognize alternative perspectives, make implicit assumptions visible, and reflect on the limits of its own answer or interpretation framework.

Focus areas: development of evaluation criteria and test questions · LLM evaluation and comparative model analysis · prompt and response analysis · qualitative classification of model answers · study of epistemic compression and value leakage · benchmark and literature research · development of structured assessment and analysis methods

As part of CPT, existing AI evaluation approaches and benchmarks were analyzed, and a minimalist test protocol was developed that classifies model answers by response patterns such as DIRECT, CLARIFY, PLURALIST, REFUSE, and META-AWARE. TruthfulQA was used as the basis for experimental application and comparison with existing reference answers.

Technologies & Methods: Large Language Models (LLMs) · Generative AI · Prompt Engineering · AI Evaluation · TruthfulQA · Benchmark Analysis · Human-in-the-Loop Evaluation · Qualitative Content Analysis · Research & Literature Review

• Implemented customer-specific data, GTM, web, and automation systems from requirements gathering through controlled deployment.
• Built multi-tenant research and delivery platforms with TypeScript/Node.js, React, APIs, LLM integration, and automated checks.
• Connected HubSpot, Notion, Clay, Smartlead, n8n, and Make with traceable handoffs, deduplication, error paths, and approvals.