vLLM Expert in Germany

• Fully on-premises LLM document-examination platform for a compliance-critical banking domain: agentic LangGraph pipeline with deterministic verification, every AI judgment structured and source-anchored; ~960 automated tests, zero data egress
• GPU throughput engineering (quantized serving, speculative decoding, prefix caching): 9.5x extraction speed-up, 500+ multi-document case files per day on a single A100
• AI-native EDI/EDIFACT integration platform (~116k LOC Java 25 / Spring Boot 4, 1,900+ tests): LLM-drafted partner mappings machine-verified before go-live (DFDL conformance, field-coverage checks, dry runs), ~99.5% byte match on real customer files — replacing weeks of manual mapping per partner

• Led end-to-end delivery of ML/AI applications for the QuantistryLab simulation platform, from requirements definition and solution design to development, testing, deployment, and production support, coordinating efforts across back-end, DevOps, and ML teams
• Designed and implemented a compound search system with an open-weights LLM, the Pydantic AI agent framework, and the Model Context Protocol (MCP), exposing it through FastAPI endpoints
• Deployed and configured vLLM-based LLM serving on Kubernetes
• Built CI/CD pipelines and Helm charts to automate deployments across staging and production environments
• Instrumented the search system with OpenTelemetry spans and traces, integrating with the Honeycomb observability platform to monitor component-level latency and functional errors
• Developed a custom evaluation dataset and implemented evaluations for retrieval relevance, answer correctness, tool-call accuracy, and end-to-end task success
• Reduced infrared spectrum prediction time by 83% (from 60 to 10 minutes) by replacing a quantum-mechanical model with a pretrained graph neural network; fine-tuned the model using PyTorch, built and containerized the inference pipeline with Docker, and integrated it into the platform
• Implemented an MLflow model registry with MinIO-backed artifact storage
• Advised sales and science teams on ML/AI applications for prospective client projects, providing technical expertise to shape proposed solutions and prototypes

Technologies: AWS, Hetzner, Kubernetes, Helm, Docker, vLLM, Pydantic AI, MCP, Qwen, Llama 3, MLflow, MinIO, GitHub Actions, Python, FastAPI, OpenTelemetry, Honeycomb, PyTorch, Polars, pytest

• Root cause analysis of complex business, technical, and data-related errors in PowerCloud across process, booking, and system boundaries.
• Data-driven management of payments and receivables; contributed to reducing historical receivables from over 100 Mio. EUR to under 25 Mio. EUR.
• Identification of automation and straight-through processing potential at the interface between business departments, IT, and external service providers.

Transmission system operator – network provisioning platform (team lead)

• Designed the saga orchestrator in Python that provisions network fabrics with rollback.
• Split IP, identity, and resource allocation into bounded contexts with their own databases and typed clients.
• Implemented data access using DDD repositories and units of work, with no SQL in the domain code.
• Required integration tests using real PostgreSQL and RabbitMQ containers, and API fuzzing for every service.
• Introduced an agent workflow where a spec starts each change and a human approves every merge.
• Rolled out OpenTelemetry auto-instrumentation through GitOps across eighteen Kubernetes clusters.
• Led incident response for stuck provisioning and recorded every outage as a post-mortem.

Languages and software used: Python, FastAPI, Pydantic v2, SQLAlchemy async, PostgreSQL, RabbitMQ, Celery, pytest, testcontainers, schemathesis, Helm, Flux CD, GitLab CI, OpenTelemetry, pi coding agent.

Software product company – datacenter simulation SaaS (backend development)

• Built the asynchronous simulation pipeline as the second-largest contributor among more than twenty team members.
• Tagged every image by commit SHA and semver in the GitHub Actions deployment workflows.
• Diagnosed the RabbitMQ memory alarm that froze every simulation and fixed the limits in the Helm chart.
• Converted the test suite to function-style pytest, with coverage reported in every pipeline.

Languages and software used: Python, FastAPI, SQLAlchemy, Alembic, Celery, RabbitMQ, Redis, PostgreSQL, S3, EKS, Helm, Keycloak, GitHub Actions, pytest, mypy, ruff, SonarQube.

Internal AI platform – model serving and telemetry

• Built the FastAPI service that deploys open-weight models on GPU tiers as OpenAI-compatible endpoints.
• Upgraded production EKS by two Kubernetes minor versions and fixed zone-bound storage faults.
• Traced every model call, including its token count, cost, and latency, through the OpenTelemetry operator.

Languages and software used: Python, FastAPI, vLLM, LangGraph, pydantic-ai, OpenAI and Anthropic APIs, EKS, Helm, Flux CD, Terraform, GitLab CI, OpenTelemetry, Grafana.

• Used OpenCode and AI-assisted software engineering to design, implement, refactor, test, and document an end-to-end RAW/SDTM/ADaM pipeline in R for Dr. Falk Pharma (07/2026), including metadata-driven transformations, automated validation rules and QC, traceability, and reproducible clinical outputs.

• Designed and deployed enterprise Retrieval-Augmented Generation (RAG) applications using LangChain, LangGraph, vector databases, embeddings, and open-source LLMs served through vLLM on GCP GPU infrastructure.
• Built agentic AI workflows using LangGraph with planning, reasoning, tool execution, persistent memory, session management, and Human-in-the-Loop approval mechanisms.
• Developed LLM-powered automation systems integrating BigQuery, SQL pipelines, and external advertising APIs including Meta, TikTok, Amazon, Snapchat, Google, and Pinterest, reducing manual operational workflows.
• Architected multi-agent AI systems for enterprise analytics and decision-support workflows, enabling autonomous task execution and intelligent data interactions.
• Implemented retrieval optimization strategies including multi-retriever architectures, semantic search, context optimization, and query improvement techniques, improving response relevance by approximately 40%.
• Engineered structured prompting strategies, function-calling schemas, and validation workflows to improve reliability of multi-step LLM applications.
• Designed scalable AI services using Python, FastAPI, Cloud Run, Pub/Sub, BigQuery, Docker, and cloud-native deployment architectures.

• Architect end-to-end AI/ML solutions, with a strong focus on advanced LLM applications, autonomous agentic AI workflows using MCP toolset, vLM embedding computations, and robust agentic RAG pipelines to drive real-world business impact for clients across diverse sectors.
• Designed intelligent agentic AI workflows to automate knowledge retrieval and reasoning for B2B clients, accelerating business impact.

• Converts natural language into JQL using RAG and pgvector. Returns structured JSON with a query, chart spec, and plain-text answer. A two-stage router answers general questions without touching the JQL pipeline at all.
• Interchangeable LLM backends: Ollama, vLLM, Groq, Anthropic Claude, AWS Bedrock - switchable at runtime, no code changes. Self-healing JQL: on Jira validation failure, feeds error back to LLM, retries up to 4 times. OCI Vault for secrets. Deployed on Oracle Cloud A1 with GPU inference over Tailscale private network. Open source.

• Consultant for system architecture, AI agents & integration, coach for data & process logic, Graph-RAG approaches, security and data protection.
• On-premise AI solutions with high compliance and performance requirements.
• Architecture decisions, operational setup, strategic prioritization & deployment.
• Technologies: LiveKit JS SDK, LiveKit Agents, Web Audio API, JS, AudioWorklet, Loki, vLLM, Zscaler, Docker, Neo4j, MySQL, Python.
• Models: GPT-OSS 20B, Whisper large v3 turbo, Qwen3-TTS.

Software service provider for AI solutions, automation, and custom software.

Team: built from 2 to 10 developers, 8 direct reports, partly remote · Portfolio: 6 parallel projects (€25k–€250k), scaling > €1M

• Ensured delivery capability for 6 parallel customer projects: role model, capacity planning (510–660 productive person-days/year), hiring roadmap with €380k–€440k/year personnel budget
• Established SDLC framework from scratch in under 6 months: REQ/SPEC structure, V-model gates, GitHub Issues as specification, Definition of Done, release process; consistent, auditable development process across all customer projects
• Prepared large program (3,000–4,000 person-days over 18 months) for decision readiness: AI-native industry platform for the construction sector; scoping, team profile for 8–10 developers, phase 0 budget €390k
• Designed and introduced self-hosted AI platform: vLLM, LiteLLM, Qdrant, Supabase; agent architecture, MCP integration, OCR pipelines; prepared GPU investment with break-even model (month 15–16)
• Systematized presales end to end: lead qualification with maturity scoring, discovery workshops, own sizing model, costing with loaded hourly rates, structured handover to development
• Tangibly improved the security level of a customer platform: penetration test incl. re-verification of all findings

• Research and develop models for chatbots, NLP and LLMs (e.g. Llama, Qwen, OpenAI)
• Enhance chatbots with RAG, in-context learning
• Supervised fine-tuning (PEFT, LoRA), Huggingface or Unsloth
• Advanced training methods: Test-time training, (transductive) active learning, reinforcement learning
• High-throughput serving with vLLM
• Apply embedding models (e.g. SentenceTransformers), similarity/vector search or vector DB or ranking (e.g. LlamaIndex, Faiss, LangChain)
• Generate and filter synthetic data, clustering
• Detect hallucinations
• Evaluate chatbot models (Rouge, BLEU, F1-Score, Recall, Precision)
• Visualization of experiments (matplotlib)

• Developed a multi-agent system connecting LangChain ZeroShotAgent with custom tools for live APIs and task automation.
• Built a FastAPI backend for Jira ticket creation, triage, and assignment, with automatic severity classification, deduplication, SLA setup, on-call rotation, and two-way syncing of status and comments.
• Added Slack alerts and RAG knowledge lookup with FAISS or pgvector to suggest fixes, with optional PagerDuty escalation for policy breaches.
• Orchestrated agents with a router and a Celery plus Redis queue, including retries with backoff, rate limits, idempotency keys, and human-in-the-loop approvals.
• Implemented guardrails and observability, prompt versioning, token and cost budgets, PII redaction, tool-use allowlists, timeouts, OpenTelemetry tracing, accuracy and latency dashboards, and deployment on Kubernetes with feature flags and canary rollouts.

• Project environment: Python, Java, Azure AI Studio & OpenAI Studio, embedding models, LLM as a judge
• Project language: German
• Project role(s): Project manager
• Project management for improving the performance of a chatbot
• Research and evaluation of approaches to improve and measure response accuracy and improve the chatbot's understanding of context
• Coordination of architecture decisions with the technical team and architects
• Coordination and transfer of research results into development tasks

• Held direct line management responsibility for a team of 4 Platform Engineers — owning hiring, performance reviews, and career development — while establishing a shared engineering standards framework and coaching culture that accelerated delivery across client engagements.
• Led a team of engineers to architect a cloud-native voice AI system for a major inspection client, enabling 2,500 field inspectors to document work fully hands-free via real-time transcription and AI agents — eliminating manual data entry across 440,000 inspections per month and reducing per-user cost from $9 to $1. Stack: AWS (DynamoDB, S3, Transcribe, CloudFront, API Gateway, Bedrock), ElevenLabs, Claude.
• Led a team of engineers to automate multi-region Kubernetes cluster management for a global SaaS leader, reducing provisioning time from 3 weeks to under a day and eliminating 90% of configuration errors. Stack: EKS, Terragrunt, Python, Bash, ArgoCD.
• Accelerator - Cloud-Agnostic AI Platform: Architected and delivered a cloud-agnostic, Kubernetes-native platform as an accelerator, enabling multi-tenant, enterprise-scale management of self-hosted LLMs with concurrent deployment of multiple base models and dynamic LoRA adapter serving. Designed production infrastructure using open-source tooling (ArgoCD, Karpenter, vLLM, SGLang) with automated model lifecycle management, API security (Keycloak + LiteLLM), and cost-optimized GPU provisioning.