Llama Experts in Germany

• TrendReel, production LLM agent and RAG system (Python, LangChain, OpenAI, Groq/Llama 3, Claude, FastAPI, Kubernetes, PostgreSQL).
• Designed and built a production multi-step LLM agent system: a script generation agent with a per-platform psychology database, 7 viral narrative frameworks, and structured quality scoring, switching between Claude and Groq backends in real time based on output metrics.
• Implemented multi-provider LLM routing (Claude primary, Groq/Llama 3 fallback) with priority-chain failover and quality-based provider switching, achieving 95% inference cost reduction while holding measurable quality thresholds.
• Built an advanced RAG-style retrieval pipeline with per-platform knowledge bases, semantic content matching, and structured output evaluation across 7 decision frameworks, directly analogous to multi-tenant context-based reasoning for enterprise document workflows.
• BrainyAI, adaptive AI learning platform (Python, LangChain, Groq Llama 3.3-70B, OpenAI, Next.js, Supabase, Redis).
• Integrated Groq Llama 3.3-70B with education-level-aware prompting, dynamically adjusting vocabulary depth, citation complexity, and reasoning style across four student proficiency tiers.
• Nexus Prime, multi-tenant SaaS platform for marketing and growth automation (25 modules, 99 backend routers, 153 frontend files).
• Built a 25-module, 99-router multi-tenant SaaS platform covering ad remix, affiliates, WhatsApp inbox, email, and cart recovery, serving four subscription tiers from $199 to $1,999 per month with integrated Stripe, Paystack, and Flutterwave billing.
• AI Video Surveillance Platform, multi-tenant edge and cloud computer vision system currently in active client pitch.
• Designed a multi-tenant AI video surveillance platform combining edge YOLO26 inference on NVIDIA Jetson Orin NX boxes with a central GKE cloud layer (Postgres, Pub/Sub, ClickHouse, R2, Keycloak) for event storage, dashboards, alerting, and multi-tenancy.

• Converts natural language into JQL using RAG and pgvector. Returns structured JSON with a query, chart spec, and plain-text answer. A two-stage router answers general questions without touching the JQL pipeline at all.
• Interchangeable LLM backends: Ollama, vLLM, Groq, Anthropic Claude, AWS Bedrock - switchable at runtime, no code changes. Self-healing JQL: on Jira validation failure, feeds error back to LLM, retries up to 4 times. OCI Vault for secrets. Deployed on Oracle Cloud A1 with GPU inference over Tailscale private network. Open source.

• ▶ Built real-time voice assistant (STT → LLM → TTS pipeline) benchmarking and evaluating multiple STT providers including faster-whisper and Azure Speech. achieved sub-3s latency, Groq API (Llama 3) with multi-turn memory - directly handling edge cases in dictation, names and passcode recognition.

• Delivered a new notifications platform implementation built from scratch to replace existing and upcoming services
• Collaborating with other teams to integrate more domains

Tech stack:

• Data: Scala 3, Apache Kafka, Python, Airflow, Astronomer
• BE-FE: TypeScript, NestJS, Java, Spring Boot, Vue
• Dev-ops: AWS, PostgreSQL, Docker, GitHub Actions, Kubernetes, Helm, ArgoCD

• Further development and operation of a central backend service providing vehicle inventory for international Mercedes-Benz online stores
• Enhancement of a vehicle reservation service as part of the checkout process
• Design and implementation of a highly scalable end-to-end test architecture focused on maintainability, reusability, and a high number of automated test cases
• Development of a multi-layered test infrastructure with a clear separation of test logic and access layers
• Development of an initialization and caching architecture to significantly speed up local and CI/CD-based test runs
• Development of an AI-driven review architecture for automated evaluation and quality assurance of end-to-end tests
• Development of a dashboard to consolidate vehicle context across multiple backend systems, including AI-generated summaries and condensed case analyses
• Integration and further development of connections to various reservation systems via Apache Kafka and REST
• Design of new microservices and support in architectural decisions
• Risk analysis and planning of microservice migrations
• Technologies: Java, Spring, Spring Boot, Gradle, Maven, Apache Kafka, REST, OpenAPI, Swagger, GitHub, Confluence, CI/CD, Microservices, AI, LLMs

• Spearheaded the integration of a custom Transformer-based encoder into the AFFGANwriting pipeline, replacing the legacy VGG19 architecture to capture richer, high-fidelity writer-style representations.
• Boosted user-study pick-rates by 40%, demonstrating a significant leap in the perceptual quality and realism of the generated handwriting compared to the baseline model.
• Enhanced OCR performance by 20% by implementing a teacher-student framework that leveraged a TrOCR benchmark model for auxiliary training alignment

• Acted as technical consultant to optimize multi-layer ensemble models combining ResNet, CNN-BiGRU-Attention, and XGBoost.
• Guided implementation of a Logistic Regression meta-learner to solve class imbalance problems, achieving 92.86% accuracy and 0.9644 AUC on PTB-XL and Chapman-Shaoxing datasets.

End-to-end responsibility for all products - concept, architecture, development, and production operation as the sole developer; in addition, customer meetings, proposals, and marketing.

Underwriting Copilot - AI assistant for industrial insurance (in production at customer sites)

• Supports underwriters in analyzing industrial insurance submissions - in production use at an industrial insurer.
• Framework-independent RAG architecture with Hybrid Search (BM25 + pgvector) across large, mixed document sets.
• Two-stage evaluation and observability pipeline (code assertions + LLM-as-Judge) that makes answer quality, retrieval accuracy, and citation integrity measurable in a regression-safe way.

Kaiki Menu Analyzer - Data intelligence platform (in production at customer sites)

• Automatically captures and analyzes menu data from around 25,000 German restaurants.
• Scalable 7-container architecture (FastAPI, partitioned PostgreSQL, Redis/RQ) with LLM-supported extraction of structured data from PDF, HTML, and images.
• Full CI/CD pipelines (GitHub Actions), production cloud deployment, interactive dashboards (Dash).

Kaiki GEO Atlas - GEO platform (in production at customer sites)

• Measures brand visibility across five AI engines (ChatGPT, Gemini, Perplexity, Grok, Claude), each augmented with web search, orchestrated as a DAG workflow pipeline (Dispatcher → Sub-workflows → Scoring → Report) with fail isolation.
• 6-container deployment (FastAPI, Celery, Redis, PostgreSQL); LLM cost estimation, PDF audit report, rule-based cross-signal insights (no extra LLM cost).

Data Pipeline & Analytics Platform - competitive analysis in the automotive aftermarket

• Automated data pipeline with gap analysis algorithms and role-based access control; 230+ tests.
• Backend with FastAPI, PostgreSQL, SQLAlchemy.

Product development (actively in progress)

BankingGPT - AI assistant for complaint management in cooperative banking

• Security architecture at the core: no AI draft reaches the customer without human approval - the approval decision is in auditable code, not in the language model (monotonic: the model may escalate, never downgrade).
• Real agentic building blocks, each with its own boundary: the model chooses tools itself through an MCP server (read-only, allowlist, capped, fail-safe); sensitive cases are handed off via an open A2A protocol (JSON-RPC, Agent Card, message/send/tasks/get; client implemented by me) to a separate specialist agent (securities/law), which never lowers the review requirement (pinned by test).
• Evaluation-driven over ten analysis rounds; uncovered a security flaw through independent review and blind tests that nine automated runs had missed.
• Voice AI frontend, responding live: covered cases are answered in the conversation, sensitive ones escalate before generation; response latency < 7 s measured (local GPU STT/TTS).

Stack & production readiness: Python, pydantic-ai, FastAPI/Celery, PostgreSQL/pgvector, FastMCP, fasta2a, Docker; multi-tenant capable (physical vector isolation per tenant), PII encrypted, OWASP-LLM reviewed, 275 tests, CI/CD; vendor-portable (Ollama / EU Cloud Vertex).

After-Sales Assistant - agentic RAG/GraphRAG assistant on public OEM manuals (automotive after-sales)

• Genuinely agentic on LangGraph: ReAct agent with four tools and conversation memory - the model decides on its own whether to use the manual (RAG, Chroma), a knowledge graph (GraphRAG, Neo4j/Cypher - decodes warning lights), or a workshop/booking service.
• Human-in-the-Loop before the irreversible action: before every appointment booking, the graph pauses (interrupt) and gets the driver's explicit confirmation - the same approval-before-action discipline as in BankingGPT, in a different framework.
• Eval as CI gate: a three-part scorecard (RAGAS grounding + deterministic tool-routing accuracy + DeepEval safety: does the answer mention the warning first when there is a critical warning?) blocks the pipeline; provider-agnostic (OpenAI/Azure/Anthropic), FastAPI with token streaming.

Stack: Python, LangChain/LangGraph, Chroma, Neo4j, RAGAS/DeepEval, FastAPI, Docker.

• Architected and deployed a production-scale GraphRAG system using Neo4j, embeddings, and multi-hop reasoning over 120M+ nodes, improving answer precision by 32%, reducing hallucinations by 41%, and lowering retrieval latency by 38%.
• Designed and implemented an enterprise agent ecosystem using Model Context Protocol (MCP), exposing internal APIs, databases, and services as secure callable tools for autonomous workflows and system integration.
• Designed and deployed a production LLM-based email routing agent using Microsoft Graph API, MCP, and Azure OpenAI, achieving 96% routing accuracy, reducing manual triage workload by 65%, and decreasing response times from 18 hours to under 4 hours.
• Implemented autonomous agent self-correction pipelines using iterative feedback loops (Ralph Wiggum), enabling reliable error detection, automated remediation, and production-safe execution.
• Developed a multimodal semantic search platform using multimodal LLMs and vector embeddings, enabling semantic discovery across 250k+ image and video assets and improving search recall by 48%.

• Introducing 5 different process applications for various teams

• Release planning: scope and time management

• Resource/capacity planning

• Conducting sprint planning / retrospectives

• Increment planning (multiple sprints)

• Preparing steering committee meetings / reporting to the executive board

• Coordinating / aligning with external suppliers / deliveries

• Multi-project resource planning

• Aligning with the business unit and development team

• Identifying best practices with IBM BAW

• Cost control and planning for the project team and external service providers

• Collecting KPIs using LogScale

• Analyzing application errors with LogScale / queries

• Defining user stories / aligning requirements with the business unit and development team

• Testing and defect tracking

• UI/UX design of the application

• Preparing and facilitating brown-paper workshop

• Test concept, test data, test organization, test execution

• Recording team velocity / metrics

• Executing tests

• Scripts for automated testing

• Organizing tests with the business unit and IT

• Recording and prioritizing defects

• Setting up and operating the application

• Setting up application monitoring with LogScale dashboards

• Checking health endpoints with PowerShell

• Post mortem analysis

• Setting up incident management

• Setting up problem management

• Analyzing errors using LogScale queries and dashboard

• Pre-processing data for AI

• Conducting evaluation with AI language models (Meta Llama 3.3 LLM and deepset Haystack) and RAG

• Installing runtime environments for LLMs (large language model)

• Evaluating various LLMs

• Installing RAG (retrieval augmented generation) and integrating with LLM

• Extracting unstructured data with LLM and RAG

• Project based on IBM BAW (Business Automation Workflow), WebSphere Liberty, Domea, d.3, REST, LogScale (formerly Humio), Swagger, PowerShell, JIRA, Confluence, Lucom Interaction Platform (LIP), Mattermost, Jabber

• Develop and demonstrate solutions using GenAI software like langchain, vercel ai sdk, copilotkit
• Work with customers to understand their challenges and provide the best solutions based on open-source data products
• Build RAG and GraphRAG solutions using Neo4j, lancedb, and Postgres
• Deploy a LLMOps platform using kubernetes, terraform, helmfile, Arize phoenix, mlflow
• Architect and build data pipelines using dbt, Trino, Spark, Iceberg, Airflow, ArgoCD, terraform, kubernetes
• Delivered user-centred technical strategy for Agriculture 4.0 and precision livestock farming, helping my client secure funding from Bpifrance
• Delivered a prospecting tool for a leading French solar carport installer, using geospatial computing (GIS), speeding up the sales process
• Built digital twin architecture for solar carports and EV chargers, making real-time monitoring and smart charging possible

• AI-powered automation with a focus on efficiency, information processing, and assistant systems
• Automated email classification (OpenAI, FastAPI)
• Contract analysis for LegalTech (Llama 3, LangGraph)
• Internal knowledge search with RAG (VLLM, Hugging Face)
• Anomaly detection on edge devices (LLAVA, TensorRT)
• Agent system for management reports (LangGraph, Zapier)

• Pioneered first enterprise AI-SAP integration at ALDI SÜD, deploying AI-driven automation within one of retail's largest SAP S/4HANA programs, eliminating 50% of manual pre-cycle validation time and establishing replicable automation framework across 11 countries
• Led end-to-end SAP project lifecycle management for implementations across SAP S/4HANA and Manhattan Systems, supporting 7,300+ ALDI SÜD locations globally across Europe and Australia
• Served as primary executive liaison to C-level stakeholders across 11 countries for strategic SAP transformation programs
• Orchestrated automation, performance, and volume testing for critical releases, maintaining 99.9% system SLA compliance during peak retail periods
• Managed cross-functional international teams of 15+ specialists, delivering projects 20% faster than industry benchmarks
• Standardized SAP processes across 11 countries as part of one of retail's largest SAP implementations
• Directly managed €2M budget with 98% allocation accuracy across 12 concurrent projects
• Reduced SAP S/4HANA migration costs by 18% through strategic vendor contract renegotiations and optimization

• Focus on integrated comms planning, marketing consulting and brand strategy in a director role (3 direct reports)
• Providing C-level advice on brand building and management
• Responsible for major new business wins
• Strategic development of integrated marcom and brand strategy
• Clients (among others): Pfister, Mainova, Hamburger Energienetze