LLMOps Experts in Germany

• ▶ Built real-time voice assistant (STT → LLM → TTS pipeline) benchmarking and evaluating multiple STT providers including faster-whisper and Azure Speech. achieved sub-3s latency, Groq API (Llama 3) with multi-turn memory - directly handling edge cases in dictation, names and passcode recognition.

• Acted as technical consultant to optimize multi-layer ensemble models combining ResNet, CNN-BiGRU-Attention, and XGBoost.
• Guided implementation of a Logistic Regression meta-learner to solve class imbalance problems, achieving 92.86% accuracy and 0.9644 AUC on PTB-XL and Chapman-Shaoxing datasets.

• Designed and deployed enterprise Retrieval-Augmented Generation (RAG) applications using LangChain, LangGraph, vector databases, embeddings, and open-source LLMs served through vLLM on GCP GPU infrastructure.
• Built agentic AI workflows using LangGraph with planning, reasoning, tool execution, persistent memory, session management, and Human-in-the-Loop approval mechanisms.
• Developed LLM-powered automation systems integrating BigQuery, SQL pipelines, and external advertising APIs including Meta, TikTok, Amazon, Snapchat, Google, and Pinterest, reducing manual operational workflows.
• Architected multi-agent AI systems for enterprise analytics and decision-support workflows, enabling autonomous task execution and intelligent data interactions.
• Implemented retrieval optimization strategies including multi-retriever architectures, semantic search, context optimization, and query improvement techniques, improving response relevance by approximately 40%.
• Engineered structured prompting strategies, function-calling schemas, and validation workflows to improve reliability of multi-step LLM applications.
• Designed scalable AI services using Python, FastAPI, Cloud Run, Pub/Sub, BigQuery, Docker, and cloud-native deployment architectures.

• Designed and implemented a hybrid recommendation system (content-based + collaborative filtering)
• Built end-to-end ML pipelines including data processing, feature engineering, model training, and evaluation
• Developed RAG-based LLM systems using LangChain and vector databases for semantic search and knowledge retrieval
• Established MLOps workflows with MLflow for experiment tracking, versioning, and deployment readiness
• Implemented deep learning models (computer vision & classification) using PyTorch and TensorFlow

• Development of a SaaS application for automated claims handling with AI agents (LLM) as the primary development team
• Design & testing of efficient and secure context management setups in the development process (including multi-sub-agent use, memory systems, caching)
• Definition and implementation of LLMOps pipelines with Azure AI Foundry for AI agents in customer contact (including versioning, logging, audit trail, security tests)
• Infrastructure provisioning via IaC (Bicep), application configuration via GitOps-based CI/CD pipelines (rules engine, workflow engine)
• Development of integrated security architecture designs between AI-based & classic applications with a special focus on regulatory requirements
• Integration of workflow and rules engine in a NestJS service architecture — for automated, rule-based control of claims processes
• Probabilistic extraction and preparation of claims data as the basis for rule-based, deterministic decision logic — traceable, auditable, and regulatorily compliant

• Converts natural language into JQL using RAG and pgvector. Returns structured JSON with a query, chart spec, and plain-text answer. A two-stage router answers general questions without touching the JQL pipeline at all.
• Interchangeable LLM backends: Ollama, vLLM, Groq, Anthropic Claude, AWS Bedrock - switchable at runtime, no code changes. Self-healing JQL: on Jira validation failure, feeds error back to LLM, retries up to 4 times. OCI Vault for secrets. Deployed on Oracle Cloud A1 with GPU inference over Tailscale private network. Open source.

AI Assistance and Target Vision for Partially Autonomous Energy Portfolio Management

Building an AI control layer directly on the up-to-date daily live portfolio of a large energy provider — not as an isolated pilot, but as an operational extension of the existing DB1 and portfolio management. The goal is the gradual development from assistance through monitoring/alerting to analysis agents with Human-in-the-Loop approvals, supplemented by a role-specific System of Engagement alongside the BI System of Record. At the same time, the business case, target vision and management pitch compared with static monthly reporting are being developed.

• AI control layer: Design and build on the existing live portfolio data product (several million contracts) — development stages assistance → monitoring/alerting → agents with Human-in-the-Loop approvals.
• LLM-supported data analysis: Semantic queries, SQL/tool integration and additional RAG components based on portfolio, plan-versus-actual and data quality data (Azure OpenAI, Snowflake), with drill-downs to individual contract level.
• Analysis agents: Multi-stage agents for variance and driver analyses of churn, price adjustments, volumes and procurement costs.
• Views concept: Role-specific interfaces for business units, management and C-level as a System of Engagement alongside the BI System of Record.
• Business case & pitch: Target vision and cost-benefit argumentation compared with static monthly reporting.
• LLM setup (privacy & security): Coordination with IT Security and Data Protection — EU region, data separation and approval processes.
• Agent architecture: Multi-stage agent pipelines (analysis → validation → summary) with documented data sources, tool calls, review steps and source references for each statement.
• Data foundation: Built on the up-to-date daily DB1 data product (Snowflake, dbt) — portfolio, plan-versus-actual and data quality metrics as the common basis for all AI analyses.
• Guardrails & evaluation: Evaluation and approval processes for LLM responses relating to management-relevant statements — test sets, metrics and human review.
• Prototyping & validation: Iterative validation of agent responses with the business unit — test question catalogue, feedback loops and response quality for each release.
• Roadmap & development stages: Detailed stages from assistance → monitoring/alerting → partially autonomous management, including transition criteria and governance for each stage.
• Integration: Integration into the existing BI and data landscape — BI remains the System of Record, while the AI layer provides interactive drill-down paths as the System of Engagement.
• Enablement: Enablement of business users — prompting guides, training and an operating model for ongoing use.
• Management: Coordination of business units, Data Engineering, IT Security and Data Protection.
• Change Management: Communication and expectation management with business units and management throughout the development stages.

Results:

• Built on an existing up-to-date daily data product with several million contracts
• Established an LLM setup coordinated with Data Protection and IT Security in the EU region, including data separation and approvals
• Defined three development stages through to partially autonomous management
• Designed role-specific views for business units, management and C-level
• Developed the business case and management pitch for the development stages
• Established an iterative response-quality validation process with the business unit
• Designed the operating model for assistance operations and initiated validation

Stack: Azure OpenAI, Azure AI Foundry, Snowflake, dbt, React, TypeScript, Entra ID, RAG, Agentic AI, analysis agents, Human-in-the-Loop, Prompt Engineering, LLM Evaluation, LLMOps, GDPR / EU region, Azure DevOps, Python, SQL, Change Management

• Lead a cross-functional squad of backend, frontend, and ML/data engineers, balancing hands-on contribution (architecture, coding, reviews) with team leadership (mentoring, backlog prioritization, roadmap alignment).
• Designed and delivered ML-powered search and discovery features, including Learning-to-Rank (LTR), query expansion, and vector search, improving result relevance and user engagement.
• Implemented personalization and recommendation pipelines, using behavioral data and segmentation to increase customer retention and lifetime value.
• Established data-driven practices, building A/B testing and experimentation workflows (Odyn, MLflow) to measure feature impact on CTR, NDCG, and conversion.
• Owned the squad’s architecture and delivery roadmap, modernizing services with cloud-native microservices and event-driven systems (AWS, Pulumi, Terraform) to improve scalability and reliability.
• Improved reliability and operational excellence, introducing observability (Prometheus, Grafana, NewRelic), incident management, and postmortems that reduced downtime for customer-facing services.
• Mentored and supported engineers, fostering technical growth, collaboration, and a customer-first mindset through regular feedback, coaching, and code reviews.
• Worked closely with product managers, researchers, and business stakeholders to translate customer insights into technical solutions that improved discovery, engagement, and retention.
• Explored Generative AI/LLM use cases (GPT-4, LangChain, RAG), prototyping intelligent assistants and personalized discovery workflows that increased user satisfaction.
• Delivered tangible results: boosted engagement through personalization, contributed to revenue uplift, and reduced incidents by embedding resilience and observability.

• Spearheading investor outreach and partnership development as founding MD, building the business case and technical narrative needed to attract initial funding and strategic collaborators in the digital health space
• Designing multi-agent AI systems for autonomous biosignal analysis, orchestrating LLM-based reasoning pipelines with domain-specific medical context to enable intelligent, clinical decision support

• Develop and demonstrate solutions using GenAI software like langchain, vercel ai sdk, copilotkit
• Work with customers to understand their challenges and provide the best solutions based on open-source data products
• Build RAG and GraphRAG solutions using Neo4j, lancedb, and Postgres
• Deploy a LLMOps platform using kubernetes, terraform, helmfile, Arize phoenix, mlflow
• Architect and build data pipelines using dbt, Trino, Spark, Iceberg, Airflow, ArgoCD, terraform, kubernetes
• Delivered user-centred technical strategy for Agriculture 4.0 and precision livestock farming, helping my client secure funding from Bpifrance
• Delivered a prospecting tool for a leading French solar carport installer, using geospatial computing (GIS), speeding up the sales process
• Built digital twin architecture for solar carports and EV chargers, making real-time monitoring and smart charging possible

Predapp is a Sovereign AI and Infrastructure company building AI systems that organisations can own, control, and deploy on their terms, with full data sovereignty. As CTO and investor since 2015, leading the development of the Sovereign AI Platform alongside an advisory practice spanning AI strategy for enterprises, fractional CTO engagements, and technical due diligence for VCs, PE, and family offices.

• Architected the Sovereign AI Platform from zero owning technical vision, infrastructure design, and engineering roadmap; currently deployed at a European hospital, an automotive client in Germany, and two US startups, with active commercial discussions with two leading European hosting providers
• Dubai Health Authority (DHA / Nabidh): Designed and trained AI symptom checker and triage system for national 'Doctor for Every Citizen' initiative under HH Sheikh Mohammed bin Rashid Al Maktoum
• Emirates Airlines: Designed and deployed AI agent for ground personnel accelerating training, improving issue handling, and reducing cost of liquid workforce
• Developed explainable AI triage system piloted at University Hospital Heidelberg and Famagusta Hospital (Cyprus); reduced patient wait times by up to 15% (validation ongoing)
• Built production scheduling engine for US industrial AI startup: RL + Monte Carlo tree search, reducing planning from hours to seconds
• Designed and led the development of semantic search engines using RAG + Knowledge Graphs; developed Agentic Text-to-SQL solution for citizen data scientists
• AI strategy advisory and readiness assessments for enterprise clients, including architecture reviews, maturity assessments, and AI roadmap development

Conception, planning, and production deployment of two AI platforms for industrial research and engineering workflows, from use-case identification and requirements analysis through architecture decisions and build-vs-buy trade-offs to go-live.

• awRAG.io: Identification of the use case (fragmented knowledge base across distributed AI tools), definition of data requirements, architecture decision for a multi-tenant RAG-as-a-service platform with GDPR-compliant EU infrastructure and production-grade retrieval pipeline

• LAIERS.ai: Use-case definition (context loss in linear AI workflows), strategic product decisions on UX, cost structure, and multi-LLM orchestration, rollout of a spatial AI conversation platform with proprietary context management system LAICS

• LLMOps ownership: Quality assurance, pipeline optimization, security architecture (OAuth 2.0, SOC 2), and performance monitoring of both platforms in live production

• Core topics: LLM, RAG, vector databases, LLMOps, AI architecture strategy, cloud infrastructure, data sovereignty

• Design, preparation and delivery of a webinar on 'RAG in Practice: How publishers create real value with AI'
• Preparing technical and strategic content on Retrieval Augmented Generation (RAG) for a mixed audience from the publishing industry
• Presenting specific use cases, technical backgrounds, common challenges and solution approaches when using RAG
• Providing practical insights into data preparation, model selection and output optimization in the context of digital publishing portals
• Conceptual and technical preparation of the webinar
• Selecting and presenting practical use cases from the publishing environment
• Developing technical backgrounds for implementing RAG systems
• Presenting and explaining typical challenges and solution strategies
• Large Language Models (LLMs)
• Retrieval Augmented Generation (RAG)

• Strategic transition into AI Engineering through intensive mentoring and project execution.

• Developed MASX AI, an agentic AI platform integrating LangGraph, AutoGen, and RAG for geopolitical forecasting and real-time ETL.

• Designed and delivered functional AI prototypes for prospective clients showcasing applied expertise in multi-agent systems, real-time data pipelines, and LLM integrations.