LLMOps Experts in Germany

• Designed and deployed enterprise Retrieval-Augmented Generation (RAG) applications using LangChain, LangGraph, vector databases, embeddings, and open-source LLMs served through vLLM on GCP GPU infrastructure.
• Built agentic AI workflows using LangGraph with planning, reasoning, tool execution, persistent memory, session management, and Human-in-the-Loop approval mechanisms.
• Developed LLM-powered automation systems integrating BigQuery, SQL pipelines, and external advertising APIs including Meta, TikTok, Amazon, Snapchat, Google, and Pinterest, reducing manual operational workflows.
• Architected multi-agent AI systems for enterprise analytics and decision-support workflows, enabling autonomous task execution and intelligent data interactions.
• Implemented retrieval optimization strategies including multi-retriever architectures, semantic search, context optimization, and query improvement techniques, improving response relevance by approximately 40%.
• Engineered structured prompting strategies, function-calling schemas, and validation workflows to improve reliability of multi-step LLM applications.
• Designed scalable AI services using Python, FastAPI, Cloud Run, Pub/Sub, BigQuery, Docker, and cloud-native deployment architectures.

• Converts natural language into JQL using RAG and pgvector. Returns structured JSON with a query, chart spec, and plain-text answer. A two-stage router answers general questions without touching the JQL pipeline at all.
• Interchangeable LLM backends: Ollama, vLLM, Groq, Anthropic Claude, AWS Bedrock - switchable at runtime, no code changes. Self-healing JQL: on Jira validation failure, feeds error back to LLM, retries up to 4 times. OCI Vault for secrets. Deployed on Oracle Cloud A1 with GPU inference over Tailscale private network. Open source.

• ▶ Built real-time voice assistant (STT → LLM → TTS pipeline) benchmarking and evaluating multiple STT providers including faster-whisper and Azure Speech. achieved sub-3s latency, Groq API (Llama 3) with multi-turn memory - directly handling edge cases in dictation, names and passcode recognition.

• Designed and implemented a hybrid recommendation system (content-based + collaborative filtering)
• Built end-to-end ML pipelines including data processing, feature engineering, model training, and evaluation
• Developed RAG-based LLM systems using LangChain and vector databases for semantic search and knowledge retrieval
• Established MLOps workflows with MLflow for experiment tracking, versioning, and deployment readiness
• Implemented deep learning models (computer vision & classification) using PyTorch and TensorFlow

Predapp is a Sovereign AI and Infrastructure company building AI systems that organisations can own, control, and deploy on their terms, with full data sovereignty. As CTO and investor since 2015, leading the development of the Sovereign AI Platform alongside an advisory practice spanning AI strategy for enterprises, fractional CTO engagements, and technical due diligence for VCs, PE, and family offices.

• Architected the Sovereign AI Platform from zero owning technical vision, infrastructure design, and engineering roadmap; currently deployed at a European hospital, an automotive client in Germany, and two US startups, with active commercial discussions with two leading European hosting providers
• Dubai Health Authority (DHA / Nabidh): Designed and trained AI symptom checker and triage system for national 'Doctor for Every Citizen' initiative under HH Sheikh Mohammed bin Rashid Al Maktoum
• Emirates Airlines: Designed and deployed AI agent for ground personnel accelerating training, improving issue handling, and reducing cost of liquid workforce
• Developed explainable AI triage system piloted at University Hospital Heidelberg and Famagusta Hospital (Cyprus); reduced patient wait times by up to 15% (validation ongoing)
• Built production scheduling engine for US industrial AI startup: RL + Monte Carlo tree search, reducing planning from hours to seconds
• Designed and led the development of semantic search engines using RAG + Knowledge Graphs; developed Agentic Text-to-SQL solution for citizen data scientists
• AI strategy advisory and readiness assessments for enterprise clients, including architecture reviews, maturity assessments, and AI roadmap development

• Development of a SaaS application for automated claims handling with AI agents (LLM) as the primary development team
• Design & testing of efficient and secure context management setups in the development process (including multi-sub-agent use, memory systems, caching)
• Definition and implementation of LLMOps pipelines with Azure AI Foundry for AI agents in customer contact (including versioning, logging, audit trail, security tests)
• Infrastructure provisioning via IaC (Bicep), application configuration via GitOps-based CI/CD pipelines (rules engine, workflow engine)
• Development of integrated security architecture designs between AI-based & classic applications with a special focus on regulatory requirements
• Integration of workflow and rules engine in a NestJS service architecture — for automated, rule-based control of claims processes
• Probabilistic extraction and preparation of claims data as the basis for rule-based, deterministic decision logic — traceable, auditable, and regulatorily compliant

• Acted as technical consultant to optimize multi-layer ensemble models combining ResNet, CNN-BiGRU-Attention, and XGBoost.
• Guided implementation of a Logistic Regression meta-learner to solve class imbalance problems, achieving 92.86% accuracy and 0.9644 AUC on PTB-XL and Chapman-Shaoxing datasets.

• Spearheading investor outreach and partnership development as founding MD, building the business case and technical narrative needed to attract initial funding and strategic collaborators in the digital health space
• Designing multi-agent AI systems for autonomous biosignal analysis, orchestrating LLM-based reasoning pipelines with domain-specific medical context to enable intelligent, clinical decision support

• Develop and demonstrate solutions using GenAI software like langchain, vercel ai sdk, copilotkit
• Work with customers to understand their challenges and provide the best solutions based on open-source data products
• Build RAG and GraphRAG solutions using Neo4j, lancedb, and Postgres
• Deploy a LLMOps platform using kubernetes, terraform, helmfile, Arize phoenix, mlflow
• Architect and build data pipelines using dbt, Trino, Spark, Iceberg, Airflow, ArgoCD, terraform, kubernetes
• Delivered user-centred technical strategy for Agriculture 4.0 and precision livestock farming, helping my client secure funding from Bpifrance
• Delivered a prospecting tool for a leading French solar carport installer, using geospatial computing (GIS), speeding up the sales process
• Built digital twin architecture for solar carports and EV chargers, making real-time monitoring and smart charging possible

Conception, planning, and production deployment of two AI platforms for industrial research and engineering workflows, from use-case identification and requirements analysis through architecture decisions and build-vs-buy trade-offs to go-live.

• awRAG.io: Identification of the use case (fragmented knowledge base across distributed AI tools), definition of data requirements, architecture decision for a multi-tenant RAG-as-a-service platform with GDPR-compliant EU infrastructure and production-grade retrieval pipeline

• LAIERS.ai: Use-case definition (context loss in linear AI workflows), strategic product decisions on UX, cost structure, and multi-LLM orchestration, rollout of a spatial AI conversation platform with proprietary context management system LAICS

• LLMOps ownership: Quality assurance, pipeline optimization, security architecture (OAuth 2.0, SOC 2), and performance monitoring of both platforms in live production

• Core topics: LLM, RAG, vector databases, LLMOps, AI architecture strategy, cloud infrastructure, data sovereignty

• Design, preparation and delivery of a webinar on 'RAG in Practice: How publishers create real value with AI'
• Preparing technical and strategic content on Retrieval Augmented Generation (RAG) for a mixed audience from the publishing industry
• Presenting specific use cases, technical backgrounds, common challenges and solution approaches when using RAG
• Providing practical insights into data preparation, model selection and output optimization in the context of digital publishing portals
• Conceptual and technical preparation of the webinar
• Selecting and presenting practical use cases from the publishing environment
• Developing technical backgrounds for implementing RAG systems
• Presenting and explaining typical challenges and solution strategies
• Large Language Models (LLMs)
• Retrieval Augmented Generation (RAG)

• Strategic transition into AI Engineering through intensive mentoring and project execution.

• Developed MASX AI, an agentic AI platform integrating LangGraph, AutoGen, and RAG for geopolitical forecasting and real-time ETL.

• Designed and delivered functional AI prototypes for prospective clients showcasing applied expertise in multi-agent systems, real-time data pipelines, and LLM integrations.

• Lead a cross-functional squad of backend, frontend, and ML/data engineers, balancing hands-on contribution (architecture, coding, reviews) with team leadership (mentoring, backlog prioritization, roadmap alignment).
• Designed and delivered ML-powered search and discovery features, including Learning-to-Rank (LTR), query expansion, and vector search, improving result relevance and user engagement.
• Implemented personalization and recommendation pipelines, using behavioral data and segmentation to increase customer retention and lifetime value.
• Established data-driven practices, building A/B testing and experimentation workflows (Odyn, MLflow) to measure feature impact on CTR, NDCG, and conversion.
• Owned the squad’s architecture and delivery roadmap, modernizing services with cloud-native microservices and event-driven systems (AWS, Pulumi, Terraform) to improve scalability and reliability.
• Improved reliability and operational excellence, introducing observability (Prometheus, Grafana, NewRelic), incident management, and postmortems that reduced downtime for customer-facing services.
• Mentored and supported engineers, fostering technical growth, collaboration, and a customer-first mindset through regular feedback, coaching, and code reviews.
• Worked closely with product managers, researchers, and business stakeholders to translate customer insights into technical solutions that improved discovery, engagement, and retention.
• Explored Generative AI/LLM use cases (GPT-4, LangChain, RAG), prototyping intelligent assistants and personalized discovery workflows that increased user satisfaction.
• Delivered tangible results: boosted engagement through personalization, contributed to revenue uplift, and reduced incidents by embedding resilience and observability.

• Evaluating openDesk as MS365 alternative
• Designing AI-optimized infrastructure
• Kubernetes orchestration
• Container security advisory