Llama Experts in Germany

• Introduction of 5 different process applications for different teams

• Release planning: scope and time management

• Resource/capacity planning

• Conducting Sprint Planning / retrospectives

• Increment planning (several sprints)

• Preparation of Steering Committee meetings / reporting to the Board

• Coordination / alignment with external suppliers / deliveries

• Resource planning for multiple projects

• Coordination with business department and development team

• Identification of best practices with IBM BAW

• Cost control and planning for the project team and external service providers

• Collection of KPIs using LogScale

• Analysis of application errors with LogScale / Queries

• User Story definitions / coordination of requirements with the business department and development team

• Testing and defect tracking

• UI/UX design of applications

• Preparation and moderation of Brown-Paper workshops

• Test concept, test data, test organization, test execution

• Collection of team velocity / metrics

• Test execution

• Script for automated testing

• Test organization with business department and IT

• Recording and prioritization of defects

• Establishment and operation of the application

• Establishment of application monitoring with LogScale Dashboards

• Checking health endpoints with PowerShell

• Post Mortem analysis

• Establishment of Incident Management

• Establishment of Problem Management

• Analysis of errors using LogScale Queries and Dashboard

• Pre-processing of data for AI

• Evaluation using AI language models (Meta Llama 3.3 LLM and deepset Haystack) and RAG

• Installation of runtime environments for LLMs (Large Language Model)

• Evaluation of various LLMs

• Installation of RAG (Retrieval Augmented Generation) and integration with LLM

• Extraction of unstructured data with LLM and RAG

• Project based on IBM BAW (Business Automation Workflow), Websphere Liberty, Domea, d.3, REST, LogScale (formerly Humio), Swagger, Powershell, JIRA, Confluence, Lucom Interaction Platform (LIP), Mattermost, Jabber

• Delivered a new notifications platform implementation built from scratch to replace existing and upcoming services
• Collaborating with other teams to integrate more domains

Tech stack:

• Data: Scala 3, Apache Kafka, Python, Airflow, Astronomer
• BE-FE: TypeScript, NestJS, Java, Spring Boot, Vue
• Dev-ops: AWS, PostgreSQL, Docker, GitHub Actions, Kubernetes, Helm, ArgoCD

• Portfolio development & customer acquisition
• Portfolio development (RAG, NLP fine-tuning, process automation with n8n) and active customer acquisition
• Positioning: GDPR-compliant, locally hosted AI solutions for SMEs

• Led end-to-end delivery of ML/AI applications for the QuantistryLab simulation platform, from requirements definition and solution design to development, testing, deployment, and production support, coordinating efforts across back-end, DevOps, and ML teams
• Designed and implemented a compound search system with an open-weights LLM, the Pydantic AI agent framework, and the Model Context Protocol (MCP), exposing it through FastAPI endpoints
• Deployed and configured vLLM-based LLM serving on Kubernetes
• Built CI/CD pipelines and Helm charts to automate deployments across staging and production environments
• Instrumented the search system with OpenTelemetry spans and traces, integrating with the Honeycomb observability platform to monitor component-level latency and functional errors
• Developed a custom evaluation dataset and implemented evaluations for retrieval relevance, answer correctness, tool-call accuracy, and end-to-end task success
• Reduced infrared spectrum prediction time by 83% (from 60 to 10 minutes) by replacing a quantum-mechanical model with a pretrained graph neural network; fine-tuned the model using PyTorch, built and containerized the inference pipeline with Docker, and integrated it into the platform
• Implemented an MLflow model registry with MinIO-backed artifact storage
• Advised sales and science teams on ML/AI applications for prospective client projects, providing technical expertise to shape proposed solutions and prototypes

Technologies: AWS, Hetzner, Kubernetes, Helm, Docker, vLLM, Pydantic AI, MCP, Qwen, Llama 3, MLflow, MinIO, GitHub Actions, Python, FastAPI, OpenTelemetry, Honeycomb, PyTorch, Polars, pytest

• Fine-tuned and evaluated alternative backbone architectures for the AFFGAN handwriting style encoder to better capture writer-specific features, benchmarking against the original baseline architecture and replacing the legacy VGG19 architecture with a custom Transformer-based encoder.
• Extended the system beyond word-level synthesis to line-level handwriting generation, integrating and adapting an existing line-generation architecture to support full-sentence output.
• Deployed the handwriting generation pipeline as a web application, enabling users to select a writing style, input custom text, and instantly generate a corresponding handwriting image.
• Integrated TrOCR into a teacher–student distillation framework to evaluate and improve readability of generated handwriting, improving OCR accuracy by 20% over the baseline.
• Boosted user-study pick-rates by 40%, demonstrating a significant leap in the perceptual quality and realism of the generated handwriting compared to the baseline model.

Tech: PyTorch, Python, GANs, CNN, ViT, TrOCR, Streamlit, CUDA.

• Building, implementing and selling automated Data Science solutions such as Scorecard Factory and Forecast Factory
• Implementation of automated end-to-end cloud processes
• Development of LLM and NLP models
• Creation of interactive reports
• Support for national and international large corporations as well as medium-sized companies in implementing ML projects

• ▶ Built real-time voice assistant (STT → LLM → TTS pipeline) benchmarking and evaluating multiple STT providers including faster-whisper and Azure Speech. achieved sub-3s latency, Groq API (Llama 3) with multi-turn memory - directly handling edge cases in dictation, names and passcode recognition.

• TrendReel, production LLM agent and RAG system (Python, LangChain, OpenAI, Groq/Llama 3, Claude, FastAPI, Kubernetes, PostgreSQL).
• Designed and built a production multi-step LLM agent system: a script generation agent with a per-platform psychology database, 7 viral narrative frameworks, and structured quality scoring, switching between Claude and Groq backends in real time based on output metrics.
• Implemented multi-provider LLM routing (Claude primary, Groq/Llama 3 fallback) with priority-chain failover and quality-based provider switching, achieving 95% inference cost reduction while holding measurable quality thresholds.
• Built an advanced RAG-style retrieval pipeline with per-platform knowledge bases, semantic content matching, and structured output evaluation across 7 decision frameworks, directly analogous to multi-tenant context-based reasoning for enterprise document workflows.
• BrainyAI, adaptive AI learning platform (Python, LangChain, Groq Llama 3.3-70B, OpenAI, Next.js, Supabase, Redis).
• Integrated Groq Llama 3.3-70B with education-level-aware prompting, dynamically adjusting vocabulary depth, citation complexity, and reasoning style across four student proficiency tiers.
• Nexus Prime, multi-tenant SaaS platform for marketing and growth automation (25 modules, 99 backend routers, 153 frontend files).
• Built a 25-module, 99-router multi-tenant SaaS platform covering ad remix, affiliates, WhatsApp inbox, email, and cart recovery, serving four subscription tiers from $199 to $1,999 per month with integrated Stripe, Paystack, and Flutterwave billing.
• AI Video Surveillance Platform, multi-tenant edge and cloud computer vision system currently in active client pitch.
• Designed a multi-tenant AI video surveillance platform combining edge YOLO26 inference on NVIDIA Jetson Orin NX boxes with a central GKE cloud layer (Postgres, Pub/Sub, ClickHouse, R2, Keycloak) for event storage, dashboards, alerting, and multi-tenancy.

• Further development and operation of a central backend service for providing vehicle inventory for international Mercedes-Benz online shops
• Further development of a reservation service for vehicles as part of the checkout process
• Design and implementation of a highly scalable end-to-end test architecture with a focus on maintainability, reusability, and a high number of automated test cases
• Development of a multi-layer test infrastructure with a strict separation of test logic and access layers
• Development of an initialization and caching architecture to significantly speed up local and CI/CD-based test runs
• Development of an AI-supported review architecture for automated evaluation and quality assurance of end-to-end tests
• Development of a dashboard for consolidated display of a vehicle context across multiple backend systems, including AI-generated summaries and compact case analyses
• Integration and further development of connections to various reservation systems via Apache Kafka and REST
• Design of new microservices and support with architecture decisions
• Risk analysis and design of microservice migrations
• Technologies: Java, Spring, Spring Boot, Gradle, Maven, Apache Kafka, REST, OpenAPI, Swagger, Github, Confluence, CI/CD, Microservices, AI, LLMs

• Acted as technical consultant to optimize multi-layer ensemble models combining ResNet, CNN-BiGRU-Attention, and XGBoost.
• Guided implementation of a Logistic Regression meta-learner to solve class imbalance problems, achieving 92.86% accuracy and 0.9644 AUC on PTB-XL and Chapman-Shaoxing datasets.

"Reasoning Models: From LLM Foundations to NOC Automation."

• Designed and deployed enterprise Retrieval-Augmented Generation (RAG) applications using LangChain, LangGraph, vector databases, embeddings, and open-source LLMs served through vLLM on GCP GPU infrastructure.
• Built agentic AI workflows using LangGraph with planning, reasoning, tool execution, persistent memory, session management, and Human-in-the-Loop approval mechanisms.
• Developed LLM-powered automation systems integrating BigQuery, SQL pipelines, and external advertising APIs including Meta, TikTok, Amazon, Snapchat, Google, and Pinterest, reducing manual operational workflows.
• Architected multi-agent AI systems for enterprise analytics and decision-support workflows, enabling autonomous task execution and intelligent data interactions.
• Implemented retrieval optimization strategies including multi-retriever architectures, semantic search, context optimization, and query improvement techniques, improving response relevance by approximately 40%.
• Engineered structured prompting strategies, function-calling schemas, and validation workflows to improve reliability of multi-step LLM applications.
• Designed scalable AI services using Python, FastAPI, Cloud Run, Pub/Sub, BigQuery, Docker, and cloud-native deployment architectures.

• Provided technical leadership for a 4-engineer team delivering 3 major client platforms in 12 months with microservices architecture and scalability solutions — 100% of scoped majors shipped ahead of schedule vs. planned milestones (baseline: prior releases often slipped 1–2 sprints).
• Ran AI model evaluation and model outputs evaluation on LLM/AI vendor APIs: safety, completeness, instruction adherence, and groundedness review before go-live; cut escaped bad outputs in AI-integrated release checklists from recurring UAT findings to near-zero on final promote.
• Drove API development and performance optimization for payment, exchange, and AI services; fail-closed error handling and payload validation reduced integration rework cycles by ~35% vs. the first AI integration pass.
• Applied software testing, testing frameworks, code quality assurance, and code refactoring with continuous integration gates; first-pass PR acceptance improved across the team and production hotfixes on AI adapters dropped noticeably after review standards landed.
• Owned DevOps practices: Docker, GitHub Actions, Jenkins-compatible pipelines, and version control workflows — cut deployment time ~50% vs. pre-automation baseline and stabilized releases across 3 client environments.
• Implemented verifier/oracle-style pass-fail checks in container sandboxes (Harbor/Terminal-Bench aligned); wrote technical documentation so failures cleared in one review cycle.
• Led cross-functional collaboration with product and client stakeholders; translated AI evaluation scores and risk findings into plain-language briefs for non-technical partners, unblocking go/no-go decisions without extra engineering meetings.
• Used agile methodologies for sprint planning and backlog ownership; mentored engineers so mid-level contributors owned AI adapter modules independently by mid-engagement.

Strategic AI consulting for management, identification, assessment and prioritization of agentic use cases, training for the development team and management