Apache Airflow Experts in Munich

• Building, implementing and selling automated Data Science solutions such as Scorecard Factory and Forecast Factory
• Implementation of automated end-to-end cloud processes
• Development of LLM and NLP models
• Creation of interactive reports
• Support for national and international large corporations as well as medium-sized companies in implementing ML projects

• Build and operate an end-to-end MLOps platform on Azure ML and Kubernetes (Kubeflow) for the automated deployment, monitoring, and scaling of forecasting models (including Temporal Fusion Transformer, Informer, Autoformer).
• Implement CI/CD pipelines in Azure DevOps for the full ML lifecycle – from resource provisioning (Terraform), data transformation (Hugging Face Datasets, Pandas, PyTorch, CUDA cluster) through training and evaluation to model registry and endpoint deployment.
• Integrate MLflow for experiment tracking, model versioning, performance monitoring, and automated registration in the Azure Model Registry.
• Develop and containerize PyTorch training jobs (Azure Notebook, Jupyter Notebooks) for price and time series forecasting (PFC models) with automatic rollout via Azure ML Endpoints and REST/gRPC interfaces, Docker containerization, secured with OAuth 2.0.
• Set up monitoring and alerting mechanisms (Prometheus, MLflow Metrics), log centralization, and cost monitoring.
• Automate infrastructure provisioning and model deployment using Terraform, Helm, and Azure CLI; connect to existing market data systems and event pipelines.
• Migrate existing workloads and databases (IONOS → Azure, MongoDB) with integration into central MLOps workflows and internal networks.
• Extend the platform with LLM-based tools (LangChain, LangServe) to integrate GPT-based analysis modules into existing Spring Boot services for market anomaly detection and automated reports.
• Analyze and architect a software solution to process large volumes of data efficiently (>3000 messages/sec.) (market data store).
• Spring Boot / Java 21 container development with RabbitMQ for distributing stock market data via MongoDB (Kubernetes) with fast storage of data in Redis RMaps, deduplication, forwarding messages to Read Model queues, and building Read Models for UI display in MongoDB.
• Integration of RESTHeart to create a REST API for MongoDB.
• Build an Angular frontend to simplify data queries and master data maintenance.
• Agentic coding with remote and local LLMs (Claude Sonnet, Ollama Qwen) and MCP servers.
• Develop Python scripts for transforming and cleaning incoming stock market data (Pandas, scikit-learn).

• Developed & maintained customer analytical reporting solutions to identify revenue trends, performance drivers, risks & optimization opportunities to ensure data driven decision making across Sales, Finance, Product, Data Engineering & Controlling.
• Defined & analyzed customer trends & performance metrics to identify root causes behind variances, anomalies & emerging risks across business domains to deliver actionable recommendations.
• Developed & owned analytical data models & reporting layers to ensure scalability, performance & analytical robustness to support executive & operational reporting across business domains.
• Planned, tracked & executed projects by ensuring adherence to timelines, data accuracy, consistency, deliverables, reliability & data quality standards through rigorous validation & reconciliation processes.
• Raised the analytical maturity by formalizing analytical workflows, documenting data processes & standard operating procedures (SOPs) & conducting training sessions to drive adoption of self-service analytics & embed a data driven culture across operational and business teams.
• Took ownership of the end-to-end lifecycle roadmap from requirement gathering, collection, transformation, developing robust business logics to data storytelling & stakeholder delivery.
• Converted complexity into structured clarity by translating requirements & business processes into analytical recommendations to ensure alignment between non-technical & technical stakeholders.
• Conducted advanced SQL based analysis of complex business datasets to uncover trends, correlations & performance improvement opportunities.
• Drove process automation & efficiency improvements by leveraging Python, SQL optimization & AI assisted tools to reduce processing time & increase reliability across analytical & operational workflows.
• Standardized KPI definitions & reporting logic to ensure consistency & trust across reporting solutions.
• Developed process monitoring dashboards & analyses to identify inefficiencies, bottlenecks & compliance deviations across end-to-end business processes to derive actionable recommendations for process improvement & automation.

• Built a Python pipeline that converts lectionary web content into structured daily JSON, applying liturgical-calendar rules for accurate weekday and Sunday coverage.
• Shipped a read-only FastAPI REST API with shared Pydantic models and delivered a Kirundi-first web client for browser and mobile use.
• Owned the data layer and backend architecture, collaborating closely on system architecture and interfaces while automating refreshes with GitHub Actions and validating the ETL with pytest.
• Impact: Created a reliable, API-driven source of truth for daily Bible readings in Kirundi, enabling consistent access to previously unstructured content.

• Idea, design and initial implementation of a service that aggregates publicly available data to estimate prices for certain types of objects
• Collection of data from different data sources and its normalization. Embedding the data using SentenceTransformer and training gradient boost models
• Implementation of a web service that
• reads arbitrary user text
• extends it if some parts of data are missing
• uses a local LLM model to prepare the data for prediction
• embed the data and call for prediction from the gradient boost model
• uses a LLM model to generate a report for the user request including explanations
• Stack: BigQuery, Vertex AI, Cloud Run (GCP), Python, Terraform, DBT, SentenceTransformer, Qwen
• Minor SEO optimizations
• More to come...

• Create an AI legal assistant with modern ML capabilities.
• Implement RAG architecture, with data pipelines for legal data search.
• Use AWS Bedrock for LLM and embedding models and LangChain/LangGraph
• Python with FastApi for backend and React for frontend

DWH for customer and financial data

• Extension of the DWH with new data sources
• Report development
• Data quality management

Methodology: Scrum

Tools: Atlassian Confluence & Jira

Databases: Microsoft SQL Server

Programming languages: SQL, T-SQL

ETL: Microsoft SQL Server Integration Services (SSIS)

Frontend platform: PowerBI, Microsoft Reporting Services

• Designed and implemented end-to-end data pipelines (batch & streaming) using Python, SQL, and Apache Spark, Databricks on AWS reducing ETL latency by 40%.
• Developed serverless event-driven ingestion pipelines using AWS Lambda and SQS, ensuring real-time data availability for downstream analytics.
• Leveraged Google Cloud Platform (GCP) services including BigQuery and Dataflow to manage cross-cloud data warehousing and analytics integration.
• Expertise in DMS (CDC, Full Load) and Airflow for scalable data pipeline automation and orchestration.
• Managed and customized data pipelines using Databricks, Airflow. Automation using Docker, Kubernetes, Terraform.
• Automated data quality checks using dbt to modularize transformations and ensure production-grade data lineage, improving reliability by 30%.
• Collaborated with compliance teams to ensure GDPR and SOC2 alignment. Mentored junior engineers and contributed to architecture refactoring for scalability.
• Created and maintained dashboards in Power BI to provide actionable insights.

AI Assistance and Target Vision for Partially Autonomous Energy Portfolio Management

Building an AI control layer directly on the up-to-date daily live portfolio of a large energy provider — not as an isolated pilot, but as an operational extension of the existing DB1 and portfolio management. The goal is the gradual development from assistance through monitoring/alerting to analysis agents with Human-in-the-Loop approvals, supplemented by a role-specific System of Engagement alongside the BI System of Record. At the same time, the business case, target vision and management pitch compared with static monthly reporting are being developed.

• AI control layer: Design and build on the existing live portfolio data product (several million contracts) — development stages assistance → monitoring/alerting → agents with Human-in-the-Loop approvals.
• LLM-supported data analysis: Semantic queries, SQL/tool integration and additional RAG components based on portfolio, plan-versus-actual and data quality data (Azure OpenAI, Snowflake), with drill-downs to individual contract level.
• Analysis agents: Multi-stage agents for variance and driver analyses of churn, price adjustments, volumes and procurement costs.
• Views concept: Role-specific interfaces for business units, management and C-level as a System of Engagement alongside the BI System of Record.
• Business case & pitch: Target vision and cost-benefit argumentation compared with static monthly reporting.
• LLM setup (privacy & security): Coordination with IT Security and Data Protection — EU region, data separation and approval processes.
• Agent architecture: Multi-stage agent pipelines (analysis → validation → summary) with documented data sources, tool calls, review steps and source references for each statement.
• Data foundation: Built on the up-to-date daily DB1 data product (Snowflake, dbt) — portfolio, plan-versus-actual and data quality metrics as the common basis for all AI analyses.
• Guardrails & evaluation: Evaluation and approval processes for LLM responses relating to management-relevant statements — test sets, metrics and human review.
• Prototyping & validation: Iterative validation of agent responses with the business unit — test question catalogue, feedback loops and response quality for each release.
• Roadmap & development stages: Detailed stages from assistance → monitoring/alerting → partially autonomous management, including transition criteria and governance for each stage.
• Integration: Integration into the existing BI and data landscape — BI remains the System of Record, while the AI layer provides interactive drill-down paths as the System of Engagement.
• Enablement: Enablement of business users — prompting guides, training and an operating model for ongoing use.
• Management: Coordination of business units, Data Engineering, IT Security and Data Protection.
• Change Management: Communication and expectation management with business units and management throughout the development stages.

Results:

• Built on an existing up-to-date daily data product with several million contracts
• Established an LLM setup coordinated with Data Protection and IT Security in the EU region, including data separation and approvals
• Defined three development stages through to partially autonomous management
• Designed role-specific views for business units, management and C-level
• Developed the business case and management pitch for the development stages
• Established an iterative response-quality validation process with the business unit
• Designed the operating model for assistance operations and initiated validation

Stack: Azure OpenAI, Azure AI Foundry, Snowflake, dbt, React, TypeScript, Entra ID, RAG, Agentic AI, analysis agents, Human-in-the-Loop, Prompt Engineering, LLM Evaluation, LLMOps, GDPR / EU region, Azure DevOps, Python, SQL, Change Management

• Designed, built, and maintained scalable ETL/ELT data pipelines using Python, SQL, REST APIs, AWS Lambda, S3, PostgreSQL RDS, EventBridge, CloudWatch, Docker, Apache Airflow, and BigQuery – integrating data from GA4, Google Ads, Meta Ads, CMS, CRM, newsletters, events, and B2C ordering systems into analytics-ready datasets.
• Built a cross-brand lakehouse architecture from AWS to BigQuery – transforming raw JSON/CSV data into structured, partitioned, and reusable reporting layers with staging, intermediate, canonical, and mart models.
• Designed relational and dimensional data models: 3NF staging models, star schemas, fact tables, dimension tables, daily KPI aggregates, and dashboard-optimized marts for marketing, content, subscription, event, CRM, and revenue analysis.
• Implemented production-grade data quality and pipeline reliability features: incremental loads, idempotent upserts, deduplication, schema validation, row matching, null checks, anomaly detection, freshness monitoring, logging, retries, and error alerts.
• Automated cross-brand reporting processes and data products – pipelines for 73 newsletter campaigns, 31 lead list syncs, 52 event partner reports, and a 500K-record company matching pipeline; reduced manual data preparation by approx. 70% and increased analyst productivity by approx. 30%.

• Concept creation and implementing AI Agents in AWS Cloud
• Continuously alignment with stakeholders
• Collaborate with DevOps
• Technologies: Git, CI/CD (GitHub Actions), Python/ML, Streamlit, Deno/typescript, AWS SAM, AWS Bedrock, AWS Lambda, AWS Dynamo DB, AWS S3, AWS Event Bridge etc.

• Co-founded an AI venture focused on building production-grade LLM applications and agentic systems
• Designed and implemented multi-agent AI workflows for financial and trading applications
• Developed LLM-powered copilot architectures for portfolio analysis, trade management, and personalized user coaching
• Built on-device and edge-deployed inference applications, optimizing models for low latency, privacy, and resource-constrained environments
• Led system architecture decisions across model selection, orchestration, state management, and deployment

• Role: Software Engineer & Applied Mathematician (Mathematical optimization for scheduling; duration: 1 months; team setting: Team of 2, remote; technologies: JuMP, Julia, Pluto, Svelte, JavaScript, TypeScript, JetBrains Space, Terraform, Nomad)

• Role: Software & Cloud & Web Engineer (Building scalable data science compute cluster from scratch; duration: 11 months; team setting: Team of 1, on-site; technologies: Terraform, Kubernetes, k8s ingress, k8s services, k8s RBAC, k8s networking, k3s, etcd, S3, DNS, certificates, Julia, Pluto, JavaScript, Tailwind, Astro, npm, Parcel, Preact, MUI, JWT, AWS SQS, AWS RDS, Python, GitLab, GitHub)

• Role: AI & Web Engineer (Custom ChatGPT service; duration: 1 months; team setting: Team of 2, remote; technologies: Python, Poetry, LangChain, Tailwind, ChatGPT API, Flask, FastAPI)

• Role: Architect & Data Engineer (Central datalake setup and ingestion; duration: 9 months; team setting: Team of 5, remote; technologies: Infrastructure-as-code, AWS CDK, Python, Boto3, PySpark, AWS Glue, IAM, S3, ECS, Fargate, Lambda, Apache Hudi, DeltaLake, Databricks, GitHub, Jira, Miro)

• Role: Software Engineer (PoC Julia migration of scikit-decide; duration: 1 months; team setting: Team of 2, remote; technologies: Python, Julia, GitHub)

• Architected a self-service Google Kubernetes Engine (GKE) platform for a major financial institution (Commerzbank), enabling 1000+ users across hundreds of product teams to autonomously provision resources and significantly accelerate development cycles.
• Designed a data-product-oriented platform architecture for the UK Department for Transport (DfT) to serve over 1500 direct end-users and numerous connected third-party systems, enhancing data accessibility and governance.
• Drove business growth by developing the strategic roadmap for the 'One Cloud' business line, targeting a 10% revenue increase.
• Served as a key member of the CTO Authority, providing strategic guidance on internal cloud initiatives and best practices.