Data Pipeline Experts in Munich

• Development of an AI-powered project organization tool for a civil engineering company that intelligently links project, task, tender, schedule, and document data through a knowledge graph.
• Implementation of AI features for document analysis, information extraction, context-based assistance, and voice-based data capture based on Microsoft Azure AI, reducing administrative effort, making information available faster, and supporting project teams in decision-making.
• Tech stack: Python, React, TypeScript, FastAPI, Claude Code, Codex, Graphify, PostgreSQL, Microsoft Azure AI Foundry, Azure OpenAI, Azure AI Speech, Azure AI Document Intelligence, Microsoft Graph, Microsoft Entra ID, Docker, Git, CI/CD.

• Leading enterprise BI transformation across Power BI & Microsoft Fabric, delivering scalable data models, automated reporting, and high-performance analytics solutions for commercial and operational leadership.
• Building and optimizing Power BI Dataflows, Fabric Lakehouse datasets, semantic models, and automated reporting pipelines to improve data scalability, governance, and reporting performance.
• Driving dashboard modernization and KPI governance by translating complex business requirements into executive-level insights, interactive visualizations, and decision-ready analytics.
• Designing end-to-end Microsoft Fabric architectures integrating data ingestion, transformation, virtualization, and enterprise reporting across cross-functional business domains with SAP BW to Qlik to Power BI migration.
• Delivering AI-enabled reporting capabilities, threshold-based alerting, and automation frameworks within the Power BI ecosystem to accelerate business decision-making.
• Partnering with commercial leadership, analytics teams, and IT stakeholders to standardize KPIs, optimize BI strategy, and deliver scalable, business-critical reporting solutions.
• Recognized for combining strong stakeholder leadership, technical architecture expertise, and business-driven analytics to deliver impactful enterprise BI transformation initiatives.

• Led enterprise reporting modernization by migrating legacy SSRS reporting solutions to Power BI, supporting 500+ business users while ensuring full GDPR/DSGVO compliance.
• Designed and optimized Power BI and Microsoft Fabric semantic models using star schema, dimensional modeling, advanced DAX, and performance optimization techniques, reducing query latency by 25%.
• Delivered 20+ executive and operational dashboards featuring KPI scorecards, drill-through, bookmarks, and row-level security, improving reporting efficiency by 20%.
• Enabled self-service analytics through governed Power BI datasets, dataflows, and gateway architecture, increasing business-led reporting adoption by 35%.
• Configured an incremental refresh policy and query folding for a 50+ million row sales dataset, reducing daily report refresh times by 85%.
• Deployed automated ETL/ELT pipelines using Azure Data Factory, Microsoft Fabric, and Snowflake, reducing reporting delivery timelines by 40% through workflow automation.
• Spearheaded Microsoft Fabric analytics modernization initiatives including lakehouse architecture, OneLake integration, and centralized data platform development, reducing data latency from 2 hours to 20 minutes.
• Translated business requirements from 15+ stakeholders into scalable Power BI semantic models and dashboards, improving reporting consistency and reducing ad-hoc reporting requests by 25%.
• Applied Microsoft Copilot and generative AI tools to accelerate SQL development, DAX authoring, technical documentation, and testing activities, reducing development effort by approximately 15 hours per week.

• Designing the audit logging framework
• Implementing APIs for developers to integrate in their codebase
• Implementing ingestion pipeline, database query layer and UI for browsing the audit events
• Improving stability and reliability of the backend system

• Defined the vision, strategy, and roadmap of AI-powered analytics products, ensuring they met the business needs of Sales, Marketing, Finance, and executive teams across Europe.
• Collected business requirements, prioritized AI product features, and led Agile development of forecasting and analytics solutions. Defined product specifications, user stories, and acceptance criteria to ensure successful delivery.
• Collaborated with business stakeholders, Product Owners, data scientists, ML engineers and software engineers to transform AI models into scalable business products and integrate AI insights into operational workflows.
• Designed and implemented Generative AI solutions leveraging Large Language Models (LLMs) to automate reporting and enable natural-language querying of enterprise data, reducing manual effort by approximately 30%.
• Defined product goals and success metrics, tracked product performance and user adoption, and continuously improved the product based on user feedback and business results.
• Established data governance, master data quality and reporting standards across SQL, BigQuery and Power BI environments to ensure reliable, secure and scalable analytics.

• Data Engineering: Design and implementation of scalable data pipelines
• Legacy migrations to Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines)
• BO Universe migrations to MS Fabric / Semantic Models / Power BI
• Taskforce for data-driven transformation projects involving Azure Fabric / Oracle / MSSQL

In my role as Senior Cloud DevOps Architect for BP, an oil and gas company, I had the mission to migrate the Electric Vehicle Charging platform of the EV Division from on-premises and Azure to AWS cloud, resulting in a hybrid multi-cloud, multi-tenant SaaS solution.

Deployment with Kubernetes for the application layer meant provisioning Kubernetes clusters managed by EKS and AKS, with a focus on integrating them into a multi-tenant environment. This integration was achieved by using Kubernetes namespaces and access controls to ensure data isolation and privacy enforcement.

In the database layer, we chose an RDS instance with PostgreSQL to support the backend infrastructure of our applications. Tenants shared the same RDS instance, but each had a dedicated schema.

To ingest near real-time data from physical charge points (CPOs), as IoT devices, via the OCPI protocol, we ran into significant delays with batch processing. As a result, we built a real-time streaming data pipeline using Apache Kafka, while prioritizing an event-driven architecture.

Led collaboration across multiple internal teams, external vendors, cloud providers, and on-site partners to integrate over five systems into a unified solution.

Achievements:

• Successfully designed and implemented hybrid multi-cloud solutions, integrating multiple cloud platforms (AWS, Azure) with on-premises infrastructure, using Site-to-Site VPNs, Firewalls, and Load Balancing.
• Led the migration of on-premises infrastructure to multi-cloud, multi-tenant infrastructure, resulting in 30% faster processing times.
• Migrated workloads from VMware and Hyper-V environments to cloud-based VMs, leveraging cloud-native services to optimize performance, cost efficiency, and scalability.
• Designed a multi-tenant Kubernetes platform leveraging the Kubernetes ecosystem, using Karpenter for dynamic EC2 node provisioning, KEDA for event-driven pod autoscaling (e.g., Kafka message lag), and Rancher for centralized monitoring of multiple clusters (EKS, AKS, or on-prem K8s), replacing Microsoft-centric Azure Arc management service.
• Designed and implemented Python-based FastAPI microservices as part of the EV core-backend on AWS EKS application layer, powering data ingestion and customer analytics pipelines.
• Developed asynchronous, event-driven APIs (Python-FastAPI) for real-time integration with CPOs, supporting OCPI 2.3 and OICP protocols.
• Designed and implemented a secure, production-grade Azure Databricks platform using Terraform, ensuring scalability and cost efficiency.
• Migrated on-premises ERP to a hybrid Dynamics 365 architecture with ERP hosted locally and CRM running in Azure, integrated via Azure Arc.
• Automated CI/CD pipelines for Databricks notebooks and jobs using GitHub Actions & Databricks CLI, reducing deployment time. Reduced infrastructure provisioning time by 70% by automating cloud resource deployment with GitOps.
• Ensured compliance with internal audit and data governance standards (GDPR) through OAuth2/OIDC-based authentication and fine-grained role-based access controls.
• Developed a Zero Trust security model, enforcing least-privilege access and microsegmentation, enhancing security posture and compliance with GDPR and NIST.
• Built interactive analytics dashboards in Amazon QuickSight, integrating data from S3 and Redshift to deliver real-time business insights and visualizations with embedded access for multi-tenant users.
• Led cloud security assessments and full-lifecycle cybersecurity integration during M&A, covering AWS, Azure, IAM (Entra ID), and data protection, while aligning security posture with NIST, ISO 27001, and GDPR across hybrid and cloud-native environments.
• Reduced cloud costs by 64% for a client's dev environment by implementing automated start/stop schedules for EC2 and RDS instances via AWS CDK with EventBridge Scheduler or AWS Systems Manager.

Tech stack:

• Infrastructure as Code: Terraform, AWS CDK, Ansible.
• Containers: Kubernetes on EKS, AKS, Docker.
• Streaming Data Processing: Kafka to Confluent Cloud, after AWS MSK.
• Frontend: TypeScript, React, NextJS, Hooks, Styled Components.
• Backend: Python with FastAPI, also Node.js with NestJS.
• Database: Aurora on PostgreSQL with TypeORM, RDS on SQL Server, Azure Databricks full setup and administration, ETL Pipelines.
• CI/CD and GitOps: GitHub Actions, Azure DevOps, ArgoCD.
• Monitoring and Observability: Prometheus and Grafana.
• Virtualization: Hyper-V, VMware Cloud on AWS, Azure Migrate.
• ERP Systems: Odoo, Microsoft Dynamics 365 Business Central on Azure, integrated with Azure Arc.
• Networking: Site-to-Site VPNs, AWS Direct Connect, Azure ExpressRoute, Firewalls (AWS Network Firewall, Azure Firewall).
• Security: IAM, NIST Framework, Zero Trust Security, AWS WAF, AWS Shield, GuardDuty.

• Built a Python pipeline that converts lectionary web content into structured daily JSON, applying liturgical-calendar rules for accurate weekday and Sunday coverage.
• Shipped a read-only FastAPI REST API with shared Pydantic models and delivered a Kirundi-first web client for browser and mobile use.
• Owned the data layer and backend architecture, collaborating closely on system architecture and interfaces while automating refreshes with GitHub Actions and validating the ETL with pytest.
• Impact: Created a reliable, API-driven source of truth for daily Bible readings in Kirundi, enabling consistent access to previously unstructured content.

• It is like a startup within REWE, where we have to build a new forecasting system on Google Cloud Platform from the scratch. Although, officially my role is called MLOps, my actual tasks also include development of data processing pipelines (data engineering) and data scientists tasks such as feature engineering and model trainings.
• GCP: Terraform (tofu), Vertex AI (Kubeflow), Cloud Run, IAM, Google Cloud Storage, BigQuery, Artifact Registry
• Data engineering: Snowflake as the main data warehouse, Terraform, DBT for data model implementations
• CI/CD: GitLab. We have built a CI/CD pipeline that automates deployments of new releases up to production environment
• Development of feature store and data synchronization between environments
• Data science: evaluation of different forecasting models, including CatBoost, Contextual Gamma and Random Forest; implementation of training pipelines using Kubeflow on Vertex AI; scaling and development of an event-driven interface using Kafka as a forecasting service; evaluation of MLFlow for model tracking and model registry
• Implementation of REST API using KeyCloak OAuth2 and OpenID (JWT)
• Monitoring: implementation of dashboards with Grafana, Prometheus, Mimir, Streamlit and Loki to monitor prediction metrics, GCP and Snowflake costs for pipelines, and system metrics
• Development of Copilot Agent Skills

Conducted an independent technical assessment of an AI-enabled software platform, combining AI risk auditing, cybersecurity analysis and software architecture review. Reviewed application components, APIs, data flows, LLM integrations, retrieval-augmented generation, multi-agent orchestration, authentication, tenant isolation, dependency vulnerabilities, AI governance and model lifecycle controls. Authored a technical audit report with a structured risk register, source-code evidence, regulatory references, corrective actions, AI system inventory, risk classification, remediation roadmap and Key Risk Indicators.

Technologies: TypeScript, JavaScript, React, Next.js, Node.js, REST APIs, MongoDB, Redis, AWS serverless services, OAuth 2.0 / OpenID Connect, LLM APIs, RAG, vector search, multi-agent orchestration, Model Context Protocol, C4 architecture modelling, threat modelling, NIST AI RMF, ISO/IEC 42001, ISO/IEC 23894, OWASP guidance, MITRE ATLAS

• Create an AI legal assistant with modern ML capabilities.
• Implement RAG architecture, with data pipelines for legal data search.
• Use AWS Bedrock for LLM and embedding models and LangChain/LangGraph
• Python with FastApi for backend and React for frontend

• Designed, developed, and configured scalable data applications aligned with business processes and technical requirements.
• Architected scalable, cost-effective data architectures leveraging Snowflake across AWS, Azure and GCP, integrating dbt for data transformation and modeling.
• Built and maintained robust ETL Data Pipelines, ensuring high data quality for seamless migration and cross-system integration.
• Demonstrated strong expertise in SQL & Python with extensive experience in data modeling, ETL/ELT pipeline development, and streaming data processing; proficient in Git-based version control, CI/CD practices, and testing frameworks, with solid knowledge of data quality, observability, cost optimization, security, and data governance principles.
• Led multiple data migration initiatives from SAP HANA to Snowflake using a modular dbt framework.
• Designed and maintained end-to-end data transformation workflows using dbt on Snowflake, implemented layered data models, optimized performance, and ensured high-quality data delivery for business intelligence and reporting.
• Managed development, QA, and production deployments through structured version control and release management using GitLab.
• Integrated and centralized data from multiple sources including relational databases, flat files, Excel, and large-scale systems into Snowflake.
• Applied strong expertise in Sales, Marketing, HR, and ERP data domains, developing and maintaining relevant KPIs and reporting solutions.
• Collaborated with cross-functional teams to deliver end-to-end data solutions on schedule through proactive issue resolution and effective coordination.
• Administered the Snowflake sandbox environment for Data Engineering division.
• Trained colleagues transitioning into data roles on Snowflake and provided technical guidance and mentorship to junior team members.

• Designed and implemented end-to-end data pipelines (batch & streaming) using Python, SQL, and Apache Spark, Databricks on AWS reducing ETL latency by 40%.
• Developed serverless event-driven ingestion pipelines using AWS Lambda and SQS, ensuring real-time data availability for downstream analytics.
• Leveraged Google Cloud Platform (GCP) services including BigQuery and Dataflow to manage cross-cloud data warehousing and analytics integration.
• Expertise in DMS (CDC, Full Load) and Airflow for scalable data pipeline automation and orchestration.
• Managed and customized data pipelines using Databricks, Airflow. Automation using Docker, Kubernetes, Terraform.
• Automated data quality checks using dbt to modularize transformations and ensure production-grade data lineage, improving reliability by 30%.
• Collaborated with compliance teams to ensure GDPR and SOC2 alignment. Mentored junior engineers and contributed to architecture refactoring for scalability.
• Created and maintained dashboards in Power BI to provide actionable insights.

• Architecture, design and development of an MVP application for a provider of specialized travel experiences
• Technologies: Python, FastAPI, Firestore, Firebase, Docker