Data Engineers in Munich

• Built a Python pipeline that converts lectionary web content into structured daily JSON, applying liturgical-calendar rules for accurate weekday and Sunday coverage.
• Shipped a read-only FastAPI REST API with shared Pydantic models and delivered a Kirundi-first web client for browser and mobile use.
• Owned the data layer and backend architecture, collaborating closely on system architecture and interfaces while automating refreshes with GitHub Actions and validating the ETL with pytest.
• Impact: Created a reliable, API-driven source of truth for daily Bible readings in Kirundi, enabling consistent access to previously unstructured content.

DWH for customer and financial data

• Extension of the DWH with new data sources
• Report development
• Data quality management

Methodology: Scrum

Tools: Atlassian Confluence & Jira

Databases: Microsoft SQL Server

Programming languages: SQL, T-SQL

ETL: Microsoft SQL Server Integration Services (SSIS)

Frontend platform: PowerBI, Microsoft Reporting Services

• Delivered backend systems, data processing solutions, and software integrations for enterprise business applications.
• Designed and implemented API-based services connecting internal platforms with external systems.
• Built automated processing workflows to handle large-scale structured business data.
• Improved application performance by 30–50% through database optimization, caching strategies, and backend refactoring.
• Reduced manual operational effort by 40–60% by automating repetitive workflows.
• Supported production environments through troubleshooting, monitoring improvements, and continuous optimization.
• Authored technical documentation and led knowledge-transfer sessions to support long-term maintainability.

• Designed, developed, and configured scalable data applications aligned with business processes and technical requirements.
• Architected scalable, cost-effective data architectures leveraging Snowflake across AWS, Azure and GCP, integrating dbt for data transformation and modeling.
• Built and maintained robust ETL Data Pipelines, ensuring high data quality for seamless migration and cross-system integration.
• Demonstrated strong expertise in SQL & Python with extensive experience in data modeling, ETL/ELT pipeline development, and streaming data processing; proficient in Git-based version control, CI/CD practices, and testing frameworks, with solid knowledge of data quality, observability, cost optimization, security, and data governance principles.
• Led multiple data migration initiatives from SAP HANA to Snowflake using a modular dbt framework.
• Designed and maintained end-to-end data transformation workflows using dbt on Snowflake, implemented layered data models, optimized performance, and ensured high-quality data delivery for business intelligence and reporting.
• Managed development, QA, and production deployments through structured version control and release management using GitLab.
• Integrated and centralized data from multiple sources including relational databases, flat files, Excel, and large-scale systems into Snowflake.
• Applied strong expertise in Sales, Marketing, HR, and ERP data domains, developing and maintaining relevant KPIs and reporting solutions.
• Collaborated with cross-functional teams to deliver end-to-end data solutions on schedule through proactive issue resolution and effective coordination.
• Administered the Snowflake sandbox environment for Data Engineering division.
• Trained colleagues transitioning into data roles on Snowflake and provided technical guidance and mentorship to junior team members.

• Design, development, and maintenance of end-to-end ETL pipelines for scalable and reliable data integration
• Support in data quality checks, testing, and migrations
• Development and maintenance of dbt models for structured, modular, and reusable data transformations
• Use of AI-driven development to improve ETL job creation and code quality.
• Development of CI/CD for automated deployment.

• Designed and implemented end-to-end data pipelines (batch & streaming) using Python, SQL, and Apache Spark, Databricks on AWS reducing ETL latency by 40%.
• Developed serverless event-driven ingestion pipelines using AWS Lambda and SQS, ensuring real-time data availability for downstream analytics.
• Leveraged Google Cloud Platform (GCP) services including BigQuery and Dataflow to manage cross-cloud data warehousing and analytics integration.
• Expertise in DMS (CDC, Full Load) and Airflow for scalable data pipeline automation and orchestration.
• Managed and customized data pipelines using Databricks, Airflow. Automation using Docker, Kubernetes, Terraform.
• Automated data quality checks using dbt to modularize transformations and ensure production-grade data lineage, improving reliability by 30%.
• Collaborated with compliance teams to ensure GDPR and SOC2 alignment. Mentored junior engineers and contributed to architecture refactoring for scalability.
• Created and maintained dashboards in Power BI to provide actionable insights.

• Migration of existing data jobs from Cognos Data Manager to Tibco/IBI Datamigrator
• Migration data jobs parametrisation for dynamic runs
• Optimisation and cutting-back
• Regression tests
• Knowledge transfer and documentation

• Established and leading multi-year research roadmap
• Developed and implementing hiring plan for science and data
• Spearheading data engineering efforts in the company
• Led the team to deploy a new trading algorithm, increasing assets’ revenue of 18%

• Lead Architect to design and implement the data lake and ETL Pipeline using AWS Stack
• Performance Optimization of Data Ingestion of ETL Pipeline
• Development of Data Validation using Great Expectations
• Leading of the data migration for two sources exchanges
• Data Modeling in AWS Redshift

MLOps

• Model inference implementation by mlflow and AWS SageMaker
• Feature Engineering for the running ML Models ( Recommender Engineer, Clustering )
• Implementatino of Model Registry and artifactory using mlflow
• Historization an Profiling of the Input Data Using AWS Glue Crawler and AWS Data Catalog
• Feature importance using mlflow

Tech. Stack: Python 3, AWS Glue, AWS Step Fucntion, AWS Lambda, AWS EventBridge, AWS IAM Role, AWS SageMaker, AWS EC2, AWS Glue Crawler, AWS CloudWatch, MLFlow, ETL, Data lake, GitHub Action, Terraform, Jenkins, Ansible playbooks (Infrastructure as Code), CI/CD, GitLab, SQL, PySparkSCRUM, Agile, Jira, BigData, VSCode, DBeaver, MSSQL, MySQL, grafana, Docker, Linux, Bash, MapReduce, Data Modeling (ORM), Pandas, YAML, SQL-Alchemy

• Replacement of a Java application and the Oracle DB for loading the internal WerWasWo system using SSIS.
• Development of SSIS packages to load text files into the database (SQL Server)
• Development of a database project for deployment on various servers
• Creation of queries to monitor the loading runs
• Development of a PowerShell script to automate the deployment of the SSDT projects.
• Oracle, SQL Developer, Microsoft SQL Server 2022 on-premises, SQL Server Management Studio v21, Visual Studio 2022, SSIS, SSDT, PowerShell.

• Architected an agentic, real-time offer orchestration engine where specialized agents (retrieval, pricing/optimization, and policy/guardrails) coordinate to personalise promotions across customer touchpoints using RAG with FAISS over Delta Lake and low-latency Databricks Model Serving. Collaborated with product managers and commercial stakeholders to shape the roadmap and evaluate emerging agent patterns for production.

• Designed an agent-based data quality service that orchestrates schema detection, entity normalization, and validator/exception-handling agents to clean multi-retailer SKU feeds at scale. Wrapped model calls in PySpark UDFs for distributed inference, automated via Databricks Workflows and CI/CD.

• Developed a multimodal, agentic extraction pipeline where vision, parsing, and compliance agents collaborate to derive brand, packaging, and volume from scanned images using Claude 3 Sonnet with Swin Transformer encoders. Orchestrated via Azure Event Hub with outputs persisted to Delta Lake.

• Implemented a GS1 taxonomy classification service built around cooperating agents for inference, drift monitoring, and auto-retraining governance using Falcon 180B (LoRA-tuned) with a batch pipeline on Databricks.

• Created a hybrid agent workflow where a retrieval agent surfaces candidate matches via embeddings and a reasoning/verification agent (Mixtral 8x7B) adjudicates receipt-to-SKU alignment, integrated into a streaming Databricks pipeline.

• Built a multimodal attribute inference pipeline structured as cooperating vision-language, rules/consistency, and compliance agents to fill NutriScore, nutrition fields, and packaging types from names and images using LLaMA 3-8B with CLIP embeddings.

• Developed a GenAI-powered orchestration system that ingests recipes from multiple websites, parses ingredients through structured extraction agents, and dynamically links them to real-time retailer offers via tagging, semantic reasoning, and business-rule agents.

• Head of technical overall integration NSC (National Secure Cloud project with about 60 employees).

• Technical integration of all subprojects into one product, definition of interfaces, basic components of a cloud including hardware, technical architecture of the IABG base.

• Development of a Cloud Management Platform (CMP) that can create a private/mixed cloud of any complexity based on a textual description with one click or interactively.

• CMP also includes the complete hardware management cycle.

• As a foundation, it uses Kubernetes, OpenStack, and Hadoop.

• The management layer includes Harbor, Gitea, Longhorn, Keycloak, Rancher and Jenkins, which are automatically configured.

• The private cloud can run any customer workloads, including a full Hadoop stack with HDFS, Spark, MapReduce, Mesos, HBase and around 20 other ML/DL technologies.

• Hadoop worker clusters can also be automatically installed on bare metal or commodity hardware without Kubernetes.

• OpenStack with Nova, Neutron, Ironic, Swift, Cinder, Ceph.

• Development of a Java application Rudi: SOAP, REST, containers, database.

• Technologies: Kubernetes (K3s, RKE2, Minikube, Harbor, Gitea, Jenkins, Longhorn, Keycloak, Rancher), OpenStack (Nova, Neutron, Keystone, Swift, Ceph, Cinder, Sahara, Magnum, Kayobe, Kolla, Bigrost, Ironic), Hadoop (HDFS, Ambari, Solr, Livy, Ranger, YARN, Tez, HBase, Kafka, Hive, Zookeeper, MapReduce, Spark, Oozie, Flink), virtualization (Kubernetes (K3s), VMware, Oracle), scripting (Ansible, Puppet, Juju, Shell, Groovy, Gradle, Maven).

• Architecture, design and development of an MVP application for a provider of specialized travel experiences
• Technologies: Python, FastAPI, Firestore, Firebase, Docker

• Developed data extraction from PostgreSQL with Talend ETL tool
• Developed SQL/PL SQL scripts and views as required for ETL process
• Used the GIT repository together with the existing CI/CD process for testing and production deployment
• Created and updated multiple complex ETL jobs for mapping tarif data into SQLite files for the Input Pool
• Extracted and transformed source data via an H2 DB into SQLite for MT and ticket machines
• Collaborated closely with requirements engineers and data managers in an Agile environment