Apache Hadoop Experts in Munich

• This project involved extraction of intelligence data to support report writing for a company that provides geopolitical, global, commercial intelligence. The data have been gathered from a number of resources (interview transcripts, online data, internal documents), and then a knowledge base has been build from it. This was the basis of a complex RAG system, that was evaluated against a golden dataset. Agents have been used to find out the contradicting intelligence, the statements supporting each other, and to store back the generated knowledge.

Used: Python, RAG, LangGraph, LangChain, deepeval, MCP

PMO & Project Organization Blueprint for Restructuring

Renewable Energy / Solar Equipment

Technologies / Methods: PMO setup, KPI tracking, project organization, Jira, Confluence

• Developed measures to improve management control during a restruct...

• Building, implementing and selling automated Data Science solutions such as Scorecard Factory and Forecast Factory
• Implementation of automated end-to-end cloud processes
• Development of LLM and NLP models
• Creation of interactive reports
• Support for national and international large corporations as well as medium-sized companies in implementing ML projects

• Development High-Performance ad distribution via auction
• Holistic (multi-campaign & multi-channel) advertisement placement optimization
• Algorithmic optimization for NP-Hard/NP-e
• Multiple Knapsack Problem with constraints
• Online estimation of parameters in stochastic environments

Tools: Python, R, Kotlin, MILP/SAT/CP Solvers, Pytorch, Pandas, Docker

• It is like a startup within REWE, where we have to build a new forecasting system on Google Cloud Platform from the scratch. Although, officially my role is called MLOps, my actual tasks also include development of data processing pipelines (data engineering) and data scientists tasks such as feature engineering and model trainings.
• GCP: Terraform (tofu), Vertex AI (Kubeflow), Cloud Run, IAM, Google Cloud Storage, BigQuery, Artifact Registry
• Data engineering: Snowflake as the main data warehouse, Terraform, DBT for data model implementations
• CI/CD: GitLab. We have built a CI/CD pipeline that automates deployments of new releases up to production environment
• Development of feature store and data synchronization between environments
• Data science: evaluation of different forecasting models, including CatBoost, Contextual Gamma and Random Forest; implementation of training pipelines using Kubeflow on Vertex AI; scaling and development of an event-driven interface using Kafka as a forecasting service; evaluation of MLFlow for model tracking and model registry
• Implementation of REST API using KeyCloak OAuth2 and OpenID (JWT)
• Monitoring: implementation of dashboards with Grafana, Prometheus, Mimir, Streamlit and Loki to monitor prediction metrics, GCP and Snowflake costs for pipelines, and system metrics
• Development of Copilot Agent Skills

Large Insurance Company – Consultant Wiesbaden: Consulting support for the introduction of an integrated planning and performance management framework (operational, financial, customer) to enhance customer-centric transparency, decision-making quality, and steering capabilities across all lines of business within an insurance organization:

• Analysis of existing processes, reports, KPIs, and KPI calculation methodologies
• Design and introduction of new, standardized customer KPIs (gross/net), as well as key steering metrics with consistent linkage across all lines of business
• Recalculation, validation, and plausibility checks of KPIs based on existing and newly integrated data sources
• Conceptual support for the development of an integrated reporting and performance management setup
• Execution of customer insights analyses to identify patterns and anomalies within customer data clusters

Large retail company – Consultant in Karlsruhe: Advisory services for the setup and step-by-step implementation of an internationally deployable RELEX solution in the supply chain management environment:

• Advising overall and sub-project management on methodology, project setup and steering (e.g. agile approach, Jira configuration, RELEX phases, Jira Structure PPM)
• Strategic-operational consulting for the introduction of RELEX including best practices
• Support in defining overarching goals and requirements (2-year target picture)
• Guidance in scoping a relevant supply chain network segment for the project
• Development of a roadmap for iterative, incremental RELEX setup and rollout
• Assessment of project dependencies (interfaces, configurations, etc.)
• Advice on prioritized implementation of business requirements and data interfaces
• Support in test planning (data validation, system testing, UAT)
• Consulting on internationalization, change management, training, and knowledge transfer
• Stakeholder advisory and alignment activities between the client, implementation partner, and RELEX

Insurance company – Management Consultant in Munich: Analysis, consulting and support for the optimization of a large-scale business and IT transformation. Focus on strategically important programs and modernization projects in the area of Managed Services Operations and processes:

• Review of project plans and deliverables; analysis of programs and projects (e.g. cloud approach, process standardization, system integration, roadmaps)
• Identification of technical, functional and personnel risks and challenges; development of content-related measures and alternative solutions
• Proposal of quality improvements for program and modernization efforts
• Sparring partner and professional, technical, structural and organizational consulting for project and program management

Large retail group – Management Consultant & Stream Lead in Cologne: Consulting, process, project and product management for the introduction and implementation of a large strategic program in the field of advanced analytics, assortment and space management:

• Setup, test and rollout of a new space planning, automation and optimization product based on the existing cluster-based merchandising approach
• Definition and setup of new processes and transformation and change management measures for the new store-specific merchandising approach
• Collaboration with Advanced Analytics and IT (internal and external) for software implementations, automations, extensions and interfaces
• MVP approach and piloting in phases with gradual rollout (pilot with 80 stores, region with 500 stores, national level with 4000 stores)

Large retail company – Agile Coach & Change Agent in Cologne: Agile coach, OKR master and facilitator for the introduction of the OKR approach in a large strategic digitization program for retail stores:

• Coaching of the core team with topic managers and team leads
• Introduction to the OKR topic and setup of the OKR cycle
• Establishment of the OKR approach in teams and on a cross-team level

Delivery and logistics company – Management Consultant in United Kingdom: Consulting and coaching in the restructuring of the Data Analytics department:

• Analysis of current challenges
• Definition of overarching goals
• Development of a proposal for a new team structure
• Identification of required competencies, skills and responsibilities
• Advisory and alignment on communication and change management strategy

• Concept creation and implementing AI Agents in AWS Cloud
• Continuously alignment with stakeholders
• Collaborate with DevOps
• Technologies: Git, CI/CD (GitHub Actions), Python/ML, Streamlit, Deno/typescript, AWS SAM, AWS Bedrock, AWS Lambda, AWS Dynamo DB, AWS S3, AWS Event Bridge etc.

• Head of overall technical integration NSC (National Secure Cloud, project with approx. 60 employees).

• Technical integration of all subprojects into one product, definition of interfaces and basic components of a cloud including hardware, technical architecture of the IABG platform.

• Development of a Cloud Management Platform (CMP) capable of creating private/mixed clouds of any complexity based on a textual description with one click or interactively.

• CMP also includes the complete hardware management lifecycle.

• Kubernetes, OpenStack and Hadoop are used as the foundation.

• The management layer includes Harbor, Gitea, Longhorn, Keycloak, Rancher and Jenkins, which are configured automatically.

• Private cloud can run any customer workloads, including a full Hadoop layer with HDFS, Spark, MapReduce, Mesos, HBase and around 20 additional ML/DL technologies.

• Hadoop worker clusters can also be installed automatically without Kubernetes on bare metal or commodity hardware.

• OpenStack with Nova, Neutron, Ironic, Swift, Cinder, Ceph.

• Development of a Java application Rudi: SOAP, REST, containers, DB.

• Technologies: Kubernetes (K3s, Rke2, Minikube, Harbor, Gitea, Jenkins, Longhorn, Keycloak, Rancher), OpenStack (Nova, Neutron, Keystone, Swift, Ceph, Cinder, Sahara, Magnum, Kayobe, Kolla, Bigrost, Ironic), Hadoop (HDFS, Ambari, Solr, Livy, Ranger, YARN, Tez, HBase, Kafka, Hive, Zookeeper, MapReduce, Spark, Oozie, Flink), virtualization (Kubernetes (K3S), VMware, Oracle), scripting (Ansible, Puppet, Juju, Shell, Groovy, Gradle, Maven).

• Role: Software Engineer & Applied Mathematician (Mathematical optimization for scheduling; duration: 1 months; team setting: Team of 2, remote; technologies: JuMP, Julia, Pluto, Svelte, JavaScript, TypeScript, JetBrains Space, Terraform, Nomad)

• Role: Software & Cloud & Web Engineer (Building scalable data science compute cluster from scratch; duration: 11 months; team setting: Team of 1, on-site; technologies: Terraform, Kubernetes, k8s ingress, k8s services, k8s RBAC, k8s networking, k3s, etcd, S3, DNS, certificates, Julia, Pluto, JavaScript, Tailwind, Astro, npm, Parcel, Preact, MUI, JWT, AWS SQS, AWS RDS, Python, GitLab, GitHub)

• Role: AI & Web Engineer (Custom ChatGPT service; duration: 1 months; team setting: Team of 2, remote; technologies: Python, Poetry, LangChain, Tailwind, ChatGPT API, Flask, FastAPI)

• Role: Architect & Data Engineer (Central datalake setup and ingestion; duration: 9 months; team setting: Team of 5, remote; technologies: Infrastructure-as-code, AWS CDK, Python, Boto3, PySpark, AWS Glue, IAM, S3, ECS, Fargate, Lambda, Apache Hudi, DeltaLake, Databricks, GitHub, Jira, Miro)

• Role: Software Engineer (PoC Julia migration of scikit-decide; duration: 1 months; team setting: Team of 2, remote; technologies: Python, Julia, GitHub)

• Designed and deployed GDPR-compliant data pipelines.
• Developed machine learning algorithms for after-sales analysis, improving repair detection.
• Built cloud-based data lake architecture, enabling cross-functional digital transformation.

• Lead Architect to design and implement the data lake and ETL Pipeline using AWS Stack
• Performance Optimization of Data Ingestion of ETL Pipeline
• Development of Data Validation using Great Expectations
• Leading of the data migration for two sources exchanges
• Data Modeling in AWS Redshift

MLOps

• Model inference implementation by mlflow and AWS SageMaker
• Feature Engineering for the running ML Models ( Recommender Engineer, Clustering )
• Implementatino of Model Registry and artifactory using mlflow
• Historization an Profiling of the Input Data Using AWS Glue Crawler and AWS Data Catalog
• Feature importance using mlflow

Tech. Stack: Python 3, AWS Glue, AWS Step Fucntion, AWS Lambda, AWS EventBridge, AWS IAM Role, AWS SageMaker, AWS EC2, AWS Glue Crawler, AWS CloudWatch, MLFlow, ETL, Data lake, GitHub Action, Terraform, Jenkins, Ansible playbooks (Infrastructure as Code), CI/CD, GitLab, SQL, PySparkSCRUM, Agile, Jira, BigData, VSCode, DBeaver, MSSQL, MySQL, grafana, Docker, Linux, Bash, MapReduce, Data Modeling (ORM), Pandas, YAML, SQL-Alchemy

• Developed the AI strategy for a major Austrian retailer with over €10 billion in annual revenue.
• Developed a go-to-market strategy for AI services for a Norwegian consulting firm specializing in SAP technologies.
• Delivered AI for Business training programs to a leading German supermarket chain.
• Defined AI governance project structure and roadmap for a large German manufacturer.
• Certified facilitator for AI Design Sprint™, leading use case discovery workshops for large enterprises.
• IEEE Certified AI Ethics Assessor with expertise in building AI governance frameworks aligned with the EU AI Act.
• Founder of aiethicsassessor.com as knowledge base for AI governance and AI legislation.
• Author of a best-selling Udemy course on Data Architecture.
• Developed intelligent agents using low-code/no-code platforms to automate complex business processes.

• Developed web scraping scripts to extract and parse over 5000 product data from the Zalando website.
• Performed ETL processes using Apache Spark in CDSW, loaded the data into the Hadoop ecosystem (HDFS), and managed data using Hive and Impala.
• Implemented machine learning algorithms, achieving 85–90% accuracy on multi-class product classification.
• Integrated Zalando's product and price data into the dashboard with Otto and Takko for interactive visuals.

• Implementation, maintenance and operation of an ERP system and a document exchange platform for a corrugated cardboard manufacturer.
• Tools and systems: Unix (Debian 6.x), C, SVN, Windows, C#, MS SQL Server, SCRUM.