Azure Data Factory Experts in Munich

• Worked as freelance Senior DevOps Consultant on-site for IBM at a European Union Agency, operating in a highly secure, air-gapped environment managing classified systems.
• Led automation and DevOps initiatives for a large-scale OpenShift platform (>400 nodes), driving deployment efficiency, GitOps adoption, and operational automation using Ansible, Python, and Bash while ensuring compliance with security requirements.
• Spearheaded automation of release and deployment workflows in a private cloud environment hosting 400+ OpenShift nodes, significantly improving deployment speed and reliability.
• Migrated existing playbooks, roles, and templates from Ansible Tower to Ansible Automation Platform (AAP), ensuring full compliance with fully-qualified collection names (FQCN) and preparing custom Execution Environments (EE) for containerized automation.
• Implemented GitOps Agent for AAP Controller Configuration as Code, enabling automated synchronization (CRUD) of Ansible Controller objects based on repository-stored configuration definitions using GitHub webhooks.
• Designed and automated complex multi-step operational workflows including environment cleanup, Helix cluster component re-creation, Kafka topic management, and OpenShift object lifecycle management across ~100 environments.
• Achieved a reduction of multi-day manual operations to under a few hours through automation improvements spanning multiple AAP clusters and OpenShift environments.
• Integrated Ansible Automation Platform with Thycotic (Delinea) Secret Server via lookup plugin to enhance secure credential management in automated processes.
• Managed deployment tasks, platform troubleshooting, and Istio network configurations while adhering to stringent EU PSC security and compliance standards.
• Collaborated with infrastructure and application teams to refine deployment procedures, develop naming conventions, and continuously improve automation coverage in an air-gapped, classified environment.

• Development of an AI-powered project organization tool for a civil engineering company that intelligently links project, task, tender, schedule, and document data through a knowledge graph.
• Implementation of AI features for document analysis, information extraction, context-based assistance, and voice-based data capture based on Microsoft Azure AI, reducing administrative effort, making information available faster, and supporting project teams in decision-making.
• Tech stack: Python, React, TypeScript, FastAPI, Claude Code, Codex, Graphify, PostgreSQL, Microsoft Azure AI Foundry, Azure OpenAI, Azure AI Speech, Azure AI Document Intelligence, Microsoft Graph, Microsoft Entra ID, Docker, Git, CI/CD.

• Led enterprise reporting modernization by migrating legacy SSRS reporting solutions to Power BI, supporting 500+ business users while ensuring full GDPR/DSGVO compliance.
• Designed and optimized Power BI and Microsoft Fabric semantic models using star schema, dimensional modeling, advanced DAX, and performance optimization techniques, reducing query latency by 25%.
• Delivered 20+ executive and operational dashboards featuring KPI scorecards, drill-through, bookmarks, and row-level security, improving reporting efficiency by 20%.
• Enabled self-service analytics through governed Power BI datasets, dataflows, and gateway architecture, increasing business-led reporting adoption by 35%.
• Configured an incremental refresh policy and query folding for a 50+ million row sales dataset, reducing daily report refresh times by 85%.
• Deployed automated ETL/ELT pipelines using Azure Data Factory, Microsoft Fabric, and Snowflake, reducing reporting delivery timelines by 40% through workflow automation.
• Spearheaded Microsoft Fabric analytics modernization initiatives including lakehouse architecture, OneLake integration, and centralized data platform development, reducing data latency from 2 hours to 20 minutes.
• Translated business requirements from 15+ stakeholders into scalable Power BI semantic models and dashboards, improving reporting consistency and reducing ad-hoc reporting requests by 25%.
• Applied Microsoft Copilot and generative AI tools to accelerate SQL development, DAX authoring, technical documentation, and testing activities, reducing development effort by approximately 15 hours per week.

• Designed and implemented end-to-end data pipelines (batch & streaming) using Python, SQL, and Apache Spark, Databricks on AWS reducing ETL latency by 40%.
• Developed serverless event-driven ingestion pipelines using AWS Lambda and SQS, ensuring real-time data availability for downstream analytics.
• Leveraged Google Cloud Platform (GCP) services including BigQuery and Dataflow to manage cross-cloud data warehousing and analytics integration.
• Expertise in DMS (CDC, Full Load) and Airflow for scalable data pipeline automation and orchestration.
• Managed and customized data pipelines using Databricks, Airflow. Automation using Docker, Kubernetes, Terraform.
• Automated data quality checks using dbt to modularize transformations and ensure production-grade data lineage, improving reliability by 30%.
• Collaborated with compliance teams to ensure GDPR and SOC2 alignment. Mentored junior engineers and contributed to architecture refactoring for scalability.
• Created and maintained dashboards in Power BI to provide actionable insights.

AI Assistance and Target Vision for Partially Autonomous Energy Portfolio Management

Building an AI control layer directly on the up-to-date daily live portfolio of a large energy provider — not as an isolated pilot, but as an operational extension of the existing DB1 and portfolio management. The goal is the gradual development from assistance through monitoring/alerting to analysis agents with Human-in-the-Loop approvals, supplemented by a role-specific System of Engagement alongside the BI System of Record. At the same time, the business case, target vision and management pitch compared with static monthly reporting are being developed.

• AI control layer: Design and build on the existing live portfolio data product (several million contracts) — development stages assistance → monitoring/alerting → agents with Human-in-the-Loop approvals.
• LLM-supported data analysis: Semantic queries, SQL/tool integration and additional RAG components based on portfolio, plan-versus-actual and data quality data (Azure OpenAI, Snowflake), with drill-downs to individual contract level.
• Analysis agents: Multi-stage agents for variance and driver analyses of churn, price adjustments, volumes and procurement costs.
• Views concept: Role-specific interfaces for business units, management and C-level as a System of Engagement alongside the BI System of Record.
• Business case & pitch: Target vision and cost-benefit argumentation compared with static monthly reporting.
• LLM setup (privacy & security): Coordination with IT Security and Data Protection — EU region, data separation and approval processes.
• Agent architecture: Multi-stage agent pipelines (analysis → validation → summary) with documented data sources, tool calls, review steps and source references for each statement.
• Data foundation: Built on the up-to-date daily DB1 data product (Snowflake, dbt) — portfolio, plan-versus-actual and data quality metrics as the common basis for all AI analyses.
• Guardrails & evaluation: Evaluation and approval processes for LLM responses relating to management-relevant statements — test sets, metrics and human review.
• Prototyping & validation: Iterative validation of agent responses with the business unit — test question catalogue, feedback loops and response quality for each release.
• Roadmap & development stages: Detailed stages from assistance → monitoring/alerting → partially autonomous management, including transition criteria and governance for each stage.
• Integration: Integration into the existing BI and data landscape — BI remains the System of Record, while the AI layer provides interactive drill-down paths as the System of Engagement.
• Enablement: Enablement of business users — prompting guides, training and an operating model for ongoing use.
• Management: Coordination of business units, Data Engineering, IT Security and Data Protection.
• Change Management: Communication and expectation management with business units and management throughout the development stages.

Results:

• Built on an existing up-to-date daily data product with several million contracts
• Established an LLM setup coordinated with Data Protection and IT Security in the EU region, including data separation and approvals
• Defined three development stages through to partially autonomous management
• Designed role-specific views for business units, management and C-level
• Developed the business case and management pitch for the development stages
• Established an iterative response-quality validation process with the business unit
• Designed the operating model for assistance operations and initiated validation

Stack: Azure OpenAI, Azure AI Foundry, Snowflake, dbt, React, TypeScript, Entra ID, RAG, Agentic AI, analysis agents, Human-in-the-Loop, Prompt Engineering, LLM Evaluation, LLMOps, GDPR / EU region, Azure DevOps, Python, SQL, Change Management

• Replacement of a Java application and the Oracle DB for loading the internal WerWasWo system using SSIS.
• Development of SSIS packages to load text files into the database (SQL Server)
• Development of a database project for deployment on various servers
• Creation of queries to monitor the loading runs
• Development of a PowerShell script to automate the deployment of the SSDT projects.
• Oracle, SQL Developer, Microsoft SQL Server 2022 on-premises, SQL Server Management Studio v21, Visual Studio 2022, SSIS, SSDT, PowerShell.

• Designed and implemented an advanced, agentic RAG pipeline using LangChain and LangGraph for structured data extraction from PDFs, utilizing tools, state management, and OpenAI LLMs (GPT-4) to improve accuracy and handle complex document structures.
• Developed a Google AI agent for extraction of structured information from PDF documents and deployed the agent on Vertex AI.
• Architected data pipelines using Azure Data Factory and Databricks to ingest data from Azure Blob Storage, process it with PySpark, and load it into Azure SQL Database via Linked Services.
• Containerized AI agents and services using Docker for consistent local development and deployment.
• Utilized PySpark and Dask for database querying in coordination with Azure Blob Storage and Document Storage.
• Created a ReAct agent that extracts structured data from PDF documents using tools and integrating Azure Document Intelligence.
• Contributed to the CPO invoices validation check project using Databricks to find existing CDRs and calculate total valid costs.
• Developed a conversational AI agent (chatbot) with a FastAPI backend, integrating RAG for precise tariff extraction and deployed the service using Azure Container Apps.
• Tools used: Azure, Azure OpenAI, Azure Document Intelligence, Azure Blob Storage, Google ADK, Google Cloud, Vertex AI, Gemini, Databricks, LangChain, LlamaIndex Ollama, Docker, PySpark, Azure SQL, Azure Data Factory, Azure AI Agent, Microsoft SQL Server

• Lead Architect to design and implement the data lake and ETL Pipeline using AWS Stack
• Performance Optimization of Data Ingestion of ETL Pipeline
• Development of Data Validation using Great Expectations
• Leading of the data migration for two sources exchanges
• Data Modeling in AWS Redshift

MLOps

• Model inference implementation by mlflow and AWS SageMaker
• Feature Engineering for the running ML Models ( Recommender Engineer, Clustering )
• Implementatino of Model Registry and artifactory using mlflow
• Historization an Profiling of the Input Data Using AWS Glue Crawler and AWS Data Catalog
• Feature importance using mlflow

Tech. Stack: Python 3, AWS Glue, AWS Step Fucntion, AWS Lambda, AWS EventBridge, AWS IAM Role, AWS SageMaker, AWS EC2, AWS Glue Crawler, AWS CloudWatch, MLFlow, ETL, Data lake, GitHub Action, Terraform, Jenkins, Ansible playbooks (Infrastructure as Code), CI/CD, GitLab, SQL, PySparkSCRUM, Agile, Jira, BigData, VSCode, DBeaver, MSSQL, MySQL, grafana, Docker, Linux, Bash, MapReduce, Data Modeling (ORM), Pandas, YAML, SQL-Alchemy

• Development and validation of a data model and ESG rating pipeline
• GenAI governance

• Design, development, and maintenance of end-to-end ETL pipelines for scalable and reliable data integration
• Support in data quality checks, testing, and migrations
• Development and maintenance of dbt models for structured, modular, and reusable data transformations
• Use of AI-driven development to improve ETL job creation and code quality.
• Development of CI/CD for automated deployment.

• Project: SAP migration (ECC to S/4HANA) – US-based internal analytics product to manage finance and personnel performance insights of 10,000+ users across the Americas.
• Led cloud migration from a legacy data warehouse to Azure Data Lake and Databricks, improving system scalability by 40% and reducing manual interventions by 60%.
• Delivered end-to-end product ownership across 3 cross-functional Agile teams using SAFe methodology and Azure DevOps.
• Designed and implemented data pipelines using Azure Data Factory, improving data ingestion speed by 30% and reducing data errors by 25%.
• Defined the product roadmap, backlog, and sprint goals in collaboration with stakeholders, ensuring 95% of deliverables met business expectations.
• Managed the product backlog and prioritised feature development based on stakeholder needs, achieving a 25% increase in sprint velocity and a 100% sprint completion rate.
• Facilitated Agile ceremonies (sprint planning, reviews, retrospectives) that improved team collaboration and reduced delivery times by 20%.
• Led requirement gathering and analysis, enhancing data quality and aligning with business objectives, resulting in a 25% improvement in migration efficiency.
• Worked closely with business owners, achieving a 15% reduction in dispute resolution time and stronger alignment with business value.
• Established KPI dashboards to measure product adoption and platform stability, resulting in 20% improved stakeholder satisfaction.

• Developed energy estimation models to estimate electric charging and hydrogen refueling requirements at charging and refueling stations for logistics trucks in Germany.
• Estimated future freight traffic demand for Germany using an in-house transport demand model.
• Designed a network of electric charging and hydrogen refueling stations based on transport model results, supporting data-driven infrastructure planning.