Azure Data Factory Experts

• Development of an AI-powered project organization tool for a civil engineering company that intelligently links project, task, tender, schedule, and document data through a knowledge graph.
• Implementation of AI features for document analysis, information extraction, context-based assistance, and voice-based data capture based on Microsoft Azure AI, reducing administrative effort, making information available faster, and supporting project teams in decision-making.
• Tech stack: Python, React, TypeScript, FastAPI, Claude Code, Codex, Graphify, PostgreSQL, Microsoft Azure AI Foundry, Azure OpenAI, Azure AI Speech, Azure AI Document Intelligence, Microsoft Graph, Microsoft Entra ID, Docker, Git, CI/CD.

Enterprise Analytics Modernization – Germany-based enterprise reporting platform for operations and management analytics, used by 1,000+ internal users across multiple departments.

• Lead end-to-end Power BI and Microsoft Fabric reporting initiatives, delivering scalable dashboards and semantic models supporting daily operational and strategic decisions, achieving 30% faster decision turnaround and 25% reporting efficiency gains.
• Designed unified enterprise datasets using Microsoft Fabric Lakehouse and OneLake, automating historical data processing and reducing manual reporting effort by 40%.
• Built and maintained automated ingestion pipelines using Fabric Dataflows Gen2 and Data Pipelines, improving data refresh reliability to 99.8% uptime and ensuring consistent data quality.
• Implemented enterprise reporting governance, including Row-Level Security (RLS), workspace strategy, deployment pipelines, and documentation, increasing dashboard adoption by 35%.

Technologies used: Power BI, Microsoft Fabric, DAX, Power Query, SQL, Azure Data Fundamentals, Semantic Modeling, RLS, Agile

• Led enterprise reporting modernization by migrating legacy SSRS reporting solutions to Power BI, supporting 500+ business users while ensuring full GDPR/DSGVO compliance.
• Designed and optimized Power BI and Microsoft Fabric semantic models using star schema, dimensional modeling, advanced DAX, and performance optimization techniques, reducing query latency by 25%.
• Delivered 20+ executive and operational dashboards featuring KPI scorecards, drill-through, bookmarks, and row-level security, improving reporting efficiency by 20%.
• Enabled self-service analytics through governed Power BI datasets, dataflows, and gateway architecture, increasing business-led reporting adoption by 35%.
• Configured an incremental refresh policy and query folding for a 50+ million row sales dataset, reducing daily report refresh times by 85%.
• Deployed automated ETL/ELT pipelines using Azure Data Factory, Microsoft Fabric, and Snowflake, reducing reporting delivery timelines by 40% through workflow automation.
• Spearheaded Microsoft Fabric analytics modernization initiatives including lakehouse architecture, OneLake integration, and centralized data platform development, reducing data latency from 2 hours to 20 minutes.
• Translated business requirements from 15+ stakeholders into scalable Power BI semantic models and dashboards, improving reporting consistency and reducing ad-hoc reporting requests by 25%.
• Applied Microsoft Copilot and generative AI tools to accelerate SQL development, DAX authoring, technical documentation, and testing activities, reducing development effort by approximately 15 hours per week.

• Architected and deployed private cloud data platform on VMware vSphere, integrating Greenplum MPP, Apache Kafka, Kubernetes, and Apache Solr, and developed real-time ingestion pipelines with Kafka Connect and Schema Registry.
• Led Oracle Exadata to Greenplum migration, rearchitected data models, optimized storage, implemented RabbitMQ with Debezium for CDC, and deployed VectorDB for Generative AI.
• Designed and executed multi-cloud migration PoC across AWS, Azure, and GCP, defined KPIs for throughput, latency, and cost efficiency, executed bulk data transfers, validated analytics and streaming workloads, and delivered full-scale architecture recommendations.
• Assessed legacy on-premises infrastructure and designed modern cloud-native data platforms using Greenplum and containerized microservices, advising on scalability, disaster recovery, and high-availability.

Architected and maintained data products for renewable energy operations, covering wind turbine, grid-meter, and weather data. Built scalable ETL/ELT pipelines in Azure Databricks using Delta Lake (bronze/silver/gold layers) and processed data in various formats, including structured and semi-structured data. Contributed to a data quality framework supporting table and column documentation, outlier detection, and completeness metrics across all datasets within a data product. In addition, implemented a DORA KPI Databricks dashboard used across all data products. Optimized CI/CD processes in Azure DevOps to streamline deployment across development, test, and production environments.

Technology stack: Azure Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Azure Data Lake, APIs, Dremio, Azure DevOps, YAML, Git, Databricks Workflows, Application Insights, Terraform, OpenAI API, Codex, LLM-assisted workflows

I designed and developed an AI-powered multi-tenant platform on Azure that transforms SAP process recordings into technical documentation, presentations and automated tests, processing over 15,000 process recordings for enterprise customers like Würth. I owned the architecture, the production releases and the DevOps setup. I also designed a multi-tenant system with SSO and role-based access on Azure. Implemented an MCP Server with Dynamic OAuth Authentication.

Main Tasks:

• Sprint planning and feature preparation
• Design the multi-tenant platform architecture (FastAPI, SQLAlchemy, PostgreSQL row-level security for tenant isolation)
• Develop AI pipelines with Prefect for transcription (Azure Speech API), document generation and SAP screen-recording analysis (Claude, gpt-4-mini)
• Design and implement an MCP server to expose tenant knowledge to LLM clients (Claude), with async retrieval and reranking
• Implement LLM cost tracking, rate limiting and client pooling for Anthropic/OpenAI/Azure OpenAI endpoints
• Set up CI/CD: Docker images to Azure Container Registry, GitHub Actions, Azure Static Web Apps, Alembic migrations in containers
• Manage production releases and execute live data migrations for enterprise customers
• Define engineering standards and architecture patterns for the team

Environment: Azure / Azure Foundry / Python / FastAPI / Prefect / React / PostgreSQL

• Developed & maintained customer analytical reporting solutions to identify revenue trends, performance drivers, risks & optimization opportunities to ensure data driven decision making across Sales, Finance, Product, Data Engineering & Controlling.
• Defined & analyzed customer trends & performance metrics to identify root causes behind variances, anomalies & emerging risks across business domains to deliver actionable recommendations.
• Developed & owned analytical data models & reporting layers to ensure scalability, performance & analytical robustness to support executive & operational reporting across business domains.
• Planned, tracked & executed projects by ensuring adherence to timelines, data accuracy, consistency, deliverables, reliability & data quality standards through rigorous validation & reconciliation processes.
• Raised the analytical maturity by formalizing analytical workflows, documenting data processes & standard operating procedures (SOPs) & conducting training sessions to drive adoption of self-service analytics & embed a data driven culture across operational and business teams.
• Took ownership of the end-to-end lifecycle roadmap from requirement gathering, collection, transformation, developing robust business logics to data storytelling & stakeholder delivery.
• Converted complexity into structured clarity by translating requirements & business processes into analytical recommendations to ensure alignment between non-technical & technical stakeholders.
• Conducted advanced SQL based analysis of complex business datasets to uncover trends, correlations & performance improvement opportunities.
• Drove process automation & efficiency improvements by leveraging Python, SQL optimization & AI assisted tools to reduce processing time & increase reliability across analytical & operational workflows.
• Standardized KPI definitions & reporting logic to ensure consistency & trust across reporting solutions.
• Developed process monitoring dashboards & analyses to identify inefficiencies, bottlenecks & compliance deviations across end-to-end business processes to derive actionable recommendations for process improvement & automation.

• Developed KPI dashboards using Power BI and DAX for 4+ business units, improving reporting transparency and strategic decision support.
• Migrated enterprise finance data views into dbt models, implementing modular SQL transformations, version-controlled data pipelines, and automated documentation to create a scalable analytics layer.
• Built dimensional data models in Snowflake for enterprise finance data, enabling scalable forecasting and supporting executive decision-making.
• Designed end-to-end ETL/ELT pipelines using Snowflake and SAP HANA, integrating data from 3+ enterprise systems.
• Automated monthly reporting workflows using SQL and Power BI, delivering strong business impact by reducing manual effort by 80%.
• Collaborated with finance stakeholders to translate business requirements into analytical data models, supporting strategic decision-making cycles.
• Delivered ad-hoc financial reports using Power BI, reducing turnaround time by 60%.
• Implemented data validation logic in SQL, resolving 95% of recurring data quality issues.

• Led design, development, and deployment of data solutions supporting a major pharma acquisition for Takeda Pharmaceutical Company, delivering transparency reporting systems across Azure,Databricks (Python and Shell Scripting) platforms.
• Owned,Designed and developed scalable ELT pipelines to process Customer and Product data using Azure, complex SQL, Databricks, and shell scripting, enabling efficient data integration and processing across multiple sources including job orchestration and workflow automation.
• Implemented performance optimization techniques (query tuning, parallelism, workload optimization), improving system efficiency and processing time.
• Applied strong analytical and problem-solving skills to assess technical solutions and support business requirements for compliance and transparency reporting.
• Designed scalable data foundations suitable for downstream analytics and AI workloads.
• Led data quality initiatives by assessing multiple source data, defining quality metrics, and establishing processes for monitoring and continuous improvement.

As a freelance IT lecturer and IT coach, I specialize in teaching individuals concepts like Cloud Computing, Business Intelligence, Python Programming and Agile Frameworks. My goal is to simplify complex technical concepts into practical, actionable knowledge. Through my extensive experience as an IT consultant in various sectors and roles I know about the importance of IT training - for companies and employees alike.

• Designed and implemented end-to-end data pipelines (batch & streaming) using Python, SQL, and Apache Spark, Databricks on AWS reducing ETL latency by 40%.
• Developed serverless event-driven ingestion pipelines using AWS Lambda and SQS, ensuring real-time data availability for downstream analytics.
• Leveraged Google Cloud Platform (GCP) services including BigQuery and Dataflow to manage cross-cloud data warehousing and analytics integration.
• Expertise in DMS (CDC, Full Load) and Airflow for scalable data pipeline automation and orchestration.
• Managed and customized data pipelines using Databricks, Airflow. Automation using Docker, Kubernetes, Terraform.
• Automated data quality checks using dbt to modularize transformations and ensure production-grade data lineage, improving reliability by 30%.
• Collaborated with compliance teams to ensure GDPR and SOC2 alignment. Mentored junior engineers and contributed to architecture refactoring for scalability.
• Created and maintained dashboards in Power BI to provide actionable insights.

Responsibilities: Design and operation of end-to-end cloud data platforms for enterprise clients in publishing and finance, including infrastructure automation, pipeline development, monitoring, and data quality.

Activities:

• Built multi-layer data architectures on Databricks (Apache Spark, Delta Lake), BigQuery, and GCP
• Fully automated cloud infrastructure with Terraform across 3 environments (DEV/STG/PRD)
• Developed automated data pipelines with Python, dbt, and GCP services for various data sources
• Built monitoring and alerting systems for real-time platform monitoring
• Implemented data versioning and quality checks at every layer
• Designed automated testing and deployment pipelines in GitLab and Bitbucket

Achievements:

• Doubled production data processing capacity, reduced spike response time from minutes to ≤15 s, server errors ≈ 0
• Replaced 3,000 lines of manual configuration with a reusable automation module for 7 customer domains, reducing configuration errors to 0
• Delivered a complete end-to-end data platform at ~10 €/month in infrastructure costs
• Migrated 7 database tables with 0 downstream issues
• Removed 100 % of exposed credentials, eliminating dependency on external vendors
• Delivered 3-team integration in 1 sprint

AI Assistance and Target Vision for Partially Autonomous Energy Portfolio Management

Building an AI control layer directly on the up-to-date daily live portfolio of a large energy provider — not as an isolated pilot, but as an operational extension of the existing DB1 and portfolio management. The goal is the gradual development from assistance through monitoring/alerting to analysis agents with Human-in-the-Loop approvals, supplemented by a role-specific System of Engagement alongside the BI System of Record. At the same time, the business case, target vision and management pitch compared with static monthly reporting are being developed.

• AI control layer: Design and build on the existing live portfolio data product (several million contracts) — development stages assistance → monitoring/alerting → agents with Human-in-the-Loop approvals.
• LLM-supported data analysis: Semantic queries, SQL/tool integration and additional RAG components based on portfolio, plan-versus-actual and data quality data (Azure OpenAI, Snowflake), with drill-downs to individual contract level.
• Analysis agents: Multi-stage agents for variance and driver analyses of churn, price adjustments, volumes and procurement costs.
• Views concept: Role-specific interfaces for business units, management and C-level as a System of Engagement alongside the BI System of Record.
• Business case & pitch: Target vision and cost-benefit argumentation compared with static monthly reporting.
• LLM setup (privacy & security): Coordination with IT Security and Data Protection — EU region, data separation and approval processes.
• Agent architecture: Multi-stage agent pipelines (analysis → validation → summary) with documented data sources, tool calls, review steps and source references for each statement.
• Data foundation: Built on the up-to-date daily DB1 data product (Snowflake, dbt) — portfolio, plan-versus-actual and data quality metrics as the common basis for all AI analyses.
• Guardrails & evaluation: Evaluation and approval processes for LLM responses relating to management-relevant statements — test sets, metrics and human review.
• Prototyping & validation: Iterative validation of agent responses with the business unit — test question catalogue, feedback loops and response quality for each release.
• Roadmap & development stages: Detailed stages from assistance → monitoring/alerting → partially autonomous management, including transition criteria and governance for each stage.
• Integration: Integration into the existing BI and data landscape — BI remains the System of Record, while the AI layer provides interactive drill-down paths as the System of Engagement.
• Enablement: Enablement of business users — prompting guides, training and an operating model for ongoing use.
• Management: Coordination of business units, Data Engineering, IT Security and Data Protection.
• Change Management: Communication and expectation management with business units and management throughout the development stages.

Results:

• Built on an existing up-to-date daily data product with several million contracts
• Established an LLM setup coordinated with Data Protection and IT Security in the EU region, including data separation and approvals
• Defined three development stages through to partially autonomous management
• Designed role-specific views for business units, management and C-level
• Developed the business case and management pitch for the development stages
• Established an iterative response-quality validation process with the business unit
• Designed the operating model for assistance operations and initiated validation

Stack: Azure OpenAI, Azure AI Foundry, Snowflake, dbt, React, TypeScript, Entra ID, RAG, Agentic AI, analysis agents, Human-in-the-Loop, Prompt Engineering, LLM Evaluation, LLMOps, GDPR / EU region, Azure DevOps, Python, SQL, Change Management