Azure Data Factory Experts

• Development of an AI-powered project organization tool for a civil engineering company that intelligently links project, task, tender, schedule, and document data through a knowledge graph.
• Implementation of AI features for document analysis, information extraction, context-based assistance, and voice-based data capture based on Microsoft Azure AI, reducing administrative effort, making information available faster, and supporting project teams in decision-making.
• Tech stack: Python, React, TypeScript, FastAPI, Claude Code, Codex, Graphify, PostgreSQL, Microsoft Azure AI Foundry, Azure OpenAI, Azure AI Speech, Azure AI Document Intelligence, Microsoft Graph, Microsoft Entra ID, Docker, Git, CI/CD.

I am an experienced data engineer specializing in end‑to‑end data integration, cloud DWH architectures, and high‑quality, governed data products.

I delivered following projects and engagements as a freelancer.

• Data Migration of CRM System for AL-FA Objekt Service Gmbh
• Microsoft Software Resales Partnership

I am looking for freelance roles like: Freelance Data Engineer Cloud Data Warehouse Architect Data Modeling & Architecture Consultant MDM & Data Governance Specialist BI & Analytics Developer

Technical Focus Areas

• Data Engineering & Integration: SQL Server/SSIS, Informatica PowerCenter/IDQ, Talend, Kafka, Azure Data Factory – Delta/CDC/ELT patterns, robust pipelines, monitoring/recovery, data lineage & impact analysis, medallion architecture Bronze/Silver/Gold layers
• DWH & Cloud: Azure SQL / Data Lake / Synapse, AWS Redshift/S3, on‑prem SQL/Oracle – scalable data marts with a strong cost/benefit focus.
• Data Modeling: Atomic (Inmon) and Dimensional (Kimball), Data Vault (Linstedt), Domain‑Driven Design, clear lineage & contracts.
• MDM & Governance: Informatica MDM, IBM MDM, stewardship processes, data quality rules, survivorship/XREF, catalog/glossary, SIF/BES/REST publication.
• Analytics/BI: Power BI, SSAS, Cognos – business‑ready, maintainable data products.

• Led enterprise reporting modernization by migrating legacy SSRS reporting solutions to Power BI, supporting 500+ business users while ensuring full GDPR/DSGVO compliance.
• Designed and optimized Power BI and Microsoft Fabric semantic models using star schema, dimensional modeling, advanced DAX, and performance optimization techniques, reducing query latency by 25%.
• Delivered 20+ executive and operational dashboards featuring KPI scorecards, drill-through, bookmarks, and row-level security, improving reporting efficiency by 20%.
• Enabled self-service analytics through governed Power BI datasets, dataflows, and gateway architecture, increasing business-led reporting adoption by 35%.
• Configured an incremental refresh policy and query folding for a 50+ million row sales dataset, reducing daily report refresh times by 85%.
• Deployed automated ETL/ELT pipelines using Azure Data Factory, Microsoft Fabric, and Snowflake, reducing reporting delivery timelines by 40% through workflow automation.
• Spearheaded Microsoft Fabric analytics modernization initiatives including lakehouse architecture, OneLake integration, and centralized data platform development, reducing data latency from 2 hours to 20 minutes.
• Translated business requirements from 15+ stakeholders into scalable Power BI semantic models and dashboards, improving reporting consistency and reducing ad-hoc reporting requests by 25%.
• Applied Microsoft Copilot and generative AI tools to accelerate SQL development, DAX authoring, technical documentation, and testing activities, reducing development effort by approximately 15 hours per week.

• Architected and deployed private cloud data platform on VMware vSphere, integrating Greenplum MPP, Apache Kafka, Kubernetes, and Apache Solr, and developed real-time ingestion pipelines with Kafka Connect and Schema Registry.
• Led Oracle Exadata to Greenplum migration, rearchitected data models, optimized storage, implemented RabbitMQ with Debezium for CDC, and deployed VectorDB for Generative AI.
• Designed and executed multi-cloud migration PoC across AWS, Azure, and GCP, defined KPIs for throughput, latency, and cost efficiency, executed bulk data transfers, validated analytics and streaming workloads, and delivered full-scale architecture recommendations.
• Assessed legacy on-premises infrastructure and designed modern cloud-native data platforms using Greenplum and containerized microservices, advising on scalability, disaster recovery, and high-availability.

Architected and maintained data products for renewable energy operations, covering wind turbine, grid-meter, and weather data. Built scalable ETL/ELT pipelines in Azure Databricks using Delta Lake (bronze/silver/gold layers) and processed data in various formats, including structured and semi-structured data. Contributed to a data quality framework supporting table and column documentation, outlier detection, and completeness metrics across all datasets within a data product. In addition, implemented a DORA KPI Databricks dashboard used across all data products. Optimized CI/CD processes in Azure DevOps to streamline deployment across development, test, and production environments.

Technology stack: Azure Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Azure Data Lake, APIs, Dremio, Azure DevOps, YAML, Git, Databricks Workflows, Application Insights, Terraform, OpenAI API, Codex, LLM-assisted workflows

I designed and developed an AI-powered multi-tenant platform on Azure that transforms SAP process recordings into technical documentation, presentations and automated tests, processing over 15,000 process recordings for enterprise customers like Würth. I owned the architecture, the production releases and the DevOps setup. I also designed a multi-tenant system with SSO and role-based access on Azure. Implemented an MCP Server with Dynamic OAuth Authentication.

Main Tasks:

• Sprint planning and feature preparation
• Design the multi-tenant platform architecture (FastAPI, SQLAlchemy, PostgreSQL row-level security for tenant isolation)
• Develop AI pipelines with Prefect for transcription (Azure Speech API), document generation and SAP screen-recording analysis (Claude, gpt-4-mini)
• Design and implement an MCP server to expose tenant knowledge to LLM clients (Claude), with async retrieval and reranking
• Implement LLM cost tracking, rate limiting and client pooling for Anthropic/OpenAI/Azure OpenAI endpoints
• Set up CI/CD: Docker images to Azure Container Registry, GitHub Actions, Azure Static Web Apps, Alembic migrations in containers
• Manage production releases and execute live data migrations for enterprise customers
• Define engineering standards and architecture patterns for the team

Environment: Azure / Azure Foundry / Python / FastAPI / Prefect / React / PostgreSQL

• Developed & maintained customer analytical reporting solutions to identify revenue trends, performance drivers, risks & optimization opportunities to ensure data driven decision making across Sales, Finance, Product, Data Engineering & Controlling.
• Defined & analyzed customer trends & performance metrics to identify root causes behind variances, anomalies & emerging risks across business domains to deliver actionable recommendations.
• Developed & owned analytical data models & reporting layers to ensure scalability, performance & analytical robustness to support executive & operational reporting across business domains.
• Planned, tracked & executed projects by ensuring adherence to timelines, data accuracy, consistency, deliverables, reliability & data quality standards through rigorous validation & reconciliation processes.
• Raised the analytical maturity by formalizing analytical workflows, documenting data processes & standard operating procedures (SOPs) & conducting training sessions to drive adoption of self-service analytics & embed a data driven culture across operational and business teams.
• Took ownership of the end-to-end lifecycle roadmap from requirement gathering, collection, transformation, developing robust business logics to data storytelling & stakeholder delivery.
• Converted complexity into structured clarity by translating requirements & business processes into analytical recommendations to ensure alignment between non-technical & technical stakeholders.
• Conducted advanced SQL based analysis of complex business datasets to uncover trends, correlations & performance improvement opportunities.
• Drove process automation & efficiency improvements by leveraging Python, SQL optimization & AI assisted tools to reduce processing time & increase reliability across analytical & operational workflows.
• Standardized KPI definitions & reporting logic to ensure consistency & trust across reporting solutions.
• Developed process monitoring dashboards & analyses to identify inefficiencies, bottlenecks & compliance deviations across end-to-end business processes to derive actionable recommendations for process improvement & automation.

Tasks: Design and operation of end-to-end cloud data platforms for enterprise clients in publishing and finance, including infrastructure automation, pipeline development, monitoring, and data quality.

Activities:

• Built multi-layer data architectures on Databricks (Apache Spark, Delta Lake), BigQuery, and GCP
• Fully automated cloud infrastructure with Terraform across 3 environments (DEV/STG/PRD)
• Developed automated data pipelines with Python, dbt, and GCP services for different data sources
• Built monitoring and alerting systems for real-time platform monitoring
• Implemented data versioning and quality checks at every layer
• Designed automated test and deployment pipelines in GitLab and Bitbucket

Achievements:

• 2× production data processing capacity, reduced spike response time from minutes to ≤15 s, server errors ≈ 0
• Replaced 3,000 lines of manual configuration with a reusable automation module for 7 customer domains, configuration errors to 0
• Delivered a complete end-to-end data platform at ~€10/month infrastructure cost
• Migrated 7 database tables with 0 downstream issues
• Removed 100% exposed credentials, eliminated external vendor dependency
• Delivered integration of 3 teams in 1 sprint

• Led design, development, and deployment of data solutions supporting a major pharma acquisition for Takeda Pharmaceutical Company, delivering transparency reporting systems across Azure,Databricks (Python and Shell Scripting) platforms.
• Owned,Designed and developed scalable ELT pipelines to process Customer and Product data using Azure, complex SQL, Databricks, and shell scripting, enabling efficient data integration and processing across multiple sources including job orchestration and workflow automation.
• Implemented performance optimization techniques (query tuning, parallelism, workload optimization), improving system efficiency and processing time.
• Applied strong analytical and problem-solving skills to assess technical solutions and support business requirements for compliance and transparency reporting.
• Designed scalable data foundations suitable for downstream analytics and AI workloads.
• Led data quality initiatives by assessing multiple source data, defining quality metrics, and establishing processes for monitoring and continuous improvement.

• Data Engineering

• Business Analyst

• Consulting

• 2025 – present

Data Engineer & Architect

• Azure Data Factory
• Azure Databricks (PySpark)
• PowerBI Service

Lead developer for the further development of the Modern Data Warehouse, as well as Power BI reports and data models based on the ERP systems Amparex and EyeOffice. Focus on topics for the marketing department with data connection via API to Amplitude and Klaviyo with Python

• 2024 – present

Data Engineer & Architect

• SQL Server (T-SQL)
• SSIS (ETL)
• SSAS Tabular
• PowerBI Report Server
• Atlassian Jira & migration to Azure DevOps with GIT (KANBAN)

Development of Power BI reports and data models based on Infor LN ERP data after migration from Baan, including the underlying data structures with Microsoft SQL Server for further development of the Data Warehouse

Consulting for controlling on the specification of business requirements and development of reporting solutions

• 2025 – 06.2025

Data Engineer & Architect

• PowerBI Dataflows
• PowerBI Service

Cloud migration of the Data Warehouse, as well as Power BI reports and data models from Microsoft Dynamics BC 2021 to Microsoft Dynamics BC Cloud, including migration of the underlying data structures from Microsoft SQL Server to Power BI Dataflows

• 2022 – 06.2024 (ongoing support for data engineers)

Data Engineer & Architect

• SQL Server (T-SQL)
• SSIS (ETL) & BIML
• SSAS Tabular
• Azure DevOps with GIT (SCRUM)

Development of analytical models based on Microsoft Dynamics BC 2021 in combination with data from the company's own MariaDB database, including the setup of the underlying data structures with Microsoft SQL Server to build a Data Warehouse. Merging of the ERP systems BC 2021 and DATEV in the Data Warehouse

Consulting for business users on the specification of business requirements and coaching of developers for the development of reporting solutions

• 2022 – 08.2023

Business Analyst & Interim Manager

• PowerBI Service
• Azure Databricks (PySpark)
• Atlassian Jira (SCRUM)

Project management for reporting solution requirements, as well as development of Power BI reports and data models with data from Azure Databricks based on SAP R/3, Google Analytics, webshop and CRM with a business focus on customer, sales and marketing

• 2022 – 05.2022

Power BI Specialist

• PowerBI Service
• Azure DevOps with GIT (SCRUM)

Development of Power BI reports and data models based on data from Exasol with a business focus on assortment management in purchasing

• 2021 – present (ongoing support for existing customers)

Power BI Specialist & Data Engineer

• SQL Server (T-SQL)
• SSIS (ETL) & BIML
• PowerBI Service
• Azure DevOps with GIT (KANBAN)
• Azure Functions (Python)

Development of Power BI reports and data models based on abas ERP data, including the setup of the underlying data structures with Microsoft SQL Server to build a Data Warehouse.

Synchronization of customer data for Pipedrive CRM via Azure Functions with Python.

Consulting for controlling and management on agile project management, the specification of business requirements and development of reporting solutions

• 2021 – present (ongoing support for existing customers)

Data Engineer & Architect

• SQL Server (T-SQL)
• SSIS (ETL) & BIML
• SSAS Tabular
• Azure DevOps with GIT (SCRUM)

Development of analytical models based on Microsoft Dynamics 365 FO, CS & CRM in combination with Microsoft Dynamics AX 2012 R3, including the setup of the underlying data structures with Microsoft SQL Server to build a Data Warehouse

Concept for the migration of the SQL Server-based Data Warehouse to Microsoft Fabric with planned future implementation and temporary use of a hybrid data architecture for the introduction of Power BI Service during the migration phase

Consulting for business users on the specification of business requirements and development of reporting solutions

As a freelance IT lecturer and IT coach, I specialize in teaching individuals concepts like Cloud Computing, Business Intelligence, Python Programming and Agile Frameworks. My goal is to simplify complex technical concepts into practical, actionable knowledge. Through my extensive experience as an IT consultant in various sectors and roles I know about the importance of IT training - for companies and employees alike.

• Design, development, and maintenance of end-to-end ETL pipelines for scalable and reliable data integration
• Support in data quality checks, testing, and migrations
• Development and maintenance of dbt models for structured, modular, and reusable data transformations
• Use of AI-driven development to improve ETL job creation and code quality.
• Development of CI/CD for automated deployment.

• Designed and implemented end-to-end data pipelines (batch & streaming) using Python, SQL, and Apache Spark, Databricks on AWS reducing ETL latency by 40%.
• Developed serverless event-driven ingestion pipelines using AWS Lambda and SQS, ensuring real-time data availability for downstream analytics.
• Leveraged Google Cloud Platform (GCP) services including BigQuery and Dataflow to manage cross-cloud data warehousing and analytics integration.
• Expertise in DMS (CDC, Full Load) and Airflow for scalable data pipeline automation and orchestration.
• Managed and customized data pipelines using Databricks, Airflow. Automation using Docker, Kubernetes, Terraform.
• Automated data quality checks using dbt to modularize transformations and ensure production-grade data lineage, improving reliability by 30%.
• Collaborated with compliance teams to ensure GDPR and SOC2 alignment. Mentored junior engineers and contributed to architecture refactoring for scalability.
• Created and maintained dashboards in Power BI to provide actionable insights.