Azure Data Factory Experts in Germany

I am an experienced data engineer specializing in end‑to‑end data integration, cloud DWH architectures, and high‑quality, governed data products.

I delivered following projects and engagements as a freelancer.

• Data Migration of CRM System for AL-FA Objekt Service Gmbh
• Microsoft Software Resales Partnership

I am looking for freelance roles like: Freelance Data Engineer Cloud Data Warehouse Architect Data Modeling & Architecture Consultant MDM & Data Governance Specialist BI & Analytics Developer

Technical Focus Areas

• Data Engineering & Integration: SQL Server/SSIS, Informatica PowerCenter/IDQ, Talend, Kafka, Azure Data Factory – Delta/CDC/ELT patterns, robust pipelines, monitoring/recovery, data lineage & impact analysis, medallion architecture Bronze/Silver/Gold layers
• DWH & Cloud: Azure SQL / Data Lake / Synapse, AWS Redshift/S3, on‑prem SQL/Oracle – scalable data marts with a strong cost/benefit focus.
• Data Modeling: Atomic (Inmon) and Dimensional (Kimball), Data Vault (Linstedt), Domain‑Driven Design, clear lineage & contracts.
• MDM & Governance: Informatica MDM, IBM MDM, stewardship processes, data quality rules, survivorship/XREF, catalog/glossary, SIF/BES/REST publication.
• Analytics/BI: Power BI, SSAS, Cognos – business‑ready, maintainable data products.

• Taught ML, BI, and Big Data to Master's students.

Tech: Python, Power BI, SQL, ML, SnowflakeDB, databricks, MS Fabric, MongoDB, LLM

• Architected and deployed private cloud data platform on VMware vSphere, integrating Greenplum MPP, Apache Kafka, Kubernetes, and Apache Solr, and developed real-time ingestion pipelines with Kafka Connect and Schema Registry.
• Led Oracle Exadata to Greenplum migration, rearchitected data models, optimized storage, implemented RabbitMQ with Debezium for CDC, and deployed VectorDB for Generative AI.
• Designed and executed multi-cloud migration PoC across AWS, Azure, and GCP, defined KPIs for throughput, latency, and cost efficiency, executed bulk data transfers, validated analytics and streaming workloads, and delivered full-scale architecture recommendations.
• Assessed legacy on-premises infrastructure and designed modern cloud-native data platforms using Greenplum and containerized microservices, advising on scalability, disaster recovery, and high-availability.

• Worked as freelance Senior DevOps Consultant on-site for IBM at a European Union Agency, operating in a highly secure, air-gapped environment managing classified systems.
• Led automation and DevOps initiatives for a large-scale OpenShift platform (>400 nodes), driving deployment efficiency, GitOps adoption, and operational automation using Ansible, Python, and Bash while ensuring compliance with security requirements.
• Spearheaded automation of release and deployment workflows in a private cloud environment hosting 400+ OpenShift nodes, significantly improving deployment speed and reliability.
• Migrated existing playbooks, roles, and templates from Ansible Tower to Ansible Automation Platform (AAP), ensuring full compliance with fully-qualified collection names (FQCN) and preparing custom Execution Environments (EE) for containerized automation.
• Implemented GitOps Agent for AAP Controller Configuration as Code, enabling automated synchronization (CRUD) of Ansible Controller objects based on repository-stored configuration definitions using GitHub webhooks.
• Designed and automated complex multi-step operational workflows including environment cleanup, Helix cluster component re-creation, Kafka topic management, and OpenShift object lifecycle management across ~100 environments.
• Achieved a reduction of multi-day manual operations to under a few hours through automation improvements spanning multiple AAP clusters and OpenShift environments.
• Integrated Ansible Automation Platform with Thycotic (Delinea) Secret Server via lookup plugin to enhance secure credential management in automated processes.
• Managed deployment tasks, platform troubleshooting, and Istio network configurations while adhering to stringent EU PSC security and compliance standards.
• Collaborated with infrastructure and application teams to refine deployment procedures, develop naming conventions, and continuously improve automation coverage in an air-gapped, classified environment.

• Development of an AI-powered project organization tool for a civil engineering company that intelligently links project, task, tender, schedule, and document data through a knowledge graph.
• Implementation of AI features for document analysis, information extraction, context-based assistance, and voice-based data capture based on Microsoft Azure AI, reducing administrative effort, making information available faster, and supporting project teams in decision-making.
• Tech stack: Python, React, TypeScript, FastAPI, Claude Code, Codex, Graphify, PostgreSQL, Microsoft Azure AI Foundry, Azure OpenAI, Azure AI Speech, Azure AI Document Intelligence, Microsoft Graph, Microsoft Entra ID, Docker, Git, CI/CD.

• Led end-to-end delivery of ML/AI applications for the QuantistryLab simulation platform, from requirements definition and solution design to development, testing, deployment, and production support, coordinating efforts across back-end, DevOps, and ML teams
• Designed and implemented a compound search system with an open-weights LLM, the Pydantic AI agent framework, and the Model Context Protocol (MCP), exposing it through FastAPI endpoints
• Deployed and configured vLLM-based LLM serving on Kubernetes
• Built CI/CD pipelines and Helm charts to automate deployments across staging and production environments
• Instrumented the search system with OpenTelemetry spans and traces, integrating with the Honeycomb observability platform to monitor component-level latency and functional errors
• Developed a custom evaluation dataset and implemented evaluations for retrieval relevance, answer correctness, tool-call accuracy, and end-to-end task success
• Reduced infrared spectrum prediction time by 83% (from 60 to 10 minutes) by replacing a quantum-mechanical model with a pretrained graph neural network; fine-tuned the model using PyTorch, built and containerized the inference pipeline with Docker, and integrated it into the platform
• Implemented an MLflow model registry with MinIO-backed artifact storage
• Advised sales and science teams on ML/AI applications for prospective client projects, providing technical expertise to shape proposed solutions and prototypes

Technologies: AWS, Hetzner, Kubernetes, Helm, Docker, vLLM, Pydantic AI, MCP, Qwen, Llama 3, MLflow, MinIO, GitHub Actions, Python, FastAPI, OpenTelemetry, Honeycomb, PyTorch, Polars, pytest

Enterprise Analytics Modernization – Germany-based enterprise reporting platform for operations and management analytics, used by 1,000+ internal users across multiple departments.

• Lead end-to-end Power BI and Microsoft Fabric reporting initiatives, delivering scalable dashboards and semantic models supporting daily operational and strategic decisions, achieving 30% faster decision turnaround and 25% reporting efficiency gains.
• Designed unified enterprise datasets using Microsoft Fabric Lakehouse and OneLake, automating historical data processing and reducing manual reporting effort by 40%.
• Built and maintained automated ingestion pipelines using Fabric Dataflows Gen2 and Data Pipelines, improving data refresh reliability to 99.8% uptime and ensuring consistent data quality.
• Implemented enterprise reporting governance, including Row-Level Security (RLS), workspace strategy, deployment pipelines, and documentation, increasing dashboard adoption by 35%.

Technologies used: Power BI, Microsoft Fabric, DAX, Power Query, SQL, Azure Data Fundamentals, Semantic Modeling, RLS, Agile

• Led enterprise reporting modernization by migrating legacy SSRS reporting solutions to Power BI, supporting 500+ business users while ensuring full GDPR/DSGVO compliance.
• Designed and optimized Power BI and Microsoft Fabric semantic models using star schema, dimensional modeling, advanced DAX, and performance optimization techniques, reducing query latency by 25%.
• Delivered 20+ executive and operational dashboards featuring KPI scorecards, drill-through, bookmarks, and row-level security, improving reporting efficiency by 20%.
• Enabled self-service analytics through governed Power BI datasets, dataflows, and gateway architecture, increasing business-led reporting adoption by 35%.
• Configured an incremental refresh policy and query folding for a 50+ million row sales dataset, reducing daily report refresh times by 85%.
• Deployed automated ETL/ELT pipelines using Azure Data Factory, Microsoft Fabric, and Snowflake, reducing reporting delivery timelines by 40% through workflow automation.
• Spearheaded Microsoft Fabric analytics modernization initiatives including lakehouse architecture, OneLake integration, and centralized data platform development, reducing data latency from 2 hours to 20 minutes.
• Translated business requirements from 15+ stakeholders into scalable Power BI semantic models and dashboards, improving reporting consistency and reducing ad-hoc reporting requests by 25%.
• Applied Microsoft Copilot and generative AI tools to accelerate SQL development, DAX authoring, technical documentation, and testing activities, reducing development effort by approximately 15 hours per week.

• Developed & maintained customer analytical reporting solutions to identify revenue trends, performance drivers, risks & optimization opportunities to ensure data driven decision making across Sales, Finance, Product, Data Engineering & Controlling.
• Defined & analyzed customer trends & performance metrics to identify root causes behind variances, anomalies & emerging risks across business domains to deliver actionable recommendations.
• Developed & owned analytical data models & reporting layers to ensure scalability, performance & analytical robustness to support executive & operational reporting across business domains.
• Planned, tracked & executed projects by ensuring adherence to timelines, data accuracy, consistency, deliverables, reliability & data quality standards through rigorous validation & reconciliation processes.
• Raised the analytical maturity by formalizing analytical workflows, documenting data processes & standard operating procedures (SOPs) & conducting training sessions to drive adoption of self-service analytics & embed a data driven culture across operational and business teams.
• Took ownership of the end-to-end lifecycle roadmap from requirement gathering, collection, transformation, developing robust business logics to data storytelling & stakeholder delivery.
• Converted complexity into structured clarity by translating requirements & business processes into analytical recommendations to ensure alignment between non-technical & technical stakeholders.
• Conducted advanced SQL based analysis of complex business datasets to uncover trends, correlations & performance improvement opportunities.
• Drove process automation & efficiency improvements by leveraging Python, SQL optimization & AI assisted tools to reduce processing time & increase reliability across analytical & operational workflows.
• Standardized KPI definitions & reporting logic to ensure consistency & trust across reporting solutions.
• Developed process monitoring dashboards & analyses to identify inefficiencies, bottlenecks & compliance deviations across end-to-end business processes to derive actionable recommendations for process improvement & automation.

Architected and maintained data products for renewable energy operations, covering wind turbine, grid-meter, and weather data. Built scalable ETL/ELT pipelines in Azure Databricks using Delta Lake (bronze/silver/gold layers) and processed data in various formats, including structured and semi-structured data. Contributed to a data quality framework supporting table and column documentation, outlier detection, and completeness metrics across all datasets within a data product. In addition, implemented a DORA KPI Databricks dashboard used across all data products. Optimized CI/CD processes in Azure DevOps to streamline deployment across development, test, and production environments.

Technology stack: Azure Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Azure Data Lake, APIs, Dremio, Azure DevOps, YAML, Git, Databricks Workflows, Application Insights, Terraform, OpenAI API, Codex, LLM-assisted workflows

• Development of Power BI reports, measures, and KPIs for sales, purchasing, materials management, warehousing, and production
• Analysis of the proALPHA database (Progress OpenEdge) and high-performance SQL queries for extraction and transformation
• Data models, ETL processes, and pipelines including automated refresh via Power BI Service and Data Gateway
• Gathering requirements and implementation in close coordination with the specialist departments

Selected projects:

• Sales report: revenue, incoming orders, and order status
• Purchasing report with automated purchase suggestions (Power Automate)
• Monitoring of missing parts for production and materials management
• Production bills of materials on Microsoft Fabric including deployment pipeline (Dev → Prod)
• Forecast comparison report
• Central Power BI apps that bundle all reports by department

Technologies: Power BI, DAX, Power Query (M), SQL, proALPHA, Progress OpenEdge, Microsoft Fabric, Power Automate, Python

Engaged as an independent BI consultant for a FinTech SaaS platform, building and maintaining the end-to-end Microsoft Azure and Fabric analytics stack behind a multi-tenant accounting product used by business owners to track their own financial performance.

• Partnered with finance stakeholders to translate complex accounting workflows into real-time BI dashboards (P&L, Cash Flow, Balance Sheet), helping 2000+ business owners track cash flow and overall financial health effortlessly.
• Developed 10+ interactive dashboards, giving each business owner personalized, real-time visibility into their own sales performance, accounts receivable aging, and operational costs.
• Enforced strict enterprise data governance by implementing dynamic Row-Level Security (RLS) via DAX to isolate each business owner's data within the shared multi-tenant model.
• Maintained and extended an Azure ELT pipeline (Azure Data Factory, Azure SQL Database, Azure Synapse) that automated data ingestion and transformation.
• Contributed to a team-wide platform migration from Azure to Microsoft Fabric to optimize capacity licensing costs.
• Designed and implemented a Microsoft Fabric ELT pipeline (Lakehouse, Pipelines, PySpark) that automated data ingestion and transformation, replacing the prior Azure pipeline.
• Modeled cleansed data into a Star Schema within the data warehouse using T-SQL, powering the Power BI Semantic Model.
• Leveraged AI tools, including Copilot and Claude, as development partners across the entire ELT pipeline, from data ingestion to KPI reporting and visualization.
• Supported agile delivery processes, using Jira to track development tasks and Confluence to maintain technical and project documentation.

• Led the migration of the existing DWH, including HR data, application processes, project business and time tracking, from an MS SQL Server environment to Azure Databricks
• Refactored existing data models and ETL processes and extended them with new objects and functionalities
• Used Azure Databricks (Unity Catalog, Notebooks, Spark SQL, Databricks Dataflows) and Power BI
• Technologies: MS SQL Server 2019 (SSMS, SSIS), Power BI, Delta Lake, Azure Databricks

• Led design, development, and deployment of data solutions supporting a major pharma acquisition for Takeda Pharmaceutical Company, delivering transparency reporting systems across Azure,Databricks (Python and Shell Scripting) platforms.
• Owned,Designed and developed scalable ELT pipelines to process Customer and Product data using Azure, complex SQL, Databricks, and shell scripting, enabling efficient data integration and processing across multiple sources including job orchestration and workflow automation.
• Implemented performance optimization techniques (query tuning, parallelism, workload optimization), improving system efficiency and processing time.
• Applied strong analytical and problem-solving skills to assess technical solutions and support business requirements for compliance and transparency reporting.
• Designed scalable data foundations suitable for downstream analytics and AI workloads.
• Led data quality initiatives by assessing multiple source data, defining quality metrics, and establishing processes for monitoring and continuous improvement.