Azure Data Factory Experts

I am an experienced data engineer specializing in end‑to‑end data integration, cloud DWH architectures, and high‑quality, governed data products.

I delivered following projects and engagements as a freelancer.

• Data Migration of CRM System for AL-FA Objekt Service Gmbh
• Microsoft Software Resales Partnership

I am looking for freelance roles like: Freelance Data Engineer Cloud Data Warehouse Architect Data Modeling & Architecture Consultant MDM & Data Governance Specialist BI & Analytics Developer

Technical Focus Areas

• Data Engineering & Integration: SQL Server/SSIS, Informatica PowerCenter/IDQ, Talend, Kafka, Azure Data Factory – Delta/CDC/ELT patterns, robust pipelines, monitoring/recovery, data lineage & impact analysis, medallion architecture Bronze/Silver/Gold layers
• DWH & Cloud: Azure SQL / Data Lake / Synapse, AWS Redshift/S3, on‑prem SQL/Oracle – scalable data marts with a strong cost/benefit focus.
• Data Modeling: Atomic (Inmon) and Dimensional (Kimball), Data Vault (Linstedt), Domain‑Driven Design, clear lineage & contracts.
• MDM & Governance: Informatica MDM, IBM MDM, stewardship processes, data quality rules, survivorship/XREF, catalog/glossary, SIF/BES/REST publication.
• Analytics/BI: Power BI, SSAS, Cognos – business‑ready, maintainable data products.

• Taught ML, BI, and Big Data to Master's students.

Tech: Python, Power BI, SQL, ML, SnowflakeDB, databricks, MS Fabric, MongoDB, LLM

• Architected and deployed private cloud data platform on VMware vSphere, integrating Greenplum MPP, Apache Kafka, Kubernetes, and Apache Solr, and developed real-time ingestion pipelines with Kafka Connect and Schema Registry.
• Led Oracle Exadata to Greenplum migration, rearchitected data models, optimized storage, implemented RabbitMQ with Debezium for CDC, and deployed VectorDB for Generative AI.
• Designed and executed multi-cloud migration PoC across AWS, Azure, and GCP, defined KPIs for throughput, latency, and cost efficiency, executed bulk data transfers, validated analytics and streaming workloads, and delivered full-scale architecture recommendations.
• Assessed legacy on-premises infrastructure and designed modern cloud-native data platforms using Greenplum and containerized microservices, advising on scalability, disaster recovery, and high-availability.

• Worked as freelance Senior DevOps Consultant on-site for IBM at a European Union Agency, operating in a highly secure, air-gapped environment managing classified systems.
• Led automation and DevOps initiatives for a large-scale OpenShift platform (>400 nodes), driving deployment efficiency, GitOps adoption, and operational automation using Ansible, Python, and Bash while ensuring compliance with security requirements.
• Spearheaded automation of release and deployment workflows in a private cloud environment hosting 400+ OpenShift nodes, significantly improving deployment speed and reliability.
• Migrated existing playbooks, roles, and templates from Ansible Tower to Ansible Automation Platform (AAP), ensuring full compliance with fully-qualified collection names (FQCN) and preparing custom Execution Environments (EE) for containerized automation.
• Implemented GitOps Agent for AAP Controller Configuration as Code, enabling automated synchronization (CRUD) of Ansible Controller objects based on repository-stored configuration definitions using GitHub webhooks.
• Designed and automated complex multi-step operational workflows including environment cleanup, Helix cluster component re-creation, Kafka topic management, and OpenShift object lifecycle management across ~100 environments.
• Achieved a reduction of multi-day manual operations to under a few hours through automation improvements spanning multiple AAP clusters and OpenShift environments.
• Integrated Ansible Automation Platform with Thycotic (Delinea) Secret Server via lookup plugin to enhance secure credential management in automated processes.
• Managed deployment tasks, platform troubleshooting, and Istio network configurations while adhering to stringent EU PSC security and compliance standards.
• Collaborated with infrastructure and application teams to refine deployment procedures, develop naming conventions, and continuously improve automation coverage in an air-gapped, classified environment.

• Development of an AI-powered project organization tool for a civil engineering company that intelligently links project, task, tender, schedule, and document data through a knowledge graph.
• Implementation of AI features for document analysis, information extraction, context-based assistance, and voice-based data capture based on Microsoft Azure AI, reducing administrative effort, making information available faster, and supporting project teams in decision-making.
• Tech stack: Python, React, TypeScript, FastAPI, Claude Code, Codex, Graphify, PostgreSQL, Microsoft Azure AI Foundry, Azure OpenAI, Azure AI Speech, Azure AI Document Intelligence, Microsoft Graph, Microsoft Entra ID, Docker, Git, CI/CD.

• Led end-to-end delivery of ML/AI applications for the QuantistryLab simulation platform, from requirements definition and solution design to development, testing, deployment, and production support, coordinating efforts across back-end, DevOps, and ML teams
• Designed and implemented a compound search system with an open-weights LLM, the Pydantic AI agent framework, and the Model Context Protocol (MCP), exposing it through FastAPI endpoints
• Deployed and configured vLLM-based LLM serving on Kubernetes
• Built CI/CD pipelines and Helm charts to automate deployments across staging and production environments
• Instrumented the search system with OpenTelemetry spans and traces, integrating with the Honeycomb observability platform to monitor component-level latency and functional errors
• Developed a custom evaluation dataset and implemented evaluations for retrieval relevance, answer correctness, tool-call accuracy, and end-to-end task success
• Reduced infrared spectrum prediction time by 83% (from 60 to 10 minutes) by replacing a quantum-mechanical model with a pretrained graph neural network; fine-tuned the model using PyTorch, built and containerized the inference pipeline with Docker, and integrated it into the platform
• Implemented an MLflow model registry with MinIO-backed artifact storage
• Advised sales and science teams on ML/AI applications for prospective client projects, providing technical expertise to shape proposed solutions and prototypes

Technologies: AWS, Hetzner, Kubernetes, Helm, Docker, vLLM, Pydantic AI, MCP, Qwen, Llama 3, MLflow, MinIO, GitHub Actions, Python, FastAPI, OpenTelemetry, Honeycomb, PyTorch, Polars, pytest

Enterprise Analytics Modernization – Germany-based enterprise reporting platform for operations and management analytics, used by 1,000+ internal users across multiple departments.

• Lead end-to-end Power BI and Microsoft Fabric reporting initiatives, delivering scalable dashboards and semantic models supporting daily operational and strategic decisions, achieving 30% faster decision turnaround and 25% reporting efficiency gains.
• Designed unified enterprise datasets using Microsoft Fabric Lakehouse and OneLake, automating historical data processing and reducing manual reporting effort by 40%.
• Built and maintained automated ingestion pipelines using Fabric Dataflows Gen2 and Data Pipelines, improving data refresh reliability to 99.8% uptime and ensuring consistent data quality.
• Implemented enterprise reporting governance, including Row-Level Security (RLS), workspace strategy, deployment pipelines, and documentation, increasing dashboard adoption by 35%.

Technologies used: Power BI, Microsoft Fabric, DAX, Power Query, SQL, Azure Data Fundamentals, Semantic Modeling, RLS, Agile

• Lakehouse build: Designed and built the member & eligibility domain of an Azure Databricks healthcare lakehouse, ingesting SQL Server, file and REST/SFTP sources (JSON, CSV, XML, Parquet) via Azure Data Factory into ADLS Gen2.
• Medallion pipelines: Transformed data through bronze, silver and gold Delta Lake layers with PySpark and Spark SQL; used Delta Live Tables / Lakeflow with built-in expectations for declarative, quality-checked pipelines.
• Platform modernisation: Delivered a SQL Server-to-cloud platform: ADF → ADLS Gen2 → Databricks → dbt Core models → Snowflake → Power BI, replacing legacy reporting with governed analytics.
• Robust ETL: Built metadata-driven, idempotent full, incremental and watermark-driven loads with schema evolution and failure-state handling, improving reliability and re-runnability.
• Data modelling: Designed Kimball star schemas with SCD Type 1 & 2 dimensions; tuned slow queries and pipelines using execution plans.
• Governance & security: Applied Unity Catalog RBAC, lineage and audit logging, with Azure Key Vault secrets and managed identities, to meet HIPAA and GDPR requirements.
• Leadership & mentoring: Led a 6-person team (2 data engineers, 2 analysts, BI developer, QA); mentored engineers, set delivery standards and coordinated with international stakeholders.
• Delivery & AI-assisted work: Ran CI/CD and work tracking in Azure DevOps; built Power BI semantic models with DAX and RLS; used Genie Code, Claude and Copilot to accelerate PySpark/SQL development, DAX and documentation.

• Led enterprise reporting modernization by migrating legacy SSRS reporting solutions to Power BI, supporting 500+ business users while ensuring full GDPR/DSGVO compliance.
• Designed and optimized Power BI and Microsoft Fabric semantic models using star schema, dimensional modeling, advanced DAX, and performance optimization techniques, reducing query latency by 25%.
• Delivered 20+ executive and operational dashboards featuring KPI scorecards, drill-through, bookmarks, and row-level security, improving reporting efficiency by 20%.
• Enabled self-service analytics through governed Power BI datasets, dataflows, and gateway architecture, increasing business-led reporting adoption by 35%.
• Configured an incremental refresh policy and query folding for a 50+ million row sales dataset, reducing daily report refresh times by 85%.
• Deployed automated ETL/ELT pipelines using Azure Data Factory, Microsoft Fabric, and Snowflake, reducing reporting delivery timelines by 40% through workflow automation.
• Spearheaded Microsoft Fabric analytics modernization initiatives including lakehouse architecture, OneLake integration, and centralized data platform development, reducing data latency from 2 hours to 20 minutes.
• Translated business requirements from 15+ stakeholders into scalable Power BI semantic models and dashboards, improving reporting consistency and reducing ad-hoc reporting requests by 25%.
• Applied Microsoft Copilot and generative AI tools to accelerate SQL development, DAX authoring, technical documentation, and testing activities, reducing development effort by approximately 15 hours per week.

• Developed & maintained customer analytical reporting solutions to identify revenue trends, performance drivers, risks & optimization opportunities to ensure data driven decision making across Sales, Finance, Product, Data Engineering & Controlling.
• Defined & analyzed customer trends & performance metrics to identify root causes behind variances, anomalies & emerging risks across business domains to deliver actionable recommendations.
• Developed & owned analytical data models & reporting layers to ensure scalability, performance & analytical robustness to support executive & operational reporting across business domains.
• Planned, tracked & executed projects by ensuring adherence to timelines, data accuracy, consistency, deliverables, reliability & data quality standards through rigorous validation & reconciliation processes.
• Raised the analytical maturity by formalizing analytical workflows, documenting data processes & standard operating procedures (SOPs) & conducting training sessions to drive adoption of self-service analytics & embed a data driven culture across operational and business teams.
• Took ownership of the end-to-end lifecycle roadmap from requirement gathering, collection, transformation, developing robust business logics to data storytelling & stakeholder delivery.
• Converted complexity into structured clarity by translating requirements & business processes into analytical recommendations to ensure alignment between non-technical & technical stakeholders.
• Conducted advanced SQL based analysis of complex business datasets to uncover trends, correlations & performance improvement opportunities.
• Drove process automation & efficiency improvements by leveraging Python, SQL optimization & AI assisted tools to reduce processing time & increase reliability across analytical & operational workflows.
• Standardized KPI definitions & reporting logic to ensure consistency & trust across reporting solutions.
• Developed process monitoring dashboards & analyses to identify inefficiencies, bottlenecks & compliance deviations across end-to-end business processes to derive actionable recommendations for process improvement & automation.

Architected and maintained data products for renewable energy operations, covering wind turbine, grid-meter, and weather data. Built scalable ETL/ELT pipelines in Azure Databricks using Delta Lake (bronze/silver/gold layers) and processed data in various formats, including structured and semi-structured data. Contributed to a data quality framework supporting table and column documentation, outlier detection, and completeness metrics across all datasets within a data product. In addition, implemented a DORA KPI Databricks dashboard used across all data products. Optimized CI/CD processes in Azure DevOps to streamline deployment across development, test, and production environments.

Technology stack: Azure Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Azure Data Lake, APIs, Dremio, Azure DevOps, YAML, Git, Databricks Workflows, Application Insights, Terraform, OpenAI API, Codex, LLM-assisted workflows

• Development of Power BI reports, measures, and KPIs for sales, purchasing, materials management, warehousing, and production
• Analysis of the proALPHA database (Progress OpenEdge) and high-performance SQL queries for extraction and transformation
• Data models, ETL processes, and pipelines including automated refresh via Power BI Service and Data Gateway
• Gathering requirements and implementation in close coordination with the specialist departments

Selected projects:

• Sales report: revenue, incoming orders, and order status
• Purchasing report with automated purchase suggestions (Power Automate)
• Monitoring of missing parts for production and materials management
• Production bills of materials on Microsoft Fabric including deployment pipeline (Dev → Prod)
• Forecast comparison report
• Central Power BI apps that bundle all reports by department

Technologies: Power BI, DAX, Power Query (M), SQL, proALPHA, Progress OpenEdge, Microsoft Fabric, Power Automate, Python

Engaged as an independent BI consultant for a FinTech SaaS platform, building and maintaining the end-to-end Microsoft Azure and Fabric analytics stack behind a multi-tenant accounting product used by business owners to track their own financial performance.

• Partnered with finance stakeholders to translate complex accounting workflows into real-time BI dashboards (P&L, Cash Flow, Balance Sheet), helping 2000+ business owners track cash flow and overall financial health effortlessly.
• Developed 10+ interactive dashboards, giving each business owner personalized, real-time visibility into their own sales performance, accounts receivable aging, and operational costs.
• Enforced strict enterprise data governance by implementing dynamic Row-Level Security (RLS) via DAX to isolate each business owner's data within the shared multi-tenant model.
• Maintained and extended an Azure ELT pipeline (Azure Data Factory, Azure SQL Database, Azure Synapse) that automated data ingestion and transformation.
• Contributed to a team-wide platform migration from Azure to Microsoft Fabric to optimize capacity licensing costs.
• Designed and implemented a Microsoft Fabric ELT pipeline (Lakehouse, Pipelines, PySpark) that automated data ingestion and transformation, replacing the prior Azure pipeline.
• Modeled cleansed data into a Star Schema within the data warehouse using T-SQL, powering the Power BI Semantic Model.
• Leveraged AI tools, including Copilot and Claude, as development partners across the entire ELT pipeline, from data ingestion to KPI reporting and visualization.
• Supported agile delivery processes, using Jira to track development tasks and Confluence to maintain technical and project documentation.

• Led the migration of the existing DWH, including HR data, application processes, project business and time tracking, from an MS SQL Server environment to Azure Databricks
• Refactored existing data models and ETL processes and extended them with new objects and functionalities
• Used Azure Databricks (Unity Catalog, Notebooks, Spark SQL, Databricks Dataflows) and Power BI
• Technologies: MS SQL Server 2019 (SSMS, SSIS), Power BI, Delta Lake, Azure Databricks