Apache Airflow Experts

I am an experienced data engineer specializing in end‑to‑end data integration, cloud DWH architectures, and high‑quality, governed data products.

I delivered following projects and engagements as a freelancer.

• Data Migration of CRM System for AL-FA Objekt Service Gmbh
• Microsoft Software Resales Partnership

I am looking for freelance roles like: Freelance Data Engineer Cloud Data Warehouse Architect Data Modeling & Architecture Consultant MDM & Data Governance Specialist BI & Analytics Developer

Technical Focus Areas

• Data Engineering & Integration: SQL Server/SSIS, Informatica PowerCenter/IDQ, Talend, Kafka, Azure Data Factory – Delta/CDC/ELT patterns, robust pipelines, monitoring/recovery, data lineage & impact analysis, medallion architecture Bronze/Silver/Gold layers
• DWH & Cloud: Azure SQL / Data Lake / Synapse, AWS Redshift/S3, on‑prem SQL/Oracle – scalable data marts with a strong cost/benefit focus.
• Data Modeling: Atomic (Inmon) and Dimensional (Kimball), Data Vault (Linstedt), Domain‑Driven Design, clear lineage & contracts.
• MDM & Governance: Informatica MDM, IBM MDM, stewardship processes, data quality rules, survivorship/XREF, catalog/glossary, SIF/BES/REST publication.
• Analytics/BI: Power BI, SSAS, Cognos – business‑ready, maintainable data products.

• Taught ML, BI, and Big Data to Master's students.

Tech: Python, Power BI, SQL, ML, SnowflakeDB, databricks, MS Fabric, MongoDB, LLM

Built an international e-commerce platform for a multi-vendor marketplace for digital assets from scratch. Designed and operated cloud native architectures at enterprise scale.

• Designed and operated a highly scalable microservice and serverless architecture
• Built the complete cloud infrastructure with Terraform + AWS CDK in AWS
• Provisioned ECS/EKS clusters (Fargate), Application Load Balancers (reverse proxy), and Lambda functions
• Observability & tracing with CloudWatch, DataDog, Prometheus, and Grafana
• End-to-end setup with DataDog (formerly AWS CloudWatch), Prometheus, and custom Grafana dashboards
• Integration of advanced metrics (including ORM mapper) and distributed tracing with Jaeger
• Robust backup and disaster recovery strategies
• RDS Postgres backups and hourly snapshots
• Read-only, asynchronously synchronized replicas with automated master failover in emergencies
• Minute-level rollback capability through versioned Docker images on ECS and Git-based CI/CD pipelines
• Created CI/CD pipelines with GitHub Actions for automated multi-stage deployments (Dev, Testing, Prod)
• Integrated Stripe for international payment processing
• Built a marketplace payment system with multiple parties and payout routines
• Used Algolia for high-performance real-time search of digital assets on the platform
• Federation of services with GraphQL and Hasura
• Later migration to GraphQL Mesh
• Test Driven Development (TDD) - unit, integration, and E2E testing with Jest, Vitest, and Playwright
• Used Next.js / React for modern frontend applications in the nx monorepo
• Enterprise security architecture & access control
• Integration of JWT tokens with Auth0, OAuth, OIDC, IP guards, BOLA protection, and secret vaults
• Authorization concepts with RBAC, ABAC, and native Postgres Row-Level Security (RLS)
• Built internal microfrontends with Retool for fast prototyping and operational business processes

Technologies: ABAC, AWS CDK, AWS CloudWatch, AWS ECS, AWS EKS, AWS Fargate, AWS RDS, AWS S3, Algolia, Auth0, DataDog, Docker, GitHub Actions, Grafana, GraphQL, GraphQL Mesh, Hasura, JWT, Jaeger, Java, JavaScript, Jest, Kotlin, Kubernetes, Monorepo, Next.js, OIDC, Playwright, Postgres, Postgres RLS, Prometheus, RBAC, Redis, Retool, Serverless, Stripe, Terraform, TypeScript, Vitest

• Architected and deployed private cloud data platform on VMware vSphere, integrating Greenplum MPP, Apache Kafka, Kubernetes, and Apache Solr, and developed real-time ingestion pipelines with Kafka Connect and Schema Registry.
• Led Oracle Exadata to Greenplum migration, rearchitected data models, optimized storage, implemented RabbitMQ with Debezium for CDC, and deployed VectorDB for Generative AI.
• Designed and executed multi-cloud migration PoC across AWS, Azure, and GCP, defined KPIs for throughput, latency, and cost efficiency, executed bulk data transfers, validated analytics and streaming workloads, and delivered full-scale architecture recommendations.
• Assessed legacy on-premises infrastructure and designed modern cloud-native data platforms using Greenplum and containerized microservices, advising on scalability, disaster recovery, and high-availability.

• Fully on-premises LLM document-examination platform for a compliance-critical banking domain: agentic LangGraph pipeline with deterministic verification, every AI judgment structured and source-anchored; ~960 automated tests, zero data egress
• GPU throughput engineering (quantized serving, speculative decoding, prefix caching): 9.5x extraction speed-up, 500+ multi-document case files per day on a single A100
• AI-native EDI/EDIFACT integration platform (~116k LOC Java 25 / Spring Boot 4, 1,900+ tests): LLM-drafted partner mappings machine-verified before go-live (DFDL conformance, field-coverage checks, dry runs), ~99.5% byte match on real customer files — replacing weeks of manual mapping per partner

Led FP&A tech transformation for a 9-figure business – from resolving legacy technical debt to leading AI-native EPM implementation

• Driving end-to-end FP&A transformation, from architecture redesign through EPM tool selection to rollout
• Ran evaluation of 12+ EPM platforms, from vendor negotiation to selection framework tied to long-term planning
• Diagnosed constraints in financial planning architecture, presented findings to the CFO, and secured executive mandate to redesign FP&A infrastructure from the ground up

• This project involved extraction of intelligence data to support report writing for a company that provides geopolitical, global, commercial intelligence. The data have been gathered from a number of resources (interview transcripts, online data, internal documents), and then a knowledge base has been build from it. This was the basis of a complex RAG system, that was evaluated against a golden dataset. Agents have been used to find out the contradicting intelligence, the statements supporting each other, and to store back the generated knowledge.

Used: Python, RAG, LangGraph, LangChain, deepeval, MCP

• Client — Podimo ApS (podcast & audiobook streaming): build the finance reporting layer on BigQuery + dbt + Airflow, including the core revenue-transaction fact tables used across finance reporting.
• API automation: design and build a BigQuery → Airflow → Microsoft Dynamics 365 Business Central REST-API pipeline to automate sales-invoice posting, with idempotency and master-data sync between systems.
• Delivery: sole engineer on the engagement — requirements, modelling, orchestration and stakeholder communication with the client finance team, end to end.

CRM and revenue platform managing billing and subscription workflows.

• Scaled payments infrastructure across data products, direct debit expansion and automated abuse prevention, generating $416K in annualized operational savings ($8K/week) by eliminating redundant gateway calls.
• Owned backlog and sprint execution for autonomous checkout abuse detection pipelines, designing real-time risk guardrails and velocity heuristics that blocked card testing attacks.
• Architected enterprise billing migrator user stories and data reconciliation mechanisms, achieving zero-downtime subscription state transitions and cutting $60K in infrastructure overhead.
• Expanded European direct debit (SEPA) payment capabilities, managing cross-squad API dependencies and automated webhook error-handling to eliminate checkout friction.

• Delivered a new notifications platform implementation built from scratch to replace existing and upcoming services
• Collaborating with other teams to integrate more domains

Tech stack:

• Data: Scala 3, Apache Kafka, Python, Airflow, Astronomer
• BE-FE: TypeScript, NestJS, Java, Spring Boot, Vue
• Dev-ops: AWS, PostgreSQL, Docker, GitHub Actions, Kubernetes, Helm, ArgoCD

• Led end-to-end delivery of ML/AI applications for the QuantistryLab simulation platform, from requirements definition and solution design to development, testing, deployment, and production support, coordinating efforts across back-end, DevOps, and ML teams
• Designed and implemented a compound search system with an open-weights LLM, the Pydantic AI agent framework, and the Model Context Protocol (MCP), exposing it through FastAPI endpoints
• Deployed and configured vLLM-based LLM serving on Kubernetes
• Built CI/CD pipelines and Helm charts to automate deployments across staging and production environments
• Instrumented the search system with OpenTelemetry spans and traces, integrating with the Honeycomb observability platform to monitor component-level latency and functional errors
• Developed a custom evaluation dataset and implemented evaluations for retrieval relevance, answer correctness, tool-call accuracy, and end-to-end task success
• Reduced infrared spectrum prediction time by 83% (from 60 to 10 minutes) by replacing a quantum-mechanical model with a pretrained graph neural network; fine-tuned the model using PyTorch, built and containerized the inference pipeline with Docker, and integrated it into the platform
• Implemented an MLflow model registry with MinIO-backed artifact storage
• Advised sales and science teams on ML/AI applications for prospective client projects, providing technical expertise to shape proposed solutions and prototypes

Technologies: AWS, Hetzner, Kubernetes, Helm, Docker, vLLM, Pydantic AI, MCP, Qwen, Llama 3, MLflow, MinIO, GitHub Actions, Python, FastAPI, OpenTelemetry, Honeycomb, PyTorch, Polars, pytest

• Lakehouse build: Designed and built the member & eligibility domain of an Azure Databricks healthcare lakehouse, ingesting SQL Server, file and REST/SFTP sources (JSON, CSV, XML, Parquet) via Azure Data Factory into ADLS Gen2.
• Medallion pipelines: Transformed data through bronze, silver and gold Delta Lake layers with PySpark and Spark SQL; used Delta Live Tables / Lakeflow with built-in expectations for declarative, quality-checked pipelines.
• Platform modernisation: Delivered a SQL Server-to-cloud platform: ADF → ADLS Gen2 → Databricks → dbt Core models → Snowflake → Power BI, replacing legacy reporting with governed analytics.
• Robust ETL: Built metadata-driven, idempotent full, incremental and watermark-driven loads with schema evolution and failure-state handling, improving reliability and re-runnability.
• Data modelling: Designed Kimball star schemas with SCD Type 1 & 2 dimensions; tuned slow queries and pipelines using execution plans.
• Governance & security: Applied Unity Catalog RBAC, lineage and audit logging, with Azure Key Vault secrets and managed identities, to meet HIPAA and GDPR requirements.
• Leadership & mentoring: Led a 6-person team (2 data engineers, 2 analysts, BI developer, QA); mentored engineers, set delivery standards and coordinated with international stakeholders.
• Delivery & AI-assisted work: Ran CI/CD and work tracking in Azure DevOps; built Power BI semantic models with DAX and RLS; used Genie Code, Claude and Copilot to accelerate PySpark/SQL development, DAX and documentation.

Scope: Embedded as FP&A Data & AI Architect within the Finance function of a major European refrigeration manufacturer, leading the transformation of manual, fragmented financial reporting into an automated, governance-driven intelligence platform. Driving the shift from Excel-based controlling to structured data architecture, Power BI analytics, and AI-assisted financial operations.

Financial Data Integrity & ERP Governance

• Initiated and led GL vs. subledger reconciliation investigations, identifying and resolving structural mismatches between General Ledger and subledger data that had gone undetected prior to engagement
• Conducted asset analysis to identify items missing from General Ledger postings, surfacing gaps in fixed asset tracking and period-end completeness
• Validated SAP reports, establishing baseline data quality standards for Finance team consumption
• Established systematic SAP data validation framework ensuring ongoing integrity between ERP postings and downstream reporting outputs

Finance Reporting Transformation

• Designed and implemented a structured Transformation Project approach for converting manual Finance reports into fully automated processes
• Created and owns the Data Reporting Audit Log; a centralized tracking system capturing report owners, stakeholders, data sources, manual effort estimates, and automation opportunity scores across the Finance function
• Mapped the full reporting landscape identifying quick-win automation targets and strategic Power BI migration candidates
• Actively reducing manual Excel and PowerPoint dependency across FP&A workflows; replacing point-in-time snapshots with live, governed data models

Power BI & Analytics Enablement

• Introduced and presented Power BI as the strategic reporting platform to Finance leadership, building internal buy-in for the BI transformation roadmap
• Designed initial Power BI architecture aligned with SAP, Salesforce and Oracle data structures and FP&A reporting requirements
• Established report ownership, governance documentation, and data lineage standards enabling sustainable self-service analytics across the Finance team

Transformation Infrastructure & Collaboration

• Configured and deployed Jira as the transformation project management hub, establishing structured sprint workflows, backlog management, and progress visibility for Finance IT initiatives
• Proposed and initiated a dedicated FP&A Communication & Transformation Hub, a structured cross-functional forum aligning Finance, IT, and business stakeholders around the reporting transformation roadmap
• Positioned the Finance function as an active driver of data governance and digital transformation within the broader organization

Outcomes

• GL/subledger reconciliation gaps identified and investigation framework established within first two weeks of engagement
• Data Reporting Audit Log deployed; first structured inventory of Finance reporting landscape in company history
• Power BI transformation roadmap presented and approved by Finance leadership
• Jira-based project governance live; Finance transformation now tracked with full sprint visibility

Technologies: SAP FI/CO · Power BI · DAX · SQL · Excel (advanced) · Power Query (M) · Power Automate · VBA · Jira · Microsoft 365 · SharePoint · Salesforce (Sales Data) · Oracle HCM · Python

• Building, implementing and selling automated Data Science solutions such as Scorecard Factory and Forecast Factory
• Implementation of automated end-to-end cloud processes
• Development of LLM and NLP models
• Creation of interactive reports
• Support for national and international large corporations as well as medium-sized companies in implementing ML projects