Apache Airflow Experts

Remote freelance role focused on Agentic AI strategy, secure application patterns, and reusable agentic workflows for a government agency.

• Development and implementation of an open-source Agentic AI strategy for a government agency, with a focus on GDPR, security, and self-hosted solutions
• Development of reusable agentic workflows and business applications that enable non-technical employees to solve business problems independently
• Implementation of nine business applications with Single Sign-On (SSO) and Azure PostgreSQL integration on Hetzner Linux servers

Techstack: Python, Streamlit, Anthropic SDK (Claude), Azure, Linux, PostgreSQL, MS SQL, Angular

Built an international e-commerce platform for a multi-vendor marketplace for digital assets from scratch. Designed and operated cloud native architectures at enterprise scale.

• Designed and operated a highly scalable microservice and serverless architecture
• Built the complete cloud infrastructure with Terraform + AWS CDK in AWS
• Provisioned ECS/EKS clusters (Fargate), Application Load Balancers (reverse proxy), and Lambda functions
• Observability & tracing with CloudWatch, DataDog, Prometheus, and Grafana
• End-to-end setup with DataDog (formerly AWS CloudWatch), Prometheus, and custom Grafana dashboards
• Integration of advanced metrics (including ORM mapper) and distributed tracing with Jaeger
• Robust backup and disaster recovery strategies
• RDS Postgres backups and hourly snapshots
• Read-only, asynchronously synchronized replicas with automated master failover in emergencies
• Minute-level rollback capability through versioned Docker images on ECS and Git-based CI/CD pipelines
• Created CI/CD pipelines with GitHub Actions for automated multi-stage deployments (Dev, Testing, Prod)
• Integrated Stripe for international payment processing
• Built a marketplace payment system with multiple parties and payout routines
• Used Algolia for high-performance real-time search of digital assets on the platform
• Federation of services with GraphQL and Hasura
• Later migration to GraphQL Mesh
• Test Driven Development (TDD) - unit, integration, and E2E testing with Jest, Vitest, and Playwright
• Used Next.js / React for modern frontend applications in the nx monorepo
• Enterprise security architecture & access control
• Integration of JWT tokens with Auth0, OAuth, OIDC, IP guards, BOLA protection, and secret vaults
• Authorization concepts with RBAC, ABAC, and native Postgres Row-Level Security (RLS)
• Built internal microfrontends with Retool for fast prototyping and operational business processes

Technologies: ABAC, AWS CDK, AWS CloudWatch, AWS ECS, AWS EKS, AWS Fargate, AWS RDS, AWS S3, Algolia, Auth0, DataDog, Docker, GitHub Actions, Grafana, GraphQL, GraphQL Mesh, Hasura, JWT, Jaeger, Java, JavaScript, Jest, Kotlin, Kubernetes, Monorepo, Next.js, OIDC, Playwright, Postgres, Postgres RLS, Prometheus, RBAC, Redis, Retool, Serverless, Stripe, Terraform, TypeScript, Vitest

• Fully on-premises LLM document-examination platform for a compliance-critical banking domain: agentic LangGraph pipeline with deterministic verification, every AI judgment structured and source-anchored; ~960 automated tests, zero data egress
• GPU throughput engineering (quantized serving, speculative decoding, prefix caching): 9.5x extraction speed-up, 500+ multi-document case files per day on a single A100
• AI-native EDI/EDIFACT integration platform (~116k LOC Java 25 / Spring Boot 4, 1,900+ tests): LLM-drafted partner mappings machine-verified before go-live (DFDL conformance, field-coverage checks, dry runs), ~99.5% byte match on real customer files — replacing weeks of manual mapping per partner

• This project involved extraction of intelligence data to support report writing for a company that provides geopolitical, global, commercial intelligence. The data have been gathered from a number of resources (interview transcripts, online data, internal documents), and then a knowledge base has been build from it. This was the basis of a complex RAG system, that was evaluated against a golden dataset. Agents have been used to find out the contradicting intelligence, the statements supporting each other, and to store back the generated knowledge.

Used: Python, RAG, LangGraph, LangChain, deepeval, MCP

• Task Engineering: Evaluating Coding Agents.
• Asset Creation: Building realistic task environments using datasets and files in German. Crucially, these assets must remain in the target language to genuinely measure multilingual handling.
• Prompting & Translation: finding failure points where AI does not work, in German.
• Implementation & Verification: Supporting the development of robust solutions (reference implementations) and write highly reliable, deterministic verifier scripts (using rubric-based judging only when strictly necessary).
• Calibration & Execution: Analyze execution logs and calibrate task difficulty (Easy to Very Hard) using standard Terminal-Bench run configurations against various model tiers (Haiku, Opus).
• Quality Assurance: Participation in a rigorous, 4-layer human quality control process (creation, human review, calibration review, and audit) alongside automated LLM-based checks to ensure fairness, grammatical accuracy, and benchmark integrity.
• Linguistic Review: Reviewing AI benchmark tasks across Hindi, Arabic, Japanese, Chinese, Czech and Turkish.

CRM and revenue platform managing billing and subscription workflows.

• Scaled payments infrastructure across data products, direct debit expansion and automated abuse prevention, generating $416K in annualized operational savings ($8K/week) by eliminating redundant gateway calls.
• Owned backlog and sprint execution for autonomous checkout abuse detection pipelines, designing real-time risk guardrails and velocity heuristics that blocked card testing attacks.
• Architected enterprise billing migrator user stories and data reconciliation mechanisms, achieving zero-downtime subscription state transitions and cutting $60K in infrastructure overhead.
• Expanded European direct debit (SEPA) payment capabilities, managing cross-squad API dependencies and automated webhook error-handling to eliminate checkout friction.

• Delivered a new notifications platform implementation built from scratch to replace existing and upcoming services
• Collaborating with other teams to integrate more domains

Tech stack:

• Data: Scala 3, Apache Kafka, Python, Airflow, Astronomer
• BE-FE: TypeScript, NestJS, Java, Spring Boot, Vue
• Dev-ops: AWS, PostgreSQL, Docker, GitHub Actions, Kubernetes, Helm, ArgoCD

Scope: Embedded as FP&A Data & AI Architect within the Finance function of a major European refrigeration manufacturer, leading the transformation of manual, fragmented financial reporting into an automated, governance-driven intelligence platform. Driving the shift from Excel-based controlling to structured data architecture, Power BI analytics, and AI-assisted financial operations.

Financial Data Integrity & ERP Governance

• Initiated and led GL vs. subledger reconciliation investigations, identifying and resolving structural mismatches between General Ledger and subledger data that had gone undetected prior to engagement
• Conducted asset analysis to identify items missing from General Ledger postings, surfacing gaps in fixed asset tracking and period-end completeness
• Validated SAP reports, establishing baseline data quality standards for Finance team consumption
• Established systematic SAP data validation framework ensuring ongoing integrity between ERP postings and downstream reporting outputs

Finance Reporting Transformation

• Designed and implemented a structured Transformation Project approach for converting manual Finance reports into fully automated processes
• Created and owns the Data Reporting Audit Log; a centralized tracking system capturing report owners, stakeholders, data sources, manual effort estimates, and automation opportunity scores across the Finance function
• Mapped the full reporting landscape identifying quick-win automation targets and strategic Power BI migration candidates
• Actively reducing manual Excel and PowerPoint dependency across FP&A workflows; replacing point-in-time snapshots with live, governed data models

Power BI & Analytics Enablement

• Introduced and presented Power BI as the strategic reporting platform to Finance leadership, building internal buy-in for the BI transformation roadmap
• Designed initial Power BI architecture aligned with SAP, Salesforce and Oracle data structures and FP&A reporting requirements
• Established report ownership, governance documentation, and data lineage standards enabling sustainable self-service analytics across the Finance team

Transformation Infrastructure & Collaboration

• Configured and deployed Jira as the transformation project management hub, establishing structured sprint workflows, backlog management, and progress visibility for Finance IT initiatives
• Proposed and initiated a dedicated FP&A Communication & Transformation Hub, a structured cross-functional forum aligning Finance, IT, and business stakeholders around the reporting transformation roadmap
• Positioned the Finance function as an active driver of data governance and digital transformation within the broader organization

Outcomes

• GL/subledger reconciliation gaps identified and investigation framework established within first two weeks of engagement
• Data Reporting Audit Log deployed; first structured inventory of Finance reporting landscape in company history
• Power BI transformation roadmap presented and approved by Finance leadership
• Jira-based project governance live; Finance transformation now tracked with full sprint visibility

Technologies: SAP FI/CO · Power BI · DAX · SQL · Excel (advanced) · Power Query (M) · Power Automate · VBA · Jira · Microsoft 365 · SharePoint · Salesforce (Sales Data) · Oracle HCM · Python

• Architected and deployed private cloud data platform on VMware vSphere, integrating Greenplum MPP, Apache Kafka, Kubernetes, and Apache Solr, and developed real-time ingestion pipelines with Kafka Connect and Schema Registry.
• Led Oracle Exadata to Greenplum migration, rearchitected data models, optimized storage, implemented RabbitMQ with Debezium for CDC, and deployed VectorDB for Generative AI.
• Designed and executed multi-cloud migration PoC across AWS, Azure, and GCP, defined KPIs for throughput, latency, and cost efficiency, executed bulk data transfers, validated analytics and streaming workloads, and delivered full-scale architecture recommendations.
• Assessed legacy on-premises infrastructure and designed modern cloud-native data platforms using Greenplum and containerized microservices, advising on scalability, disaster recovery, and high-availability.

• Building, implementing and selling automated Data Science solutions such as Scorecard Factory and Forecast Factory
• Implementation of automated end-to-end cloud processes
• Development of LLM and NLP models
• Creation of interactive reports
• Support for national and international large corporations as well as medium-sized companies in implementing ML projects

Architected and maintained data products for renewable energy operations, covering wind turbine, grid-meter, and weather data. Built scalable ETL/ELT pipelines in Azure Databricks using Delta Lake (bronze/silver/gold layers) and processed data in various formats, including structured and semi-structured data. Contributed to a data quality framework supporting table and column documentation, outlier detection, and completeness metrics across all datasets within a data product. In addition, implemented a DORA KPI Databricks dashboard used across all data products. Optimized CI/CD processes in Azure DevOps to streamline deployment across development, test, and production environments.

Technology stack: Azure Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Azure Data Lake, APIs, Dremio, Azure DevOps, YAML, Git, Databricks Workflows, Application Insights, Terraform, OpenAI API, Codex, LLM-assisted workflows

Led FP&A tech transformation for a 9-figure business – from resolving legacy technical debt to leading AI-native EPM implementation

• Driving end-to-end FP&A transformation, from architecture redesign through EPM tool selection to rollout
• Ran evaluation of 12+ EPM platforms, from vendor negotiation to selection framework tied to long-term planning
• Diagnosed constraints in financial planning architecture, presented findings to the CFO, and secured executive mandate to redesign FP&A infrastructure from the ground up

Independent engineering practice focused on custom AI systems, production delivery, and fractional technical leadership.

Selected client engagement: Scalutions

• Role: Serve as fractional CTO and hands-on technical lead, responsible for the architecture and agentic infrastructure behind its managed B2B outbound operation.

• Product: Designed and built OutboundLoop, an agentic SDR operating system for research, qualification, personalized outreach, campaign management, human approvals, measurement, and continuous improvement.

• Scope: Own the full system lifecycle—from business processes and agent behavior to context design, model routing, integrations, evaluation, telemetry, reliability, cost control, and production operations.

• Delivered MVP-focused full-stack architecture for a health-sector client: Vite/React frontend, backend services on Google Cloud Run, and Supabase for database plus IAM/authentication.
• Supported product requirements engineering and prioritized cost-aware workload placement, implementing browser-side/edge computation where feasible before moving logic to backend services.