Azure Data Factory Experts in Munich

Ales L.

Senior DevOps Consultant (Freelance)

Last position:

Senior DevOps Consultant (Freelance) at European Union Agency (via IBM)

Worked as freelance Senior DevOps Consultant on-site for IBM at a European Union Agency, operating in a highly secure, air-gapped environment managing classified systems.
Led automation and DevOps initiatives for a large-scale OpenShift platform (>400 nodes), driving deployment efficiency, GitOps adoption, and operational automation using Ansible, Python, and Bash while ensuring compliance with security requirements.
Spearheaded automation of release and deployment workflows in a private cloud environment hosting 400+ OpenShift nodes, significantly improving deployment speed and reliability.
Migrated existing playbooks, roles, and templates from Ansible Tower to Ansible Automation Platform (AAP), ensuring full compliance with fully-qualified collection names (FQCN) and preparing custom Execution Environments (EE) for containerized automation.
Implemented GitOps Agent for AAP Controller Configuration as Code, enabling automated synchronization (CRUD) of Ansible Controller objects based on repository-stored configuration definitions using GitHub webhooks.
Designed and automated complex multi-step operational workflows including environment cleanup, Helix cluster component re-creation, Kafka topic management, and OpenShift object lifecycle management across ~100 environments.
Achieved a reduction of multi-day manual operations to under a few hours through automation improvements spanning multiple AAP clusters and OpenShift environments.
Integrated Ansible Automation Platform with Thycotic (Delinea) Secret Server via lookup plugin to enhance secure credential management in automated processes.
Managed deployment tasks, platform troubleshooting, and Istio network configurations while adhering to stringent EU PSC security and compliance standards.
Collaborated with infrastructure and application teams to refine deployment procedures, develop naming conventions, and continuously improve automation coverage in an air-gapped, classified environment.

Michael N.

Senior ML Engineer | AI Engineer | Problem Solver

Eichenau

Last position:

Senior AI Engineer | Forward Deployed Engineer at Tiefbau

Development of an AI-powered project organization tool for a civil engineering company that intelligently links project, task, tender, schedule, and document data through a knowledge graph.
Implementation of AI features for document analysis, information extraction, context-based assistance, and voice-based data capture based on Microsoft Azure AI, reducing administrative effort, making information available faster, and supporting project teams in decision-making.
Tech stack: Python, React, TypeScript, FastAPI, Claude Code, Codex, Graphify, PostgreSQL, Microsoft Azure AI Foundry, Azure OpenAI, Azure AI Speech, Azure AI Document Intelligence, Microsoft Graph, Microsoft Entra ID, Docker, Git, CI/CD.

Ajay Kumar D.

Senior BI and Analytics Engineer

Last position:

Senior BI and Analytics Engineer at Novartis

Led enterprise reporting modernization by migrating legacy SSRS reporting solutions to Power BI, supporting 500+ business users while ensuring full GDPR/DSGVO compliance.
Designed and optimized Power BI and Microsoft Fabric semantic models using star schema, dimensional modeling, advanced DAX, and performance optimization techniques, reducing query latency by 25%.
Delivered 20+ executive and operational dashboards featuring KPI scorecards, drill-through, bookmarks, and row-level security, improving reporting efficiency by 20%.
Enabled self-service analytics through governed Power BI datasets, dataflows, and gateway architecture, increasing business-led reporting adoption by 35%.
Configured an incremental refresh policy and query folding for a 50+ million row sales dataset, reducing daily report refresh times by 85%.
Deployed automated ETL/ELT pipelines using Azure Data Factory, Microsoft Fabric, and Snowflake, reducing reporting delivery timelines by 40% through workflow automation.
Spearheaded Microsoft Fabric analytics modernization initiatives including lakehouse architecture, OneLake integration, and centralized data platform development, reducing data latency from 2 hours to 20 minutes.
Translated business requirements from 15+ stakeholders into scalable Power BI semantic models and dashboards, improving reporting consistency and reducing ad-hoc reporting requests by 25%.
Applied Microsoft Copilot and generative AI tools to accelerate SQL development, DAX authoring, technical documentation, and testing activities, reducing development effort by approximately 15 hours per week.

Suyash S.

Business Data Science Intern

Last position:

Data Analyst - Reporting & Analytics at SIXT SE

Developed & maintained customer analytical reporting solutions to identify revenue trends, performance drivers, risks & optimization opportunities to ensure data driven decision making across Sales, Finance, Product, Data Engineering & Controlling.
Defined & analyzed customer trends & performance metrics to identify root causes behind variances, anomalies & emerging risks across business domains to deliver actionable recommendations.
Developed & owned analytical data models & reporting layers to ensure scalability, performance & analytical robustness to support executive & operational reporting across business domains.
Planned, tracked & executed projects by ensuring adherence to timelines, data accuracy, consistency, deliverables, reliability & data quality standards through rigorous validation & reconciliation processes.
Raised the analytical maturity by formalizing analytical workflows, documenting data processes & standard operating procedures (SOPs) & conducting training sessions to drive adoption of self-service analytics & embed a data driven culture across operational and business teams.
Took ownership of the end-to-end lifecycle roadmap from requirement gathering, collection, transformation, developing robust business logics to data storytelling & stakeholder delivery.
Converted complexity into structured clarity by translating requirements & business processes into analytical recommendations to ensure alignment between non-technical & technical stakeholders.
Conducted advanced SQL based analysis of complex business datasets to uncover trends, correlations & performance improvement opportunities.
Drove process automation & efficiency improvements by leveraging Python, SQL optimization & AI assisted tools to reduce processing time & increase reliability across analytical & operational workflows.
Standardized KPI definitions & reporting logic to ensure consistency & trust across reporting solutions.
Developed process monitoring dashboards & analyses to identify inefficiencies, bottlenecks & compliance deviations across end-to-end business processes to derive actionable recommendations for process improvement & automation.

Hardeep B.

Sr. Data Engineer

Last position:

Sr. Data Engineer at Charles Schwab Bank

Designed and implemented end-to-end data pipelines (batch & streaming) using Python, SQL, and Apache Spark, Databricks on AWS reducing ETL latency by 40%.
Developed serverless event-driven ingestion pipelines using AWS Lambda and SQS, ensuring real-time data availability for downstream analytics.
Leveraged Google Cloud Platform (GCP) services including BigQuery and Dataflow to manage cross-cloud data warehousing and analytics integration.
Expertise in DMS (CDC, Full Load) and Airflow for scalable data pipeline automation and orchestration.
Managed and customized data pipelines using Databricks, Airflow. Automation using Docker, Kubernetes, Terraform.
Automated data quality checks using dbt to modularize transformations and ensure production-grade data lineage, improving reliability by 30%.
Collaborated with compliance teams to ensure GDPR and SOC2 alignment. Mentored junior engineers and contributed to architecture refactoring for scalability.
Created and maintained dashboards in Power BI to provide actionable insights.

Maziyar K.

Senior Data Engineer

Taufkirchen

Last position:

Data Engineer at MSD Germany

Lead Architect to design and implement the data lake and ETL Pipeline using AWS Stack
Performance Optimization of Data Ingestion of ETL Pipeline
Development of Data Validation using Great Expectations
Leading of the data migration for two sources exchanges
Data Modeling in AWS Redshift

MLOps

Model inference implementation by mlflow and AWS SageMaker
Feature Engineering for the running ML Models ( Recommender Engineer, Clustering )
Implementatino of Model Registry and artifactory using mlflow
Historization an Profiling of the Input Data Using AWS Glue Crawler and AWS Data Catalog
Feature importance using mlflow

Tech. Stack: Python 3, AWS Glue, AWS Step Fucntion, AWS Lambda, AWS EventBridge, AWS IAM Role, AWS SageMaker, AWS EC2, AWS Glue Crawler, AWS CloudWatch, MLFlow, ETL, Data lake, GitHub Action, Terraform, Jenkins, Ansible playbooks (Infrastructure as Code), CI/CD, GitLab, SQL, PySparkSCRUM, Agile, Jira, BigData, VSCode, DBeaver, MSSQL, MySQL, grafana, Docker, Linux, Bash, MapReduce, Data Modeling (ORM), Pandas, YAML, SQL-Alchemy

Stefan C.

SQL, ETL, Reporting, DWH Development

Last position:

SSIS Development at Stadtsparkasse München

Replacement of a Java application and the Oracle DB for loading the internal WerWasWo system using SSIS.
Development of SSIS packages to load text files into the database (SQL Server)
Development of a database project for deployment on various servers
Creation of queries to monitor the loading runs
Development of a PowerShell script to automate the deployment of the SSDT projects.
Oracle, SQL Developer, Microsoft SQL Server 2022 on-premises, SQL Server Management Studio v21, Visual Studio 2022, SSIS, SSDT, PowerShell.

Manikanta R.

Data Engineer

Germering

Last position:

Data Engineer at Insurance client

Design, development, and maintenance of end-to-end ETL pipelines for scalable and reliable data integration
Support in data quality checks, testing, and migrations
Development and maintenance of dbt models for structured, modular, and reusable data transformations
Use of AI-driven development to improve ETL job creation and code quality.
Development of CI/CD for automated deployment.

Nina N.

ESG Data Analyst (Volunteer, part-time)

Eching

Last position:

ESG Data Analyst (Volunteer, part-time) at Climate Accountability API

Development and validation of a data model and ESG rating pipeline
GenAI governance

Nandana R.

IT Product Owner

München

Last position:

IT Product Owner at PwC

Project: SAP migration (ECC to S/4HANA) – US-based internal analytics product to manage finance and personnel performance insights of 10,000+ users across the Americas.
Led cloud migration from a legacy data warehouse to Azure Data Lake and Databricks, improving system scalability by 40% and reducing manual interventions by 60%.
Delivered end-to-end product ownership across 3 cross-functional Agile teams using SAFe methodology and Azure DevOps.
Designed and implemented data pipelines using Azure Data Factory, improving data ingestion speed by 30% and reducing data errors by 25%.
Defined the product roadmap, backlog, and sprint goals in collaboration with stakeholders, ensuring 95% of deliverables met business expectations.
Managed the product backlog and prioritised feature development based on stakeholder needs, achieving a 25% increase in sprint velocity and a 100% sprint completion rate.
Facilitated Agile ceremonies (sprint planning, reviews, retrospectives) that improved team collaboration and reduced delivery times by 20%.
Led requirement gathering and analysis, enhancing data quality and aligning with business objectives, resulting in a 25% improvement in migration efficiency.
Worked closely with business owners, achieving a 15% reduction in dispute resolution time and stronger alignment with business value.
Established KPI dashboards to measure product adoption and platform stability, resulting in 20% improved stakeholder satisfaction.

Mohamed S.

Machine Learning Engineer (Part Time)

München

Last position:

Machine Learning Engineer (Part Time) at E.ON Digital Technology

Designed and implemented an advanced, agentic RAG pipeline using LangChain and LangGraph for structured data extraction from PDFs, utilizing tools, state management, and OpenAI LLMs (GPT-4) to improve accuracy and handle complex document structures.
Developed a Google AI agent for extraction of structured information from PDF documents and deployed the agent on Vertex AI.
Architected data pipelines using Azure Data Factory and Databricks to ingest data from Azure Blob Storage, process it with PySpark, and load it into Azure SQL Database via Linked Services.
Containerized AI agents and services using Docker for consistent local development and deployment.
Utilized PySpark and Dask for database querying in coordination with Azure Blob Storage and Document Storage.
Created a ReAct agent that extracts structured data from PDF documents using tools and integrating Azure Document Intelligence.
Contributed to the CPO invoices validation check project using Databricks to find existing CDRs and calculate total valid costs.
Developed a conversational AI agent (chatbot) with a FastAPI backend, integrating RAG for precise tariff extraction and deployed the service using Azure Container Apps.
Tools used: Azure, Azure OpenAI, Azure Document Intelligence, Azure Blob Storage, Google ADK, Google Cloud, Vertex AI, Gemini, Databricks, LangChain, LlamaIndex Ollama, Docker, PySpark, Azure SQL, Azure Data Factory, Azure AI Agent, Microsoft SQL Server

Satish K.

Sustainability Intern

Last position:

Sustainability Intern at Forschungszentrum Jülich GmbH

Developed energy estimation models to estimate electric charging and hydrogen refueling requirements at charging and refueling stations for logistics trucks in Germany.
Estimated future freight traffic demand for Germany using an in-house transport demand model.
Designed a network of electric charging and hydrogen refueling stations based on transport model results, supporting data-driven infrastructure planning.

Ben S.