Amazon ECS Experts in Munich

• This project involved extraction of intelligence data to support report writing for a company that provides geopolitical, global, commercial intelligence. The data have been gathered from a number of resources (interview transcripts, online data, internal documents), and then a knowledge base has been build from it. This was the basis of a complex RAG system, that was evaluated against a golden dataset. Agents have been used to find out the contradicting intelligence, the statements supporting each other, and to store back the generated knowledge.

Used: Python, RAG, LangGraph, LangChain, deepeval, MCP

In my role as Senior Cloud DevOps Architect for BP, an oil and gas company, I had the mission to migrate the Electric Vehicle Charging platform of the EV Division from on-premises and Azure to AWS cloud, resulting in a hybrid multi-cloud, multi-tenant SaaS solution.

Deployment with Kubernetes for the application layer meant provisioning Kubernetes clusters managed by EKS and AKS, with a focus on integrating them into a multi-tenant environment. This integration was achieved by using Kubernetes namespaces and access controls to ensure data isolation and privacy enforcement.

In the database layer, we chose an RDS instance with PostgreSQL to support the backend infrastructure of our applications. Tenants shared the same RDS instance, but each had a dedicated schema.

To ingest near real-time data from physical charge points (CPOs), as IoT devices, via the OCPI protocol, we ran into significant delays with batch processing. As a result, we built a real-time streaming data pipeline using Apache Kafka, while prioritizing an event-driven architecture.

Led collaboration across multiple internal teams, external vendors, cloud providers, and on-site partners to integrate over five systems into a unified solution.

Achievements:

• Successfully designed and implemented hybrid multi-cloud solutions, integrating multiple cloud platforms (AWS, Azure) with on-premises infrastructure, using Site-to-Site VPNs, Firewalls, and Load Balancing.
• Led the migration of on-premises infrastructure to multi-cloud, multi-tenant infrastructure, resulting in 30% faster processing times.
• Migrated workloads from VMware and Hyper-V environments to cloud-based VMs, leveraging cloud-native services to optimize performance, cost efficiency, and scalability.
• Designed a multi-tenant Kubernetes platform leveraging the Kubernetes ecosystem, using Karpenter for dynamic EC2 node provisioning, KEDA for event-driven pod autoscaling (e.g., Kafka message lag), and Rancher for centralized monitoring of multiple clusters (EKS, AKS, or on-prem K8s), replacing Microsoft-centric Azure Arc management service.
• Designed and implemented Python-based FastAPI microservices as part of the EV core-backend on AWS EKS application layer, powering data ingestion and customer analytics pipelines.
• Developed asynchronous, event-driven APIs (Python-FastAPI) for real-time integration with CPOs, supporting OCPI 2.3 and OICP protocols.
• Designed and implemented a secure, production-grade Azure Databricks platform using Terraform, ensuring scalability and cost efficiency.
• Migrated on-premises ERP to a hybrid Dynamics 365 architecture with ERP hosted locally and CRM running in Azure, integrated via Azure Arc.
• Automated CI/CD pipelines for Databricks notebooks and jobs using GitHub Actions & Databricks CLI, reducing deployment time. Reduced infrastructure provisioning time by 70% by automating cloud resource deployment with GitOps.
• Ensured compliance with internal audit and data governance standards (GDPR) through OAuth2/OIDC-based authentication and fine-grained role-based access controls.
• Developed a Zero Trust security model, enforcing least-privilege access and microsegmentation, enhancing security posture and compliance with GDPR and NIST.
• Built interactive analytics dashboards in Amazon QuickSight, integrating data from S3 and Redshift to deliver real-time business insights and visualizations with embedded access for multi-tenant users.
• Led cloud security assessments and full-lifecycle cybersecurity integration during M&A, covering AWS, Azure, IAM (Entra ID), and data protection, while aligning security posture with NIST, ISO 27001, and GDPR across hybrid and cloud-native environments.
• Reduced cloud costs by 64% for a client's dev environment by implementing automated start/stop schedules for EC2 and RDS instances via AWS CDK with EventBridge Scheduler or AWS Systems Manager.

Tech stack:

• Infrastructure as Code: Terraform, AWS CDK, Ansible.
• Containers: Kubernetes on EKS, AKS, Docker.
• Streaming Data Processing: Kafka to Confluent Cloud, after AWS MSK.
• Frontend: TypeScript, React, NextJS, Hooks, Styled Components.
• Backend: Python with FastAPI, also Node.js with NestJS.
• Database: Aurora on PostgreSQL with TypeORM, RDS on SQL Server, Azure Databricks full setup and administration, ETL Pipelines.
• CI/CD and GitOps: GitHub Actions, Azure DevOps, ArgoCD.
• Monitoring and Observability: Prometheus and Grafana.
• Virtualization: Hyper-V, VMware Cloud on AWS, Azure Migrate.
• ERP Systems: Odoo, Microsoft Dynamics 365 Business Central on Azure, integrated with Azure Arc.
• Networking: Site-to-Site VPNs, AWS Direct Connect, Azure ExpressRoute, Firewalls (AWS Network Firewall, Azure Firewall).
• Security: IAM, NIST Framework, Zero Trust Security, AWS WAF, AWS Shield, GuardDuty.

• Build and operate an end-to-end MLOps platform on Azure ML and Kubernetes (Kubeflow) for the automated deployment, monitoring, and scaling of forecasting models (including Temporal Fusion Transformer, Informer, Autoformer).
• Implement CI/CD pipelines in Azure DevOps for the full ML lifecycle – from resource provisioning (Terraform), data transformation (Hugging Face Datasets, Pandas, PyTorch, CUDA cluster) through training and evaluation to model registry and endpoint deployment.
• Integrate MLflow for experiment tracking, model versioning, performance monitoring, and automated registration in the Azure Model Registry.
• Develop and containerize PyTorch training jobs (Azure Notebook, Jupyter Notebooks) for price and time series forecasting (PFC models) with automatic rollout via Azure ML Endpoints and REST/gRPC interfaces, Docker containerization, secured with OAuth 2.0.
• Set up monitoring and alerting mechanisms (Prometheus, MLflow Metrics), log centralization, and cost monitoring.
• Automate infrastructure provisioning and model deployment using Terraform, Helm, and Azure CLI; connect to existing market data systems and event pipelines.
• Migrate existing workloads and databases (IONOS → Azure, MongoDB) with integration into central MLOps workflows and internal networks.
• Extend the platform with LLM-based tools (LangChain, LangServe) to integrate GPT-based analysis modules into existing Spring Boot services for market anomaly detection and automated reports.
• Analyze and architect a software solution to process large volumes of data efficiently (>3000 messages/sec.) (market data store).
• Spring Boot / Java 21 container development with RabbitMQ for distributing stock market data via MongoDB (Kubernetes) with fast storage of data in Redis RMaps, deduplication, forwarding messages to Read Model queues, and building Read Models for UI display in MongoDB.
• Integration of RESTHeart to create a REST API for MongoDB.
• Build an Angular frontend to simplify data queries and master data maintenance.
• Agentic coding with remote and local LLMs (Claude Sonnet, Ollama Qwen) and MCP servers.
• Develop Python scripts for transforming and cleaning incoming stock market data (Pandas, scikit-learn).

• Applied modern JavaScript features, including ES6+ syntax, destructuring, modules, array methods, and asynchronous programming, to develop efficient and readable frontend code.
• Implemented frontend integration patterns for PHP and Laravel backend services, connecting React interfaces to REST APIs and handling structured JSON data.
• Developed interactive, functional component-based frontend applications using React Hooks, JavaScript, and TypeScript, alongside backend applications and RESTful APIs using Python, Django, Flask, and FastAPI, focusing on reusable components, modular architecture, maintainability, and efficient data processing.
• Maintained a dynamic portfolio platform using PHP, Laravel, Livewire, and MySQL, implementing end-to-end functionality across frontend interfaces, backend services, and database operations.
• Validated server-side request handling, routing, middleware, and form validation using Laravel features to support reliable application workflows and consistent data processing.
• Designed and managed relational database structures using MySQL and Laravel Eloquent ORM, implementing data models, relationships, database migrations, and efficient queries for content management.
• AI-powered applications integrating Large Language Models (LLMs) through external APIs and locally hosted models, exploring practical use cases for conversational AI, intelligent automation, and AI-assisted workflows.
• Built local AI applications and developer tools for running, configuring, and interacting with locally hosted language models, gaining experience with local inference, model integration, and privacy-conscious AI workflows.
• Explored Retrieval-Augmented Generation (RAG) approaches to combine language models with external knowledge sources, enabling context-aware responses based on relevant application data and retrieved information.
• Integrated AI services with backend APIs and application components, developing reusable modules for model communication, response processing, error handling, and data exchange.

• It is like a startup within REWE, where we have to build a new forecasting system on Google Cloud Platform from the scratch. Although, officially my role is called MLOps, my actual tasks also include development of data processing pipelines (data engineering) and data scientists tasks such as feature engineering and model trainings.
• GCP: Terraform (tofu), Vertex AI (Kubeflow), Cloud Run, IAM, Google Cloud Storage, BigQuery, Artifact Registry
• Data engineering: Snowflake as the main data warehouse, Terraform, DBT for data model implementations
• CI/CD: GitLab. We have built a CI/CD pipeline that automates deployments of new releases up to production environment
• Development of feature store and data synchronization between environments
• Data science: evaluation of different forecasting models, including CatBoost, Contextual Gamma and Random Forest; implementation of training pipelines using Kubeflow on Vertex AI; scaling and development of an event-driven interface using Kafka as a forecasting service; evaluation of MLFlow for model tracking and model registry
• Implementation of REST API using KeyCloak OAuth2 and OpenID (JWT)
• Monitoring: implementation of dashboards with Grafana, Prometheus, Mimir, Streamlit and Loki to monitor prediction metrics, GCP and Snowflake costs for pipelines, and system metrics
• Development of Copilot Agent Skills

• Responsible for Openshift/Kubernetes on-prem administration and developer support.
• Developed URP infrastructure automation with Python, Ansible, Kustomize and ArgoCD, Argo Workflow/Events stack.
• Wrote smoke and load tests for URP infrastructure utilizing Python, Kustomize and ApplicationSets.
• Helped to set up and deploy URP infrastructure in Google Cloud, GKE.
• Set up monitoring for URP and ArgoCD stack with Splunk Cloud.
• Performed system administration tasks across RedHat Linux, Kubernetes/Openshift, ArgoCD, GitLab, Bitbucket Enterprise, Kafka and MongoDB.

• Overall responsibility for the project lifecycle from scope definition to completion
• Close collaboration with platform teams, IT leaders, and external service providers
• Application of SAFe principles and structured sprint work
• Creation of a migration roadmap with clear milestones
• Monitoring of the lifecycle: onboarding, repository migration, replication of permissions, and system tests
• Visualization of the architecture with PlantUML and Gliffy as well as documentation in Confluence
• Regular status reports and running knowledge transfer sessions

• Build a scalable multi-region backend service in AWS to serve remote desktop virtual machines for scientific analysis
• Stack: AWS, GitHub, Terraform, Python, Rust
• Built and defined the core infrastructure of the backend system
• Defined and coded the virtual machines provisioning supporting Ubuntu and Rocky Linux desktop setups
• Programmed the API service running in ECS to manage virtual machines and build custom Docker images for users

• Test concept creation
• Creation of test processes
• Coordination of TC development: stress tests, functional tests, performance tests, high data rate tests, integration tests, etc.
• HW testing: FPGA, RF
• Test automation and regression tests
• Ensuring 24/7 operation of the test system
• Analysis & reporting
• Regular coordination of the test team, meetings with other stakeholders
• Communication and coordination with stakeholders and the project manager

• Role: Software Engineer & Applied Mathematician (Mathematical optimization for scheduling; duration: 1 months; team setting: Team of 2, remote; technologies: JuMP, Julia, Pluto, Svelte, JavaScript, TypeScript, JetBrains Space, Terraform, Nomad)

• Role: Software & Cloud & Web Engineer (Building scalable data science compute cluster from scratch; duration: 11 months; team setting: Team of 1, on-site; technologies: Terraform, Kubernetes, k8s ingress, k8s services, k8s RBAC, k8s networking, k3s, etcd, S3, DNS, certificates, Julia, Pluto, JavaScript, Tailwind, Astro, npm, Parcel, Preact, MUI, JWT, AWS SQS, AWS RDS, Python, GitLab, GitHub)

• Role: AI & Web Engineer (Custom ChatGPT service; duration: 1 months; team setting: Team of 2, remote; technologies: Python, Poetry, LangChain, Tailwind, ChatGPT API, Flask, FastAPI)

• Role: Architect & Data Engineer (Central datalake setup and ingestion; duration: 9 months; team setting: Team of 5, remote; technologies: Infrastructure-as-code, AWS CDK, Python, Boto3, PySpark, AWS Glue, IAM, S3, ECS, Fargate, Lambda, Apache Hudi, DeltaLake, Databricks, GitHub, Jira, Miro)

• Role: Software Engineer (PoC Julia migration of scikit-decide; duration: 1 months; team setting: Team of 2, remote; technologies: Python, Julia, GitHub)

Serving as AI technical advisor to Dialpad's Telephony Engineering division while building AI products hands-on. Currently developing MCP-based tooling for AI text and voice agents: agent authoring, integrations and adoption of existing agents, shared authentication and API contracts, and durable workflow state. This includes text and voice tests that evaluate agent behavior, latency and task completion.

In parallel, helping Dialpad's engineers adopt QualityLayer and use Claude Code and Codex effectively. This ongoing work covers context management for large codebases, reusable plan-implement-test-review workflows connected to CI/CD, playbooks, hands-on workshops, labs and pair programming.

Technologies: AI Agent Products (Text & Voice Agents, MCP, LLMs, Python, TypeScript), Agent Tooling (Authoring, Integrations, OAuth, Durable State), Quality & Evaluation (Text & Voice Tests, Evals, Regression, Traces), Agentic Engineering (Claude Code, Codex, QualityLayer, Hooks, Prompts), Context Engineering (RAG, Vector Stores, Codebase Embeddings), Software Delivery (CI/CD Integration, Agentic Loops, PR Automation), Enablement & Coaching (Workshops, Hands-On Labs, Pair Programming)

• Platform: Python ecosystem, RHEL 8, K10, AWS IoT Core, AWS Lambda, MLOps
• Software: Java JEE/cloud, IntelliJ IDEA, AWS IoT Core, AWS Edge and Lambda, AWS SageMaker SDK, Docker Compose, Kubernetes, OpenShift 4, Tekton, Flux, Helm charts, JSON/XML technology, Nginx, Apache Spark, OpenAI (GPT Plus, DALL-E 3, Whisper), GAN, GitHub Copilot, AI/machine and deep learning, Jupyter notebooks, TensorFlow 2, Colab, Keras API, Prometheus, Grafana, Conda, Python 3.9, PySci stack (NumPy, pandas, Scikit-learn, matplotlib)
• Responsible for webinar:
• IoT edge computing: architecture, components, resources, management
• IoT edge computing with MicroK8s, designing and creating flows/diagrams for AWS, three-step model for IoT ecosystem
• IoT processes, connectivity, data transfer and deployment, security
• Optimization of edge computing for IoT networks and services (AWS SQS queue, SNS notifications, events, analytics, buttons, device management/defender, Things Graph)
• Machine/deep learning frameworks (models, training, pipeline optimization, deployment in the cloud/at the edge (OpenShift), monitoring workloads with Prometheus and Grafana)
• Performance optimization for low latency/resilience using adaptive ML/DL/RL models for customer IoT data
• Analysis of large sensor data sets with Apache Spark, Kafka clusters
• Kasten K10 data management platform on Kubernetes multi-cluster with Helm chart, deployment, backup/disaster recovery (RTO/RPO), data lifecycle and security management
• Implementation of multilayer artificial neural network (ANN) with TensorFlow 2 and Colab for regression and classification; data analysis and provisioning for applications; development of models for testing and training, deployment of models
• Automation of business streamline processes with AI (Azure OpenAI, Discord bots/Zapier apps AI assistants (IntelliJ, GitHub Copilot))