AWS Lambda Experts in Munich

In my role as Senior Cloud DevOps Architect for BP, an oil and gas company, I had the mission to migrate the Electric Vehicle Charging platform of the EV Division from on-premises and Azure to AWS cloud, resulting in a hybrid multi-cloud, multi-tenant SaaS solution.

Deployment with Kubernetes for the application layer meant provisioning Kubernetes clusters managed by EKS and AKS, with a focus on integrating them into a multi-tenant environment. This integration was achieved by using Kubernetes namespaces and access controls to ensure data isolation and privacy enforcement.

In the database layer, we chose an RDS instance with PostgreSQL to support the backend infrastructure of our applications. Tenants shared the same RDS instance, but each had a dedicated schema.

To ingest near real-time data from physical charge points (CPOs), as IoT devices, via the OCPI protocol, we ran into significant delays with batch processing. As a result, we built a real-time streaming data pipeline using Apache Kafka, while prioritizing an event-driven architecture.

Led collaboration across multiple internal teams, external vendors, cloud providers, and on-site partners to integrate over five systems into a unified solution.

Achievements:

• Successfully designed and implemented hybrid multi-cloud solutions, integrating multiple cloud platforms (AWS, Azure) with on-premises infrastructure, using Site-to-Site VPNs, Firewalls, and Load Balancing.
• Led the migration of on-premises infrastructure to multi-cloud, multi-tenant infrastructure, resulting in 30% faster processing times.
• Migrated workloads from VMware and Hyper-V environments to cloud-based VMs, leveraging cloud-native services to optimize performance, cost efficiency, and scalability.
• Designed a multi-tenant Kubernetes platform leveraging the Kubernetes ecosystem, using Karpenter for dynamic EC2 node provisioning, KEDA for event-driven pod autoscaling (e.g., Kafka message lag), and Rancher for centralized monitoring of multiple clusters (EKS, AKS, or on-prem K8s), replacing Microsoft-centric Azure Arc management service.
• Designed and implemented Python-based FastAPI microservices as part of the EV core-backend on AWS EKS application layer, powering data ingestion and customer analytics pipelines.
• Developed asynchronous, event-driven APIs (Python-FastAPI) for real-time integration with CPOs, supporting OCPI 2.3 and OICP protocols.
• Designed and implemented a secure, production-grade Azure Databricks platform using Terraform, ensuring scalability and cost efficiency.
• Migrated on-premises ERP to a hybrid Dynamics 365 architecture with ERP hosted locally and CRM running in Azure, integrated via Azure Arc.
• Automated CI/CD pipelines for Databricks notebooks and jobs using GitHub Actions & Databricks CLI, reducing deployment time. Reduced infrastructure provisioning time by 70% by automating cloud resource deployment with GitOps.
• Ensured compliance with internal audit and data governance standards (GDPR) through OAuth2/OIDC-based authentication and fine-grained role-based access controls.
• Developed a Zero Trust security model, enforcing least-privilege access and microsegmentation, enhancing security posture and compliance with GDPR and NIST.
• Built interactive analytics dashboards in Amazon QuickSight, integrating data from S3 and Redshift to deliver real-time business insights and visualizations with embedded access for multi-tenant users.
• Led cloud security assessments and full-lifecycle cybersecurity integration during M&A, covering AWS, Azure, IAM (Entra ID), and data protection, while aligning security posture with NIST, ISO 27001, and GDPR across hybrid and cloud-native environments.
• Reduced cloud costs by 64% for a client's dev environment by implementing automated start/stop schedules for EC2 and RDS instances via AWS CDK with EventBridge Scheduler or AWS Systems Manager.

Tech stack:

• Infrastructure as Code: Terraform, AWS CDK, Ansible.
• Containers: Kubernetes on EKS, AKS, Docker.
• Streaming Data Processing: Kafka to Confluent Cloud, after AWS MSK.
• Frontend: TypeScript, React, NextJS, Hooks, Styled Components.
• Backend: Python with FastAPI, also Node.js with NestJS.
• Database: Aurora on PostgreSQL with TypeORM, RDS on SQL Server, Azure Databricks full setup and administration, ETL Pipelines.
• CI/CD and GitOps: GitHub Actions, Azure DevOps, ArgoCD.
• Monitoring and Observability: Prometheus and Grafana.
• Virtualization: Hyper-V, VMware Cloud on AWS, Azure Migrate.
• ERP Systems: Odoo, Microsoft Dynamics 365 Business Central on Azure, integrated with Azure Arc.
• Networking: Site-to-Site VPNs, AWS Direct Connect, Azure ExpressRoute, Firewalls (AWS Network Firewall, Azure Firewall).
• Security: IAM, NIST Framework, Zero Trust Security, AWS WAF, AWS Shield, GuardDuty.

• Build and operate an end-to-end MLOps platform on Azure ML and Kubernetes (Kubeflow) for the automated deployment, monitoring, and scaling of forecasting models (including Temporal Fusion Transformer, Informer, Autoformer).
• Implement CI/CD pipelines in Azure DevOps for the full ML lifecycle – from resource provisioning (Terraform), data transformation (Hugging Face Datasets, Pandas, PyTorch, CUDA cluster) through training and evaluation to model registry and endpoint deployment.
• Integrate MLflow for experiment tracking, model versioning, performance monitoring, and automated registration in the Azure Model Registry.
• Develop and containerize PyTorch training jobs (Azure Notebook, Jupyter Notebooks) for price and time series forecasting (PFC models) with automatic rollout via Azure ML Endpoints and REST/gRPC interfaces, Docker containerization, secured with OAuth 2.0.
• Set up monitoring and alerting mechanisms (Prometheus, MLflow Metrics), log centralization, and cost monitoring.
• Automate infrastructure provisioning and model deployment using Terraform, Helm, and Azure CLI; connect to existing market data systems and event pipelines.
• Migrate existing workloads and databases (IONOS → Azure, MongoDB) with integration into central MLOps workflows and internal networks.
• Extend the platform with LLM-based tools (LangChain, LangServe) to integrate GPT-based analysis modules into existing Spring Boot services for market anomaly detection and automated reports.
• Analyze and architect a software solution to process large volumes of data efficiently (>3000 messages/sec.) (market data store).
• Spring Boot / Java 21 container development with RabbitMQ for distributing stock market data via MongoDB (Kubernetes) with fast storage of data in Redis RMaps, deduplication, forwarding messages to Read Model queues, and building Read Models for UI display in MongoDB.
• Integration of RESTHeart to create a REST API for MongoDB.
• Build an Angular frontend to simplify data queries and master data maintenance.
• Agentic coding with remote and local LLMs (Claude Sonnet, Ollama Qwen) and MCP servers.
• Develop Python scripts for transforming and cleaning incoming stock market data (Pandas, scikit-learn).

Project: Tax Exemption Order Application

The client has an existing application for creating and maintaining tax exemption orders for end customers; design and implementation of a comparable application for internal employees.

• Design and implementation of microservices and the UI for the business area "tax exemption orders" using Domain Driven Design as well as Spring Boot and Angular.
• Implementation of reactive, non-reactive, and asynchronous APIs (Spring REST, WebFlux, GraphQL).
• Development of the Angular application, including state management using Signals, RxJS Observables, and subscriptions.
• Securing the API and the application using OAuth2, JWT, and OpenID Connect.
• Configuration and setup of CI/CD pipelines with Jenkins.
• Collaboration with cross-functional teams and conducting code reviews.

Environment: Java, Spring Boot, Angular 18 & 19 (standalone, signals), RxJs, Bootstrap CSS, Vitesting, OpenShift, Istio, microservices, Kafka, Dynatrace, Jenkins, GitLab, Graylog, Sonar, Oauth2, OracleDB

• It is like a startup within REWE, where we have to build a new forecasting system on Google Cloud Platform from the scratch. Although, officially my role is called MLOps, my actual tasks also include development of data processing pipelines (data engineering) and data scientists tasks such as feature engineering and model trainings.
• GCP: Terraform (tofu), Vertex AI (Kubeflow), Cloud Run, IAM, Google Cloud Storage, BigQuery, Artifact Registry
• Data engineering: Snowflake as the main data warehouse, Terraform, DBT for data model implementations
• CI/CD: GitLab. We have built a CI/CD pipeline that automates deployments of new releases up to production environment

• Responsible for Openshift/Kubernetes on-prem administration and developer support.
• Developed URP infrastructure automation with Python, Ansible, Kustomize and ArgoCD, Argo Workflow/Events stack.
• Wrote smoke and load tests for URP infrastructure utilizing Python, Kustomize and ApplicationSets.
• Helped to set up and deploy URP infrastructure in Google Cloud, GKE.
• Set up monitoring for URP and ArgoCD stack with Splunk Cloud.
• Performed system administration tasks across RedHat Linux, Kubernetes/Openshift, ArgoCD, GitLab, Bitbucket Enterprise, Kafka and MongoDB.

• Designed and implemented end-to-end data pipelines (batch & streaming) using Python, SQL, and Apache Spark, Databricks on AWS reducing ETL latency by 40%.
• Developed serverless event-driven ingestion pipelines using AWS Lambda and SQS, ensuring real-time data availability for downstream analytics.
• Leveraged Google Cloud Platform (GCP) services including BigQuery and Dataflow to manage cross-cloud data warehousing and analytics integration.
• Expertise in DMS (CDC, Full Load) and Airflow for scalable data pipeline automation and orchestration.
• Managed and customized data pipelines using Databricks, Airflow. Automation using Docker, Kubernetes, Terraform.
• Automated data quality checks using dbt to modularize transformations and ensure production-grade data lineage, improving reliability by 30%.
• Collaborated with compliance teams to ensure GDPR and SOC2 alignment. Mentored junior engineers and contributed to architecture refactoring for scalability.
• Created and maintained dashboards in Power BI to provide actionable insights.

As the Solution Architect for Agentic AI in auto claims processing, I led global customer delivery implementations, encompassing solution design and detailing, multi-tenancy, process flows, integration with third-party solutions, and localization requirements.

• Architectural Analysis: Conducted in-depth analysis of business requirements, managing requirements and creating detailed specifications.
• Service Definition: Developed comprehensive technical definitions for services and integration contracts.
• AI Process Management: Automated AI process management, focusing on analysis, optimization, and continuous improvement.
• Requirements Gathering: Facilitated requirement-gathering sessions and analyzed business processes to identify optimization opportunities.
• Agile Collaboration: Employed agile methodologies, working closely with stakeholders to ensure alignment and responsiveness.
• Technical Support: Assisted senior management with technical analyses and deliverability assessments.

• Designed, built, and maintained scalable ETL/ELT data pipelines using Python, SQL, REST APIs, AWS Lambda, S3, PostgreSQL RDS, EventBridge, CloudWatch, Docker, Apache Airflow, and BigQuery – integrating data from GA4, Google Ads, Meta Ads, CMS, CRM, newsletters, events, and B2C ordering systems into analytics-ready datasets.
• Built a cross-brand lakehouse architecture from AWS to BigQuery – transforming raw JSON/CSV data into structured, partitioned, and reusable reporting layers with staging, intermediate, canonical, and mart models.
• Designed relational and dimensional data models: 3NF staging models, star schemas, fact tables, dimension tables, daily KPI aggregates, and dashboard-optimized marts for marketing, content, subscription, event, CRM, and revenue analysis.
• Implemented production-grade data quality and pipeline reliability features: incremental loads, idempotent upserts, deduplication, schema validation, row matching, null checks, anomaly detection, freshness monitoring, logging, retries, and error alerts.
• Automated cross-brand reporting processes and data products – pipelines for 73 newsletter campaigns, 31 lead list syncs, 52 event partner reports, and a 500K-record company matching pipeline; reduced manual data preparation by approx. 70% and increased analyst productivity by approx. 30%.

• Concept creation and implementing AI Agents in AWS Cloud
• Continuously alignment with stakeholders
• Collaborate with DevOps
• Technologies: Git, CI/CD (GitHub Actions), Python/ML, Streamlit, Deno/typescript, AWS SAM, AWS Bedrock, AWS Lambda, AWS Dynamo DB, AWS S3, AWS Event Bridge etc.

• Test concept creation
• Creation of test processes
• Coordination of TC development: stress tests, functional tests, performance tests, high data rate tests, integration tests, etc.
• HW testing: FPGA, RF
• Test automation and regression tests
• Ensuring 24/7 operation of the test system
• Analysis & reporting
• Regular coordination of the test team, meetings with other stakeholders
• Communication and coordination with stakeholders and the project manager

• Designed and developed a high-performance internal resource management platform using React and TypeScript, optimizing dynamic data rendering and state management.
• Built a React Native application to support mobile access to internal tools, enabling on-the-go project tracking for field teams.
• Developed custom 2D canvas-based visualizations using Pixi.js to simulate material flows and refractory layer behaviors.
• Integrated Pixi.js with React components for interactive diagrams and real-time UI updates.
• Developed interactive 3D visualizations using React.js for displaying refractory product layouts and simulations, supporting engineering and sales teams with dynamic product previews.
• Integrated Three.js within the React ecosystem to allow manipulation of 3D models in real-time via browser, enhancing user engagement and field configurability.
• Integrated a headless CMS to enable dynamic content updates by non-technical users, reducing content deployment time by 40%.
• Led AWS CloudFront optimization initiatives, improving portal load speeds by 30% globally.
• Actively collaborated with cross-functional Agile teams and product owners to deliver prioritized features with a fast feedback loop.
• Key Technologies: React.js, React Native, Three.js, TypeScript, Contentful CMS, AWS S3/Lambda/CloudFront, Cypress, Agile Scrum

• Participated in the gradual modernization of components into cloud-native 12-factor applications.
• Worked closely with the business operations team to eliminate manual processes and resolve several performance bottlenecks.
• Designed and implemented a CI/CD pipeline to increase developer productivity, enforce quality and security checks, and automate product delivery.
• Migrated several components into the OpenShift Kubernetes cluster.
• Built a monitoring stack from scratch with Prometheus and Grafana to monitor services running in OpenShift.
• Developed dashboards in both Grafana and Splunk for operational transparency.
• Implemented an OIDC/OAuth2-based single sign-on (SSO) solution with Keycloak to secure multiple applications.
• Technologies: Java, Spring, Quarkus, Kafka, MySQL, Cassandra, Redis, Spring Data, Hibernate, Docker, Kubernetes, OpenShift, Keycloak, OIDC, OAuth2, Helm, Prometheus, Grafana, Splunk, Spark.

• Head of overall technical integration NSC (National Secure Cloud, project with approx. 60 employees).

• Technical integration of all subprojects into one product, definition of interfaces and basic components of a cloud including hardware, technical architecture of the IABG platform.

• Development of a Cloud Management Platform (CMP) capable of creating private/mixed clouds of any complexity based on a textual description with one click or interactively.

• CMP also includes the complete hardware management lifecycle.

• Kubernetes, OpenStack and Hadoop are used as the foundation.

• The management layer includes Harbor, Gitea, Longhorn, Keycloak, Rancher and Jenkins, which are configured automatically.

• Private cloud can run any customer workloads, including a full Hadoop layer with HDFS, Spark, MapReduce, Mesos, HBase and around 20 additional ML/DL technologies.

• Hadoop worker clusters can also be installed automatically without Kubernetes on bare metal or commodity hardware.

• OpenStack with Nova, Neutron, Ironic, Swift, Cinder, Ceph.

• Development of a Java application Rudi: SOAP, REST, containers, DB.

• Technologies: Kubernetes (K3s, Rke2, Minikube, Harbor, Gitea, Jenkins, Longhorn, Keycloak, Rancher), OpenStack (Nova, Neutron, Keystone, Swift, Ceph, Cinder, Sahara, Magnum, Kayobe, Kolla, Bigrost, Ironic), Hadoop (HDFS, Ambari, Solr, Livy, Ranger, YARN, Tez, HBase, Kafka, Hive, Zookeeper, MapReduce, Spark, Oozie, Flink), virtualization (Kubernetes (K3S), VMware, Oracle), scripting (Ansible, Puppet, Juju, Shell, Groovy, Gradle, Maven).

• Maintained a SaaS billing platform on AWS as part of the Site Reliability Engineering (SRE) team.
• Played a key role in an AWS cloud migration project, implementing Terraform (IaC), creating CI/CD processes and pipelines, hardening images, upgrading tool versions, and developing scripts.
• Wrote documentation.

AWS Cloud migration:

• Design and implement CI/CD for deploying AWS resources using GitLab CI, Terraform, and GitOps.
• Create and configure DevOps toolchain including Jenkins, Harbor, and Vault.
• Deploy billing application, microservices, and supporting infrastructure services to Nomad clusters.
• Re-designed TLS/mTLS certificate management using Vault and Lambda.

Security (Infrastructure Hardening & Patch Management & Vulnerability Scanning):

• Managed multiple AWS accounts for Consul/Nomad/Traefik clusters (10–20 EC2 instances/account, ASG) and DevOps toolchain accounts (Harbor, Jenkins, Vault).
• Created hardened AMIs via Packer based on CIS benchmarks for Nomad, Jenkins, Harbor, and Vault; deployed using Terraform.
• Integrated Trivy via Harbor plugin for container image scanning.
• Implemented strict AWS VPC security group rules.
• Developed and maintained patching process across environments using Qualys and Wiz.
• Deployed Qualys Cloud Agent to all EC2 instances, tracked CVEs and tested patches in lower environments before rollout.
• Automated patch deployment across all AWS accounts using Terraform and GitLab CI and verified patch compliance via Qualys/Wiz dashboards.