Amazon EventBridge Experts in Germany

In my role as Senior Cloud DevOps Architect for BP, an oil and gas company, I had the mission to migrate the Electric Vehicle Charging platform of the EV Division from on-premises and Azure to AWS cloud, resulting in a hybrid multi-cloud, multi-tenant SaaS solution.

Deployment with Kubernetes for the application layer meant provisioning Kubernetes clusters managed by EKS and AKS, with a focus on integrating them into a multi-tenant environment. This integration was achieved by using Kubernetes namespaces and access controls to ensure data isolation and privacy enforcement.

In the database layer, we chose an RDS instance with PostgreSQL to support the backend infrastructure of our applications. Tenants shared the same RDS instance, but each had a dedicated schema.

To ingest near real-time data from physical charge points (CPOs), as IoT devices, via the OCPI protocol, we ran into significant delays with batch processing. As a result, we built a real-time streaming data pipeline using Apache Kafka, while prioritizing an event-driven architecture.

Led collaboration across multiple internal teams, external vendors, cloud providers, and on-site partners to integrate over five systems into a unified solution.

Achievements:

• Successfully designed and implemented hybrid multi-cloud solutions, integrating multiple cloud platforms (AWS, Azure) with on-premises infrastructure, using Site-to-Site VPNs, Firewalls, and Load Balancing.
• Led the migration of on-premises infrastructure to multi-cloud, multi-tenant infrastructure, resulting in 30% faster processing times.
• Migrated workloads from VMware and Hyper-V environments to cloud-based VMs, leveraging cloud-native services to optimize performance, cost efficiency, and scalability.
• Designed a multi-tenant Kubernetes platform leveraging the Kubernetes ecosystem, using Karpenter for dynamic EC2 node provisioning, KEDA for event-driven pod autoscaling (e.g., Kafka message lag), and Rancher for centralized monitoring of multiple clusters (EKS, AKS, or on-prem K8s), replacing Microsoft-centric Azure Arc management service.
• Designed and implemented Python-based FastAPI microservices as part of the EV core-backend on AWS EKS application layer, powering data ingestion and customer analytics pipelines.
• Developed asynchronous, event-driven APIs (Python-FastAPI) for real-time integration with CPOs, supporting OCPI 2.3 and OICP protocols.
• Designed and implemented a secure, production-grade Azure Databricks platform using Terraform, ensuring scalability and cost efficiency.
• Migrated on-premises ERP to a hybrid Dynamics 365 architecture with ERP hosted locally and CRM running in Azure, integrated via Azure Arc.
• Automated CI/CD pipelines for Databricks notebooks and jobs using GitHub Actions & Databricks CLI, reducing deployment time. Reduced infrastructure provisioning time by 70% by automating cloud resource deployment with GitOps.
• Ensured compliance with internal audit and data governance standards (GDPR) through OAuth2/OIDC-based authentication and fine-grained role-based access controls.
• Developed a Zero Trust security model, enforcing least-privilege access and microsegmentation, enhancing security posture and compliance with GDPR and NIST.
• Built interactive analytics dashboards in Amazon QuickSight, integrating data from S3 and Redshift to deliver real-time business insights and visualizations with embedded access for multi-tenant users.
• Led cloud security assessments and full-lifecycle cybersecurity integration during M&A, covering AWS, Azure, IAM (Entra ID), and data protection, while aligning security posture with NIST, ISO 27001, and GDPR across hybrid and cloud-native environments.
• Reduced cloud costs by 64% for a client's dev environment by implementing automated start/stop schedules for EC2 and RDS instances via AWS CDK with EventBridge Scheduler or AWS Systems Manager.

Tech stack:

• Infrastructure as Code: Terraform, AWS CDK, Ansible.
• Containers: Kubernetes on EKS, AKS, Docker.
• Streaming Data Processing: Kafka to Confluent Cloud, after AWS MSK.
• Frontend: TypeScript, React, NextJS, Hooks, Styled Components.
• Backend: Python with FastAPI, also Node.js with NestJS.
• Database: Aurora on PostgreSQL with TypeORM, RDS on SQL Server, Azure Databricks full setup and administration, ETL Pipelines.
• CI/CD and GitOps: GitHub Actions, Azure DevOps, ArgoCD.
• Monitoring and Observability: Prometheus and Grafana.
• Virtualization: Hyper-V, VMware Cloud on AWS, Azure Migrate.
• ERP Systems: Odoo, Microsoft Dynamics 365 Business Central on Azure, integrated with Azure Arc.
• Networking: Site-to-Site VPNs, AWS Direct Connect, Azure ExpressRoute, Firewalls (AWS Network Firewall, Azure Firewall).
• Security: IAM, NIST Framework, Zero Trust Security, AWS WAF, AWS Shield, GuardDuty.

• It is like a startup within REWE, where we have to build a new forecasting system on Google Cloud Platform from the scratch. Although, officially my role is called MLOps, my actual tasks also include development of data processing pipelines (data engineering) and data scientists tasks such as feature engineering and model trainings.
• GCP: Terraform (tofu), Vertex AI (Kubeflow), Cloud Run, IAM, Google Cloud Storage, BigQuery, Artifact Registry
• Data engineering: Snowflake as the main data warehouse, Terraform, DBT for data model implementations
• CI/CD: GitLab. We have built a CI/CD pipeline that automates deployments of new releases up to production environment
• Development of feature store and data synchronization between environments
• Data science: evaluation of different forecasting models, including CatBoost, Contextual Gamma and Random Forest; implementation of training pipelines using Kubeflow on Vertex AI; scaling and development of an event-driven interface using Kafka as a forecasting service; evaluation of MLFlow for model tracking and model registry
• Implementation of REST API using KeyCloak OAuth2 and OpenID (JWT)
• Monitoring: implementation of dashboards with Grafana, Prometheus, Mimir, Streamlit and Loki to monitor prediction metrics, GCP and Snowflake costs for pipelines, and system metrics
• Development of Copilot Agent Skills

• Consulting an NGO in the field of data center sustainability in publicly funded projects (BMUKN with NADIKI and Umweltbundesamt with SIEC)
• Development of Python APIs and web applications, deployment on AWS/ECS with Terraform
• Collecting power consumption metrics for servers, CPUs, GPUs running AI workloads
• Technologies used: AWS, EC2, ECS, Fargate, CloudMap, VPC, Route53, Lambda, EventBridge, CodeBuild/CodePipeline/CodeDeploy, Terraform, Docker, Linux, Bash scripting, Python, Flask, SQLAlchemy, SQL, MariaDB, InfluxDB, Telegraf, Prometheus, Zabbix, Kubernetes, Letsencrypt, certificate management

• Datastage 11.7, dbt, Oracle 19, Python 3.12 / PySpark 3.5, Azure GitHub, Azure DevOps, Automic
• Development of migration jobs to transfer data from the collection DWH to the new Risk Mart, as well as development of ETL pipelines to migrate historical data from the old Mart to the new Risk Mart.
• Storage of the silver layer on Hadoop and the gold layer in Oracle.
• Translation of DataStage jobs into dbt to publish reporting data in Google Cloud to a PostgreSQL database.
• Creation and optimization of complex SQL queries for data extraction from a data vault, taking into account historical data in the point-in-time tables.
• Creation of Oracle table definitions (DDL) and adjustment of existing stored procedures.
• Versioning changes in GitHub and deployment via the CI/CD portal.
• Refactoring long-running DataStage jobs into Python using PySpark to reduce server load.
• Migration of SAS scripts to PL/SQL, including new development of distribution functions that have no direct equivalent in Oracle.
• Development of Automic jobs to run DataStage pipelines and Python scripts (PySpark jobs) that control the population of the SME and institutional risk tables in the Risk Mart and perform business calculations.
• Participation in the agile process, including creating user stories, estimations, and planning in Azure DevOps.
• Handling Azure DevOps tickets and close collaboration with testers and business teams for error analysis and resolution.

• Designing new apps as well as enhancing and running 29 Angular apps for digital claims in an Nx monorepo
• Maintaining and improving a shared component library with ~300 libraries for multiple product teams
• Migrating all apps to a new design system including its component library and systematic refactoring
• Developing and maintaining the CI/CD pipelines (Jenkins, Azure DevOps, Terraform, AWS)
• Managing releases independently including branch handling, versioning, PR coordination and production deployment
• Implementing and maintaining tracking (Adobe Analytics)
• Ensuring accessibility according to BFSG/WCAG
• Test-driven development (TDD) with Jest and Cypress
• Code reviews, mentoring and setting up best practices in the team
• Technologies: TypeScript, Angular 16-20, RxJS, NgRx, Nx (Monorepo), npm, HTML, (S)CSS, Storybook, Jest, Cypress, Cucumber, Husky, Node.js, Git, AWS, Azure DevOps (Repos & Pipelines), Jenkins, Terraform, TDD, BFSG, WCAG, Nexus, IntelliJ, Adobe Analytics

• Designed, built, and maintained scalable ETL/ELT data pipelines using Python, SQL, REST APIs, AWS Lambda, S3, PostgreSQL RDS, EventBridge, CloudWatch, Docker, Apache Airflow, and BigQuery – integrating data from GA4, Google Ads, Meta Ads, CMS, CRM, newsletters, events, and B2C ordering systems into analytics-ready datasets.
• Built a cross-brand lakehouse architecture from AWS to BigQuery – transforming raw JSON/CSV data into structured, partitioned, and reusable reporting layers with staging, intermediate, canonical, and mart models.
• Designed relational and dimensional data models: 3NF staging models, star schemas, fact tables, dimension tables, daily KPI aggregates, and dashboard-optimized marts for marketing, content, subscription, event, CRM, and revenue analysis.
• Implemented production-grade data quality and pipeline reliability features: incremental loads, idempotent upserts, deduplication, schema validation, row matching, null checks, anomaly detection, freshness monitoring, logging, retries, and error alerts.
• Automated cross-brand reporting processes and data products – pipelines for 73 newsletter campaigns, 31 lead list syncs, 52 event partner reports, and a 500K-record company matching pipeline; reduced manual data preparation by approx. 70% and increased analyst productivity by approx. 30%.

• Concept creation and implementing AI Agents in AWS Cloud
• Continuously alignment with stakeholders
• Collaborate with DevOps
• Technologies: Git, CI/CD (GitHub Actions), Python/ML, Streamlit, Deno/typescript, AWS SAM, AWS Bedrock, AWS Lambda, AWS Dynamo DB, AWS S3, AWS Event Bridge etc.

• Test concept creation
• Creation of test processes
• Coordination of TC development: stress tests, functional tests, performance tests, high data rate tests, integration tests, etc.
• HW testing: FPGA, RF
• Test automation and regression tests
• Ensuring 24/7 operation of the test system
• Analysis & reporting
• Regular coordination of the test team, meetings with other stakeholders
• Communication and coordination with stakeholders and the project manager

• Mobile: Kotlin Multiplatform (KMP), Kotlin, Swift, SwiftUI, Jetpack Compose, Ktor, Room, Koin
• Backend: Spring Boot, GCP Cloud Run, GCP Load Balancer, GCP Eventarc
• Planned and developed a cloud backend architecture with Google Cloud Platform
• Developed a cross-platform architecture with Kotlin Multiplatform (KMP)
• Tech lead for comprehensive large project including webshop, two apps and omnichannel backend

• Co-authored enterprise cloud strategy including security and governance frameworks for 5 subsidiaries, and implemented part of the governance automation.
• Performed regular cloud cost optimization reviews across 10 teams resulting in ~20% cost reduction.
• Led the technology selection for the migration of in-house CIAM for 25M+ accounts to a SaaS solution, and worked with the product team through the migration.
• Supervised the technology selection and designed the architecture and delivery pipelines for the multi-tenant digital news and sports publishing platform, enabling ~250 editors within ~6 months of development start.
• Led the implementation of a multi-brand design system from idea and technical concept to implementation and rollout, enabling rapid UI prototyping for new products in a matter of hours.
• Managed a team of 4 architects and accelerated the professional growth of team members.
• Technologies: AWS cloud, Microservices, Docker, Python, Kafka, JavaScript, TypeScript, React.js, Node.js, GraphQL, REST, Gitlab CI, Visual Studio Code, git.

• Lead Architect to design and implement the data lake and ETL Pipeline using AWS Stack
• Performance Optimization of Data Ingestion of ETL Pipeline
• Development of Data Validation using Great Expectations
• Leading of the data migration for two sources exchanges
• Data Modeling in AWS Redshift

MLOps

• Model inference implementation by mlflow and AWS SageMaker
• Feature Engineering for the running ML Models ( Recommender Engineer, Clustering )
• Implementatino of Model Registry and artifactory using mlflow
• Historization an Profiling of the Input Data Using AWS Glue Crawler and AWS Data Catalog
• Feature importance using mlflow

Tech. Stack: Python 3, AWS Glue, AWS Step Fucntion, AWS Lambda, AWS EventBridge, AWS IAM Role, AWS SageMaker, AWS EC2, AWS Glue Crawler, AWS CloudWatch, MLFlow, ETL, Data lake, GitHub Action, Terraform, Jenkins, Ansible playbooks (Infrastructure as Code), CI/CD, GitLab, SQL, PySparkSCRUM, Agile, Jira, BigData, VSCode, DBeaver, MSSQL, MySQL, grafana, Docker, Linux, Bash, MapReduce, Data Modeling (ORM), Pandas, YAML, SQL-Alchemy

• Extended the document management system with a standard CMIS (Content Management Interoperability Services) interface
• Implemented CMIS core services like navigation, access rights, search, CRUD operations, and versioning in Java
• Implemented based on RESTful / OpenAPI services
• Delivered as a fat-jar and native container image
• Deployed on-premises and serverlessly as an Azure Container Application using Terraform
• Improved team autonomy through infrastructure engineering and short feedback loops
• Established observability with OpenTelemetry, Azure Monitor, and Azure Logic Apps
• Introduced Terraform and trunk-based development processes
• Ensured quality with BDD tests in C# using SpecFlow and Testcontainers
• Created Azure DevOps pipeline integration tests
• Introduced cloud deployment processes
• Trained staff in cloud and Terraform

• Building and maintaining an event-driven microservice architecture around Shopify
• Documenting with Confluence and IcePanel (C4)
• Using PHP 8.2, Symfony, Shopify, Bref, AWS, SQS, EventBridge, Cloud, DevOps, Datadog, Docker, Kubernetes, Jira, GitHub, Scrum, Kanban, PHPUnit, Prophecy and Swagger

• Developed automated ETL pipelines with AWS Glue and Athena to ensure consistent data quality and governance requirements
• Implemented validation, anonymization, and encryption measures for data in compliance with GDPR
• Optimized cloud costs by introducing FinOps practices and increased transparency for business units
• Monitored performance, performed root cause analyses, and ensured adherence to SLAs
• Supported data and solution architects in building scalable data models for ML and analytics scenarios