Infrastructure as Code Experts in Berlin

AI Platform Backend – Senior Developer

Hired to design and build an AI platform backend from the ground up, including multi-provider LLM orchestration and real-time infrastructure for AI influencer personas at scale.

Tasks and Responsibilities

• Architected and implemented a multi-LLM orchestration layer with Semantic Kernel to integrate GPT-4 and other providers for core platform logic and AI influencer personas, reducing model-switching overhead by abstracting provider APIs behind a unified interface.
• Designed and developed a backend from the ground up in C# / .NET 10, including domain modeling with DDD, a versioned RESTful API layer, and cloud infrastructure on Azure.
• Built real-time chat infrastructure with Server-Sent Events (SSE), message persistence, and delivery guarantees for running AI influencer personas live at scale.
• Developed a media management service with cloud object storage integration for uploading and retrieving influencer-generated content.
• Created an integration and unit test suite with data seeding for reliable regression testing across all core platform flows, significantly reducing the production error rate.

Tools and Technologies: C#, .NET, ASP.NET Core, Python, TypeScript, MySQL, Semantic Kernel, EF Core, Minimal APIs, LLM Orchestration, Prompt Engineering, Agentic AI, Generative AI, AI-Assisted Engineering, Claude Code, GitHub Copilot, Google Gemini, OpenAI API, Ollama, Redis, Azure, Azure Container Apps, Azure Database for MySQL, Docker, GitHub Actions, Clean Architecture, Vertical Slice Architecture, CQRS, Domain-Driven Design, REST API, xUnit, Integration Testing, Unit Testing, Jira, Confluence, Scrum

• Creation, maintenance and hardening of Kubernetes clusters employing Ansible and ArgoCD
• Keywords: Ansible, AWX, Kubernetes, NetApp, Prometheus, CI/CD ArgoCD, SSO, Fluent-bit, HAProxy, Calico, Keycloak, oauth2-proxy, SealedSecrets, kubeseal, Aqua kube-bench, CIS-Benchmarks, Aqua Trivy operator

• Azure Landing Zone architecture: Design and implement a hub-spoke, multi-region-capable Azure landing zone that provides the secure, scalable and highly available foundation for autonomous driving and parking data/ML platforms.
• Compliance through Azure Policy: Enforce security and compliance standards across Azure subscriptions via Azure Policy (guardrails, deny/audit/deploy-if-not-exists), consistently achieving top-tier infrastructure security scores.
• Infrastructure-as-Code: Automate provisioning and configuration of Azure resources with Terraform and Bicep, with changes delivered through reviewed CI/CD pipelines.
• Azure Databricks and Unity Catalog: Extensive experience operating Azure Databricks with Unity Catalog for centralized data governance, access control, lineage and auditing across workspaces.
• Monitoring and observability: Built and run infrastructure monitoring and logging with Azure Monitor, Prometheus, Grafana and Loki, covering platform health, alerting, troubleshooting and capacity trends.
• Platform at scale: Architected and operate cloud data/ML platforms supporting multi-PB vehicle data ingestion and simulation; orchestrate Argo Workflow-based recompute and autolabeling services scaling to 100k+ concurrent pods on AKS.
• Reproducible ML: Established reproducible training environments with dataset versioning and provenance tracking, enabling auditing and experiment reliability.
• Operational excellence: Automated GitHub organization management and CI/CD pipelines, improving developer productivity and deployment reliability; automated recurring operational processes.
• FinOps: Developed transparent resource utilization and cost-tracking for multi-project Azure environments.
• Leadership: Technical lead for infrastructure topics, collaborating with development, DevOps and security teams; technical interviewer and recruitment panel member for scaling the engineering team.

• Drive migration of enterprise authorization platform from Styra DAS to open-source OPA via Skipper (Zalando's Golang-based ingress proxy) integration
• Optimise k8s resources and integrate native Prometheus metrics with OPA
• Migrate from internal monitoring solution to Prometheus CRs + Dash0

Tech Stack: Java/Kotlin, Golang, Python, Spring Boot, AWS, Kubernetes, Docker, OpenTofu, Prometheus, Grafana

• Fractional leadership; consulting growth-stage startups and scale-ups on data strategy, ML products, and platform foundations
• Building decisioning systems for growth, personalization, & product experimentation, across e-Commerce, Digital Health, Energy, and Logistics
• Exploring Agentic AI & LLM-based tooling for production readiness patterns

• Codebase Evaluation & Problem Design: Designed and stress-tested complex software engineering problems against large open-source Python codebases (including pandas), requiring deep context acquisition and architectural understanding to produce well-scoped, realistic problem statements aligned to strict correctness guidelines.
• Agent Failure Analysis: Assessed LLM coding agent solutions for correctness and completeness, identifying meaningful failures across edge case handling, dtype behaviour, and multi-column NaN propagation logic; documented findings with precision for downstream evaluation use.
• Programmatic Test Suite Development: Authored comprehensive pytest suites to programmatically verify agent-generated solutions against defined requirements, with deliberate coverage of boundary conditions and failure modes not caught by naive implementations.
• Containerised Environment Engineering: Built and debugged Docker environments for reproducible agent execution, including git-based repository provisioning, dependency pinning with npm ci, and multi-stage Dockerfile authoring across Linux-based containers.

OpsWorker turns Kubernetes alerts into root-cause analyses, on top of the monitoring a team already runs. I lead the technical side: the agent architecture, the AWS infrastructure it runs on (fully inside EU regions), and the engineering decisions behind it, read-only in the cluster by default, human in the loop for judgment. The stack underneath: Amazon Bedrock and Bedrock AgentCore, agents built with the Strands Agents SDK, the Claude and OpenAI APIs, and the Kubernetes API.

• Developed a custom tool using the Mistral 7B LLM to scan, validate, and report security vulnerabilities.
• Security tested AI agents, bots, and other LLMs, focusing on prompt injection, model inversion, data poisoning, EDR/AV bypass and evasion techniques, membership inference, model evasion, overfitting to malicious inputs, and contextual manipulation.
• Onboarded repositories to SAST solutions for security scanning, implemented secrets scanning, DAST, and SCA, and used ZAP for DAST in CI/CD pipelines.
• Delivered security awareness training and developed CTF challenges and training materials to improve developers' security knowledge.
• Planned and carried out bi-annual red teaming operations based on the MITRE ATT&CK framework and led internal and external pentests based on the OWASP Top 10 framework for 70+ applications worldwide, resulting in the detection, reporting, and remediation of hundreds of vulnerabilities.
• Triaged HackerOne reports.

• Insurance service provider*

Challenge: Business-critical documents were processed through external OCR providers, with ongoing costs, dependency, and data privacy risks for sensitive insurance data.

Implementation:

• Architecture and production implementation of an on-premise OCR solution with full data ownership
• Methods for recognizing document structures as the basis for automated further processing
• ML-, NLP-, and LLM/VLM-based information extraction, especially from invoices and quotations

Success: Replaced external providers: full data ownership, GDPR-compliant processing, and 75% lower recurring OCR costs per year

Used technologies: Python, Docker, Microservices, FastAPI, PyTorch, Torchvision, MongoDB, MySQL

• Conducting cybersecurity readiness checks based on an in-house assessment methodology
• Analyzing the external attack surface using the Graydaxe EASM platform
• Assessing maturity levels and deriving prioritized recommendations for action

• Mentor team of 6 ML platform engineers through weekly 1:1s, technical design reviews, and best practices, improving team velocity by 35% through structured sprint planning and skill development programs
• Define 2025–2026 ML platform roadmap in collaboration with Data Science, Cloud Engineering, and Product teams, prioritizing automated model governance, cost attribution systems, and multi-environment deployment strategies
• Partner with Data Science, SRE, and Product stakeholders to align ML platform capabilities with business objectives, reducing data scientist deployment friction by 60% through self-service platforms
• Architect and deliver production-grade MLOps platform supporting 50+ models in production with automated promotion pipelines, versioning, and rollback capabilities, achieving 99.5% platform uptime SLA
• Design distributed ML pipeline architecture using Metaflow and Argo Workflows (Vertex Pipelines-compatible), reducing model training time by 30% and deployment cycles from 2 weeks to 3 days through full CI/CD automation
• Build containerized ML services on Kubernetes with auto-scaling policies, resource quotas, and multi-tenancy isolation, optimizing infrastructure costs by $180K annually (25% reduction)
• Implement monitoring, alerting, and performance tracking using Prometheus, Grafana, and custom instrumentation, reducing model debugging time by 50% and establishing model performance SLOs
• Lead development of RAG-based document intelligence platform using LangChain, LangGraph, and vector databases, implementing agentic AI workflows for automated financial document processing
• Implement Infrastructure-as-Code using Terraform for reproducible environment provisioning and GitOps workflows, reducing infrastructure drift incidents by 80%
• Design role-based access control for ML platform, implement model lineage tracking, and establish audit trails for regulatory compliance aligned with enterprise IAM best practices

• Developed and implemented organization-wide discovery framework based on Ulwick’s Outcome-Driven Innovation; enabled 7 Product Owners to systematically identify and quantify unrealized value through shared outcome language and opportunity scoring methodology
• Transformed Product Owner role from backlog clerks to strategic experimenters; established dedicated time budget for autonomous hypothesis testing and discovery activities
• Rebuilt customer journey maps to start at actual user need (tool selection phase) instead of platform entry point; eliminated manual data aggregation work previously done by project teams
• Implemented OKR framework across 4 product teams; defined quarterly objectives with measurable key results (e.g., 40% reduction in manual integration effort, self-service adoption increase)
• Unified 3 separate platform roadmaps through cross-team dependency mapping and shared service agreements
• Supported enterprise sales cycle with ROI modeling and technical due diligence for automotive and defense customers

• Built core parts of formae's infrastructure engine and cloud integrations in Go, managing resource lifecycles across cloud and Kubernetes environments.
• Designed and implemented an extensible plugin architecture and SDK for integrating infrastructure providers and resources, including AWS, Kubernetes and Helm.
• Built agent-native infrastructure workflows exposing formae through MCP to tools including Claude Code, Codex and Cursor.
• Worked directly with prospective customers on technical evaluations, implementation design and migration paths from existing infrastructure workflows to formae.
• Helped evolve formae through its open-source, multi-cloud and cloud platform releases, with a focus on reliable infrastructure orchestration and developer experience.