Observability Experts in Berlin

AI Platform Backend – Senior Developer

Brought in to design and build a backend for an AI platform from scratch, including multi-provider LLM orchestration and real-time infrastructure for AI influencer personas at scale.

Tasks and responsibilities

• Architected and implemented a multi-LLM orchestration layer with Semantic Kernel to integrate GPT-4 and other providers for core platform logic and AI influencer personas, reducing model-switching overhead by abstracting provider APIs behind a single interface.
• Designed and developed a backend from scratch in C# / .NET 10, including domain modeling with DDD, a versioned RESTful API layer, and cloud infrastructure setup on Azure.
• Built a real-time chat infrastructure with Server-Sent Events (SSE), message persistence, and delivery guarantees for live operation of AI influencer personas at scale.
• Developed a media management service with integration of cloud object storage for upload and retrieval of influencer-generated content.
• Created an integration and unit test suite with data seeding for reliable regression testing across all core platform flows, significantly reducing the production error rate.

Tools and technologies: C#, .NET, ASP.NET Core, Python, TypeScript, MySQL, Semantic Kernel, EF Core, Minimal APIs, LLM Orchestration, Prompt Engineering, Agentic AI, Generative AI, AI-Assisted Engineering, Claude Code, GitHub Copilot, Google Gemini, OpenAI API, Ollama, Redis, Azure, Azure Container Apps, Azure Database for MySQL, Docker, GitHub Actions, Clean Architecture, Vertical Slice Architecture, CQRS, Domain-Driven Design, REST API, xUnit, Integration Testing, Unit Testing, Jira, Confluence, Scrum

• Led migration to GCP using Terraform, GKE, and GitOps, improving deployment consistency and scalability
• Implemented Datadog observability stack via Terraform and datadog-operator
• Established automated end-to-end tests and on-call processes, improving incident response and service reliability
• Migrated from NGINX Ingress Controller to Kubernetes Gateway API (NGINX Gateway Fabric)
• Migrated stateful services (PostgreSQL and Redis) to GCP, improving scalability and operational reliability

• Support Authorization as a Service initiative for enterprise-scale authorization platform
• Incorporate comprehensive observability solutions into authorization infrastructure
• Provision and manage AWS infrastructure for authorization services
• Mentor development team on AWS and Kubernetes best practices
• Tech Stack: Java/Kotlin, Golang, Python, OPA, Spring Boot, AWS, Kubernetes, Terraform, ELK Stack, Prometheus, Grafana

• Fractional leadership; consulting growth-stage startups and scale-ups on data strategy, ML products, and platform foundations
• Building decisioning systems for growth, personalization, & product experimentation, across e-Commerce, Digital Health, Energy, and Logistics
• Exploring Agentic AI & LLM-based tooling for production readiness patterns

• Led development of 15+ microservices (Java 17, Spring Boot) driving customer interactions; migrated from on-prem to GCP Kubernetes, improving scalability and reducing infra cost by 20%.
• Optimized user services with CouchDB caching and API refactoring, cutting response times by 35% and enhancing customer experience.
• Implemented canary deployments, FluxCD GitOps, and CI/CD optimizations in GitLab, reducing release lead time by 25% and enabling zero-downtime rollouts.
• Set up Grafana health checks and Anodot alerts for latency, error, and throughput monitoring, reducing MTTR by 40%.
• Built secure APIs using OAuth2, DPoP, and Gatekeeper, integrated REST and GraphQL, and achieved 90%+ test coverage with unit and E2E tests.
• Mentored junior developers, promoted Agile best practices, and collaborated cross-functionally to deliver high-impact, reliable customer-facing features.

Enterprise AI content categorization and AI-powered web research.

• Built multi-LLM evaluation framework with annotated data
• Iterated LLM error rates based on annotated datasets
• Implemented AI-powered web research pipeline Stack: LLM, evals, OpenRouter, Python, Node.js, TypeScript, React

• Designed and implemented a hybrid recommendation system (content-based + collaborative filtering)
• Built end-to-end ML pipelines including data processing, feature engineering, model training, and evaluation
• Developed RAG-based LLM systems using LangChain and vector databases for semantic search and knowledge retrieval
• Established MLOps workflows with MLflow for experiment tracking, versioning, and deployment readiness
• Implemented deep learning models (computer vision & classification) using PyTorch and TensorFlow

• Developed and deployed microservices in Kotlin and Spring Boot, integrated AWS Secrets Manager to secure credentials and decreased network calls using Spring cache.
• Refactored Kafka consumer using Spring Kafka with semaphore-based backpressure to cap records and keep heap memory stable under spikes; switched to batch upserts to cut down on database invocations; added Testcontainers integration tests for Kafka and database to pave the way for future changes.
• Automated the financial reconciliation workflow in Spring Boot (Kotlin) using Spring Scheduler, transactional boundaries, JPA/Hibernate on MySQL, and Flyway migrations, saving the accounts team 16+ hours per week.
• Designed and dockerized payments end-to-end test framework in Robot (Python) with reusable keyword libraries and profiles; integrated with GitLab CI (JaCoCo XML and HTML reports) to accelerate releases and lift code coverage to 80%.
• Implemented end-to-end observability on Datadog by instrumenting services with Datadog APM, correlating metrics and logs, provisioning dashboards, and creating monitors with burn-rate alerts and anomalies to harden reliability and give stakeholders clear visibility.

OpsWorker turns Kubernetes alerts into root-cause analyses, on top of the monitoring a team already runs. I lead the technical side: the agent architecture, the AWS infrastructure it runs on (fully inside EU regions), and the engineering decisions behind it, read-only in the cluster by default, human in the loop for judgment. The stack underneath: Amazon Bedrock and Bedrock AgentCore, agents built with the Strands Agents SDK, the Claude and OpenAI APIs, and the Kubernetes API.

In a lean, execution-focused environment, I took ownership beyond a narrow engineering lane, shaping and implementing systems across backend, data, and infrastructure. Partnered directly with the three founders in a fast-moving, high-stakes environment, turning strategic priorities into concrete technical decisions and production outcomes.

• Owned core platform development across backend (Django/Rest Framework/Postgres), ETL (Python/Dagster), infrastructure (Terraform/Kubernetes/AWS), and frontend (typescript/react) for a climate-tech SaaS product, driving continuous cross-stack development across five repositories from October 2021 to this day.
• Architected and owned a standalone internal Python scoring framework for CRC assessments, using YAML-driven rules and metaprogramming to enable non-technical users to define complex evaluation logic without hardcoded implementations.
• Built and stabilized ETL and scraping pipelines using Dagster and Scrapfly, improving document ingestion, tagging, retry behavior, deployment flow, and operational resilience.
• Contributed to platform modernization and reliability through Django/Python upgrades, Postgres/RDS and EKS changes, CDN/TLS updates, test and performance improvements, and observability hardening.
• Drove backend engineering for product features, translating requirements into technical specifications, API contracts, data structures, and scalable implementation plans.

• Developed and implemented organization-wide discovery framework based on Ulwick’s Outcome-Driven Innovation; enabled 7 Product Owners to systematically identify and quantify unrealized value through shared outcome language and opportunity scoring methodology
• Transformed Product Owner role from backlog clerks to strategic experimenters; established dedicated time budget for autonomous hypothesis testing and discovery activities
• Rebuilt customer journey maps to start at actual user need (tool selection phase) instead of platform entry point; eliminated manual data aggregation work previously done by project teams
• Implemented OKR framework across 4 product teams; defined quarterly objectives with measurable key results (e.g., 40% reduction in manual integration effort, self-service adoption increase)
• Unified 3 separate platform roadmaps through cross-team dependency mapping and shared service agreements
• Supported enterprise sales cycle with ROI modeling and technical due diligence for automotive and defense customers

• Too Good To Throw (AI powered social impact webapp focused on reducing food waste in Nigeria):

• Integrated Paystack Split Payments to automatically route payments between the platform and partner vendors.

• Configured automated subaccount creation workflows so new businesses get a settlement account instantly.

• Setup a scalable cloud backend using Supabase.

• Implemented role-based access control (RBAC) for Users, Partners, and Admin.

• FaithFlow (AI powered webapp supporting Christian teens on their spiritual journey):

• Designed and implemented an AI-driven scripture search engine that interprets natural language questions and maps them to relevant Bible texts, commentary, devotionals, and cross-references.

• Designed a spiritual growth dashboard enabling users to track reading progress, prayer streaks, and devotional completion milestones.

• Elevated LLM output reliability by engineering domain-specific prompts and evaluation logic, improving reasoning consistency across production language model workflows.
• Designed advanced coding benchmarks and validated solutions to strengthen training and evaluation datasets, improving model performance on technical problem-solving tasks.
• Designed and implemented automated evaluation frameworks for technical reasoning tasks; optimized LLM output reliability by 15% through rigorous prompt engineering and rubric-based benchmarking.

• Shipped Memorable, a production iOS app using on-device CLIP-based semantic photo search. Owned the full stack: Core ML conversion, local inference pipeline, App Store release, and post-launch iteration.
• Built a practical AI deployment framework that covers workflow redesign, use-case prioritization, system integration, eval planning, and human-in-the-loop controls.
• Conducting AI use-case discovery and advisory conversations with professionals in legal, tax, and real estate sectors.