OpenTelemetry Experts in Berlin

AI Platform Backend – Senior Developer

Brought in to design and build a backend for an AI platform from scratch, including multi-provider LLM orchestration and real-time infrastructure for AI influencer personas at scale.

Tasks and responsibilities

• Architecture and implementation of a multi-LLM orchestration layer with Semantic Kernel to integrate GPT-4 and other providers for core platform logic and AI influencer personas, reducing model-switching overhead by abstracting provider APIs behind a single interface.
• Design and development of a backend from scratch in C# / .NET 10, including domain modeling with DDD, a versioned RESTful API layer, and cloud infrastructure setup on Azure.
• Built a real-time chat infrastructure with Server-Sent Events (SSE), message persistence, and delivery guarantees for live operation of AI influencer personas at scale.
• Developed a media management service with integration of cloud object storage for upload and retrieval of influencer-generated content.
• Created an integration and unit test suite with data seeding for reliable regression testing across all core platform flows, significantly reducing production error rates.

Tools and technologies: C#, .NET, ASP.NET Core, Python, TypeScript, MySQL, Semantic Kernel, EF Core, Minimal APIs, LLM Orchestration, Prompt Engineering, Agentic AI, Generative AI, AI-Assisted Engineering, Claude Code, GitHub Copilot, Google Gemini, OpenAI API, Ollama, Redis, Azure, Azure Container Apps, Azure Database for MySQL, Docker, GitHub Actions, Clean Architecture, Vertical Slice Architecture, CQRS, Domain-Driven Design, REST API, xUnit, Integration Testing, Unit Testing, Jira, Confluence, Scrum

• Acted as technical consultant to optimize multi-layer ensemble models combining ResNet, CNN-BiGRU-Attention, and XGBoost.
• Guided implementation of a Logistic Regression meta-learner to solve class imbalance problems, achieving 92.86% accuracy and 0.9644 AUC on PTB-XL and Chapman-Shaoxing datasets.

• Bootstrapping a CloudOps team and building a multi-cloud provider backend for a low-code Internal Developer Platform (IDP) with env zero

• Introducing user story mapping, ADRs, milestones, and backlog management

• Designing and developing core APIs, setting up CI/CD pipelines, OpenTofu/Terraform scripts

• Representing and communicating the team with third-party stakeholders (e.g. env zero)

• (Cross-)team coaching on DevOps, software design, Terraform, Golang, and agile practices

Java 21 · Spring Boot 3 · Keycloak · PostgreSQL · Docker · Nginx · GitHub Actions · DigitalOcean · React 18 · TypeScript · Plasmo

• Architected and shipped a production-ready Job Application Tracker end-to-end: REST API with 5-stage workflow, pagination, sorting, and dynamic filtering — full ownership from design to live cloud deployment on DigitalOcean.
• Implemented production-grade identity management: OAuth 2.0 / OpenID Connect / JWT / RBAC via Keycloak, applying Hexagonal Architecture and DDD principles.
• Built automated CI/CD pipeline (GitHub Actions); containerised with Docker; Nginx reverse proxy with path-based routing and SSL termination.
• Developed a Chrome Extension (Plasmo framework, Manifest V3) that auto-fills job applications directly from LinkedIn into the tracker — demonstrates full product thinking across backend API and browser client.

• Leading the setup of Passify’s internal automation and risk management portal, connecting workflows across teams through SharePoint and Power Automate.
• Moderating retrospective workshops and creating PRDs and design tickets during PDLC.
• Supporting ISO 27001 documentation and compliance, focusing on customer support, user registration, and internal communication processes.
• Helping align design, development, and operations in a modular design cycle, ensuring each release meets both business and user needs.
• Contributing to feature planning and validation for subcontractor flows, training dashboards, and terminal portal improvements.

• Leading the product lifecycle for sovereign AI platform and operating system teams for enterprise & government clients and internal stakeholders (infra, solution delivery, support, revenue)
• Built and scaled the platform from a 200-user beta to a full rollout of 70K+ members at the Bundesagentur für Arbeit (BA), secured with ISO 42001 and EU AI Act compliance
• Architected the shift to a multi-tenant shared inference, increasing GPU cluster utilization from 20% to 85% and reducing infrastructure cost-to-serve by 40% for SaaS clients
• Shipped model quantization, allowing clients to run advanced LLMs on legacy hardware (A100s GPUs) instead of the H100s, saving upwards of 70% cost per enquiry
• Abstracted complex Helm configurations into a dynamic model manager, reducing the time to install or swap models by ~80%
• Killed an expensive move to build own dashboard service, pivoting to an API-first data strategy that clients can consume directly and saving €100Ks in opex and capex
• Built a safety-first agent marketplace and control plane lighthouse project for a Tier-1 bank, allowing internal teams to deploy autonomous agents within strict regulatory guardrails