DevOps Experts in Berlin

Driving AI model quality at scale — evaluating prompt-response accuracy, flagging edge cases, and maintaining SLA-compliant workflows across distributed global teams.

• Analyse AI prompts and side-by-side model outputs to assess response quality, factual accuracy, relevance, consistency, and compliance with project evaluation guidelines.
• Perform fact-checking, data validation, troubleshooting, issue identification, and edge-case review to improve quality standards across AI training support workflows.
• Use Google Sheets, Google Docs, and browser-based tools to document findings, maintain evaluation logs, track issue patterns, and support workflow optimisation in a remote environment.
• Create clear written justifications, review summaries, and KPI-oriented reporting focused on accuracy, turnaround time, documentation completeness, defect identification rate, and SLA adherence.

• Architected and deployed private cloud data platform on VMware vSphere, integrating Greenplum MPP, Apache Kafka, Kubernetes, and Apache Solr, and developed real-time ingestion pipelines with Kafka Connect and Schema Registry.
• Led Oracle Exadata to Greenplum migration, rearchitected data models, optimized storage, implemented RabbitMQ with Debezium for CDC, and deployed VectorDB for Generative AI.
• Designed and executed multi-cloud migration PoC across AWS, Azure, and GCP, defined KPIs for throughput, latency, and cost efficiency, executed bulk data transfers, validated analytics and streaming workloads, and delivered full-scale architecture recommendations.
• Assessed legacy on-premises infrastructure and designed modern cloud-native data platforms using Greenplum and containerized microservices, advising on scalability, disaster recovery, and high-availability.

• Own full-stack development of an AI-native enterprise platform built on TypeScript, React, Vite, tRPC, Hono, and PostgreSQL, delivering AI-powered consulting workflows to B2B clients.
• Designed and shipped a multi-agent AI system using ReAct framework and Claude skills-style workflow patterns, including an intelligent PM assistant with rich system prompts, slash commands, tool integrations, and streaming chat UI.
• Architected an LLM evaluation framework: rubric-based LLM-as-judge, golden datasets, regression testing, and automated quality gating — ensuring consistent AI output quality at scale.
• Integrated LangFuse for end-to-end LLM tracing, conversation replays, and evaluation pipelines, enabling data-driven prompt optimisation that reduced token costs and response variance.
• Built with Drizzle ORM, pgvector, and knowledge graphs for structured data access, semantic search, and relationship-aware AI reasoning across the platform.
• Led TanStack React Query migration across the application — replacing manual state management with centralised caching and automatic refetching, reducing data-fetching boilerplate significantly.
• Practiced AI-native development throughout: Claude Code, Codex, Perplexity SDK, and LLM-assisted testing across the full development lifecycle. Deployed on Vercel + Azure ACA with Biome for linting/formatting.

• Designed, built, and launched an internal event planning web application used by over 100 department leads for a large event, despite having no dedicated testing phase.

• Ensured smooth, failure-free operation during first production use, leading to the tool being adopted for future events.

• Automated catering calculations and related workflows, significantly reducing email communication and manual computation effort for meal planning.

• Managed deployment and hosting on a Linux server using Coolify, including application setup and runtime operations.

• Hired and guided a communication designer on UX while independently owning all technical decisions and implementation.

• Led the end-to-end delivery of enterprise full-stack web applications by driving requirement analysis, solution design, frontend and backend development, database design, API integration, code reviews, team coordination, Agile execution, CI/CD deployments, production support, performance optimization, security implementation, and stakeholder collaboration to deliver scalable, high-quality software solutions.

• Mentor team of 6 ML platform engineers through weekly 1:1s, technical design reviews, and best practices, improving team velocity by 35% through structured sprint planning and skill development programs
• Define 2025–2026 ML platform roadmap in collaboration with Data Science, Cloud Engineering, and Product teams, prioritizing automated model governance, cost attribution systems, and multi-environment deployment strategies
• Partner with Data Science, SRE, and Product stakeholders to align ML platform capabilities with business objectives, reducing data scientist deployment friction by 60% through self-service platforms
• Architect and deliver production-grade MLOps platform supporting 50+ models in production with automated promotion pipelines, versioning, and rollback capabilities, achieving 99.5% platform uptime SLA
• Design distributed ML pipeline architecture using Metaflow and Argo Workflows (Vertex Pipelines-compatible), reducing model training time by 30% and deployment cycles from 2 weeks to 3 days through full CI/CD automation
• Build containerized ML services on Kubernetes with auto-scaling policies, resource quotas, and multi-tenancy isolation, optimizing infrastructure costs by $180K annually (25% reduction)
• Implement monitoring, alerting, and performance tracking using Prometheus, Grafana, and custom instrumentation, reducing model debugging time by 50% and establishing model performance SLOs
• Lead development of RAG-based document intelligence platform using LangChain, LangGraph, and vector databases, implementing agentic AI workflows for automated financial document processing
• Implement Infrastructure-as-Code using Terraform for reproducible environment provisioning and GitOps workflows, reducing infrastructure drift incidents by 80%
• Design role-based access control for ML platform, implement model lineage tracking, and establish audit trails for regulatory compliance aligned with enterprise IAM best practices

• Responsibilities:
• Collaborate with Product Owner to define functional and technical requirements
• Quarterly Roadmap definition with Executives and Product Owner
• Fix bug and develop new features in Go and Typescript
• Manage and mentor full stack engineering team
• System Design in a micro-service environment
• Guarantee application security
• Improve engineering efficiency and deliverable quality
• Support automation with agentic-AI workflow
• Achievements:
• Improved security and data privacy awareness in the team with workshops around best practices, security measures and attacks types
• Conceptualized, designed and successfully released a new real-time chat application for our partners improving partner/company relationship and collaboration efficiency in Go and Typescript
• Reduced meeting hours for engineers by restructuring projects preparation workflow in collaboration with product team

• Led the end-to-end transformation of a 125+-person development organization, driving full operational integration into the Aviv Group within nine months
• Overhauled finance, HR, IT, and facilities by establishing scalable frameworks and modern governance models
• Introduced structured budgeting and cashflow processes, job leveling, and compensation frameworks to build transparency, accountability, and sustainable growth
• Implemented complete financial restructuring with a strategic budgeting process aligned to group objectives
• Re-engineered and operationalized HR functions, establishing modern talent management and organizational development processes
• Formalized nearshore vendor management by fully integrating partners and processes into Aviv Group’s operational framework
• Scaled IT infrastructure and support capabilities, significantly extending helpdesk services
• Instituted clear on-call and overtime regulations for nearshore partners to enhance service reliability and cost predictability
• Directed facilities and real estate management to ensure productive and efficient work environments
• Achieved a cohesive and accountable subsidiary fully aligned with Aviv’s strategy

AI Platform Backend – Senior Developer

Brought in to design and build a backend for an AI platform from scratch, including multi-provider LLM orchestration and real-time infrastructure for AI influencer personas at scale.

Tasks and responsibilities

• Architected and implemented a multi-LLM orchestration layer with Semantic Kernel to integrate GPT-4 and other providers for core platform logic and AI influencer personas, reducing model-switching overhead by abstracting provider APIs behind a single interface.
• Designed and developed a backend from scratch in C# / .NET 10, including domain modeling with DDD, a versioned RESTful API layer, and cloud infrastructure setup on Azure.
• Built a real-time chat infrastructure with Server-Sent Events (SSE), message persistence, and delivery guarantees for live operation of AI influencer personas at scale.
• Developed a media management service with integration of cloud object storage for upload and retrieval of influencer-generated content.
• Created an integration and unit test suite with data seeding for reliable regression testing across all core platform flows, significantly reducing the production error rate.

Tools and technologies: C#, .NET, ASP.NET Core, Python, TypeScript, MySQL, Semantic Kernel, EF Core, Minimal APIs, LLM Orchestration, Prompt Engineering, Agentic AI, Generative AI, AI-Assisted Engineering, Claude Code, GitHub Copilot, Google Gemini, OpenAI API, Ollama, Redis, Azure, Azure Container Apps, Azure Database for MySQL, Docker, GitHub Actions, Clean Architecture, Vertical Slice Architecture, CQRS, Domain-Driven Design, REST API, xUnit, Integration Testing, Unit Testing, Jira, Confluence, Scrum

• Led migration to GCP using Terraform, GKE, and GitOps, improving deployment consistency and scalability
• Implemented Datadog observability stack via Terraform and datadog-operator
• Established automated end-to-end tests and on-call processes, improving incident response and service reliability
• Migrated from NGINX Ingress Controller to Kubernetes Gateway API (NGINX Gateway Fabric)
• Migrated stateful services (PostgreSQL and Redis) to GCP, improving scalability and operational reliability

• Converts natural language into JQL using RAG and pgvector. Returns structured JSON with a query, chart spec, and plain-text answer. A two-stage router answers general questions without touching the JQL pipeline at all.
• Interchangeable LLM backends: Ollama, vLLM, Groq, Anthropic Claude, AWS Bedrock - switchable at runtime, no code changes. Self-healing JQL: on Jira validation failure, feeds error back to LLM, retries up to 4 times. OCI Vault for secrets. Deployed on Oracle Cloud A1 with GPU inference over Tailscale private network. Open source.

• Support Authorization as a Service initiative for enterprise-scale authorization platform
• Incorporate comprehensive observability solutions into authorization infrastructure
• Provision and manage AWS infrastructure for authorization services
• Mentor development team on AWS and Kubernetes best practices
• Tech Stack: Java/Kotlin, Golang, Python, OPA, Spring Boot, AWS, Kubernetes, Terraform, ELK Stack, Prometheus, Grafana

• Delivered a new notifications platform implementation built from scratch to replace existing and upcoming services
• Collaborating with other teams to integrate more domains

Tech stack:

• Data: Scala 3, Apache Kafka, Python, Airflow, Astronomer
• BE-FE: TypeScript, NestJS, Java, Spring Boot, Vue
• Dev-ops: AWS, PostgreSQL, Docker, GitHub Actions, Kubernetes, Helm, ArgoCD

• Designed and implemented a hybrid recommendation system (content-based + collaborative filtering)
• Built end-to-end ML pipelines including data processing, feature engineering, model training, and evaluation
• Developed RAG-based LLM systems using LangChain and vector databases for semantic search and knowledge retrieval
• Established MLOps workflows with MLflow for experiment tracking, versioning, and deployment readiness
• Implemented deep learning models (computer vision & classification) using PyTorch and TensorFlow