Open WebUI Experts in Germany

• Situation: Increasing demand for privacy-compliant AI solutions for clients in the KRITIS and mid-market sector that need to analyze sensitive media content (audio, video, documents) without sending data to public cloud LLMs.

• Task: Design, deployment, and secure operation of a fully self-hosted AI infrastructure including a custom-built digital management platform for automated media analysis.

• Action: Architected and implemented a multi-tier platform on hardened Proxmox infrastructure with frontend (Nuxt 3, Vue 3, TypeScript, Tailwind 4), backend (Laravel 13, PHP 8.4, Sanctum), data storage (PostgreSQL 16, MongoDB 7), caching/queuing (Redis 7, Laravel Queue), AI workers (Python 3.11, Whisper, DeepFace, Librosa), scheduling (Laravel Scheduler/Cron), and local LLMs (Gemma, DeepSeek, Qwen, Mistral, LLaMA, Phi) via OpenWebUI with segmented network access, API hardening, and audit logging following BSI recommendations.

• Result: Fully GDPR-compliant, on-premises AI platform with zero data leakage to third parties.

• Task: Overall responsibility as an external Head of Cyber Security / CISO-as-a-Service for the design, implementation, and continuous improvement of ISMS according to ISO 27001, BSI IT-Grundschutz, and NIS2.

• Action: Built and managed Cyber Defense Centers (CDC) with SOC operations, integrated SIEM solutions (Splunk, Graylog), established risk-based vulnerability management (Qualys, Nessus, OpenVAS), and conducted regular infrastructure, application, and physical penetration tests.

• Result: Audit-ready ISMS for multiple clients and a 60% reduction in critical vulnerabilities within 90 days.

• Task: Design and execution of NIS2 assessments and operational roll-out plans for KRITIS operators.

• Action: Developed an online assessment tool for automated identification of individual weakness profiles, implemented ISMS optimizations, penetration testing, awareness programs, GRC suite deployment, and delivered C-level presentations.

• Result: Accelerated the consulting process by 50% and successfully prepared multiple clients for NIS2 compliance.

• Task: Incident commander for crisis response, forensics, and business recovery in ransomware attacks and APT campaigns.

• Action: Coordinated with state and federal police (LKA, BKA), performed forensic analysis (OSForensics, Wireshark, Kali Linux), executed disaster recovery and BCM strategies, and developed BTC extortion response strategies.

• Result: 100% recovery rate within defined RTO windows and sustainable post-incident security architectures.

• Action: Planned, built, and operated a hardened multi-VM infrastructure (Proxmox, 15+ VMs) with web and mail servers, Graylog, OPNsense firewalls, CRM/ERP and LLM instances, network segmentation, DDoS mitigation, automated patch management, and backup strategies.

• Result: >99.5% uptime over 20+ years and zero compromises.

• Action: Designed coordinated phishing campaigns with five levels of difficulty, developed e-trainings and webinars in a PDCA cycle, and led red and blue teams.

• Result: Phishing click rate reduced from 35% to under 5% within three campaign cycles.

Technologies: n8n, Notion, OpenAI API, Claude, MS AI Foundry, MS CoPilot Studio, MS CoPilot, LLM, Node.js, Vercel, LangGraph, PostgreSQL, pgEdge, pgvector, Docker, LangChain, Ollama, Open WebUI

• Continuous evaluation and prioritization of internal automation needs
• ~20 AI agents in active use: research, content pipelines, document processing
• 5 n8n workflows for automated data and process control
• Architecture built on the same principles as in customer projects: state management, event-driven orchestration, API integration
• Ongoing operation and further development

• Acted as technical consultant to optimize multi-layer ensemble models combining ResNet, CNN-BiGRU-Attention, and XGBoost.
• Guided implementation of a Logistic Regression meta-learner to solve class imbalance problems, achieving 92.86% accuracy and 0.9644 AUC on PTB-XL and Chapman-Shaoxing datasets.

AI-driven automation of purchasing on a printing company's website, including selecting delivery times, order options, ordering, payment, and uploading print data from the Lumiz Cloud.

• Provision Kubernetes infrastructure on Azure, GCP, or bare-metal at the hosting provider
• Design and implementation of REST and GraphQL APIs
• Cloud governance (cost, compliance, security)
• Infrastructure-as-Code and CI/CD as code (Terraform, Ansible)
• Container technologies (Docker, Helm)
• Maintain and improve CI/CD pipelines (GitLab CI, GitHub Actions), Argo CD
• Deployment, scaling, and monitoring of microservices
• Distributed event streaming (Kafka)
• Message brokers RabbitMQ, MQTT
• Software development from scratch or further development of existing projects using PHP, Python, Go, C#, and Bash

• Vram.run: Rust, TypeScript, HF Inference API with 19 providers, 220+ HW configs, and 30+ cloud GPUs. Search a model to see which API providers serve it, which GPUs can run it locally (and how fast), and what cloud rental would cost. Or search your hardware and see what fits. Also includes a Rust CLI.
• Psychotron: JavaScript, Web Audio API, AudioWorklet, Canvas 2D. Front-end for flash fiction audiobook with Web Audio DSP chain featuring pitch-shifting, 12-voice chorus, flanger, 13-band EQ, and convolver reverb. Includes a 2D canvas effect morphing engine and synchronized teleprompter.
• RecentWork: Swift, macOS, FSEvents, launchd. macOS daemon that watches project directories and maintains a flat folder of symlinks to recently modified files. Homebrew installable.
• Mini-llm: Bash, macOS, launchd, Ollama, llama.cpp, MLX, Open WebUI. Single command that turns a Mac Mini into a headless AI server.
• ThatSlop: JavaScript. Chrome/Firefox extension for AI content detection on LinkedIn and Twitter.
• Smux: Bash, tmux. Human-friendly tmux wrapper that is Homebrew installable.
• Learn Rust Course: Rust. Course on Rust’s memory model for C++ programmers, written from experience of transitioning from C++ to Rust at Irreducible.

• Pioneer work in personalized AI: development of a framework for “Interactive Content” (RAG) for novels, lectures, expert debriefing
• Successful launch of Einbug, the Pantopia chatbot, with media resonance (SZ interview)
• Creation of compelling AI personalities: AI blog ([link]), 100% personalized learning environments, Perry Rhodan, and others.

• Pilot testing local AI environments to explore local AI use cases and cloud-based AI solutions
• Evaluation of AI tools and techniques
• Use of local AI tools with own data sovereignty
• Prompt engineering
• Creation of example environments for speech-to-text, text-to-speech, text-to-image, text-to-video, and image-to-video

Tools: Grok, Perplexity, ChatGPT, Elevenlabs, Github, Ollama, HuggingFace, Open WebUI, Faster Whisper, LibreTranslate, WSL, Docker Desktop, Shotcut, Audacity, Sound eXchange, Ffmpeg, Coqui TTS, Pinokio, Stable Diffusion Web UI, ComfyUI, OWL, Void Editor

• Design and implementation of a solution for managing projects, materials, and assets in field operations
• Development of a modern web application (Blazor) for project managers to track inventory, plan demand, and issue transport and purchase orders
• Delivery of a mobile MAUI app for field staff to store and retrieve materials with location-based photo documentation in map views
• Control of the full business logic through a central API
• Tech stack: .NET 9, C#, WebAPI, Blazor, MAUI, REST, PostgreSQL, Entity Framework, Docker, Docker Compose, Ansible, Keycloak, Aspire
• Identity and access management with Keycloak
• Deployment and orchestration via Docker Compose and Ansible
• Project in testing and evaluation phase

• Further training in Snowflake and Google Looker
• Working with LLMs: local models (Llama, Mistral, Gemma, Phi, Qwen, DeepSeek, Bitnet, Flux, Whisper), OpenAI API, frontends (ollama, openwebui, loacalai)
• Inference methods: llama.cpp, vLLM, transformer
• Quantization, benchmarking, prompting
• LLM Agents (Tool/Function Calling, LangChain, LangGraph, MCP)
• Topics: attention, reasoning, chain of thoughts, RAG, GraphRAG, mlflow
• Cloud hosted: ChatGPT, Claude, Gemini