Web Scraping Experts in Germany

agentic-engineer.online is my publicly testable live demo and at the same time the platform where I show my work. Originally created as a recruitment trial task, I have since continued to run it as my own demo, learning, and product project — on a Hetzner VPS behind a Cloudflare tunnel, through a multi-stage AI-orchestrated deploy pipeline with snapshot rollback. If a deploy step breaks, the system falls back to the last clean snapshot, the script is adjusted, the test repeated — empirical, test-driven, without hand tuning.

• Technically behind it: Python and FastAPI, an OpenRouter model cascade, SQLite persistence, and Cloudflare edge tuning.
• I am the developer and the strictest customer of my own AI work in one person — what started as a prototype has become a tool I use every day and against which I test my own products.

• Use of AI tools (ChatGPT Pro, Google Gemini Plus, Claude Pro, Make.com Pro, n8n, Sora, Google Veo3, Octoparse Professional)
• Creation of high-quality sales pipelines in CRM Pipedrive
• Automated lead generation and qualification via web scraping and AI analysis
• Development of social selling and sales materials
• 56% lead-to-deal conversion; approx. €140k in own closings

• Managed and maintained daily sales and transaction data, ensuring data accuracy and integrity for operational reporting and analysis.
• Analyzed customer purchasing patterns to support inventory planning and improve product availability.

Re-platforming an e-commerce shop to a microservice architecture

• Goal: Replace an outdated Shopware system with a scalable, future-proof solution based on microservices and a headless architecture.
• Led a full architecture consulting process and defined the microservice boundaries based on a headless architecture with commercetools as PIM/OMS and Next.js as the frontend solution.
• Developed and integrated several decentralized services (e.g. internationalization, personalization).
• Took over the configuration of central third-party systems such as Contentstack and Algolia.
• Built a stable cloud infrastructure on Google Cloud with monitoring via Grafana.

Technologies: commercetools, Next.js, Contentstack, Algolia, Google Cloud, Grafana, TypeScript, Shopware

Development of an international e-commerce platform

• Goal: Build a high-performance, user-friendly and international e-commerce platform.
• Defined a scalable, high-performance and maintainable software architecture that served as the foundation for the platform's international expansion.
• Selected a best-of-breed technology stack that enabled the development of an industry-leading shop and reduced development effort for new features by 30%.
• Ensured seamless integration of critical third-party systems (PIM, CRM, ERP) to guarantee end-to-end business processes and a consistent data foundation.
• Implemented comprehensive tracking and analytics tools for continuous performance monitoring and optimization of the customer journey.

Technologies: React.js, Next.js, commerceTools, Algolia, Salesforce, Heroku, CI/CD, PHP, Google Analytics

AI-powered personalization and customer data platform in e-commerce

• Goal: Replace static content with a dynamic, AI-based personalization strategy to increase user relevance and automate marketing processes.
• Designed and built a customer data platform to aggregate and combine customer and analytics data from distributed sources.
• Implemented automated categorization of customer profiles as the basis for delivering personalized content and product recommendations in the Shopware frontend.
• Developed a semantic similarity algorithm based on Python and OpenAI to calculate product and content similarity from user profiles.
• Built the technical connection to retail media platforms to control external ad placements along the customer journey.

Technologies: Shopware 6, Python 3, OpenAI, Elasticsearch, PHP, Symfony, Twig

Shopware tracking & consent architecture (GDPR) for 4 online shops

• Goal: Build a unified, GDPR-compliant tracking infrastructure across multiple shops with central consent management across several Shopware instances.
• Defined a comprehensive tracking guide and developed a modular architecture compatible across multiple Shopware versions.
• GDPR-compliant integration of Usercentrics and Adobe Launch through a central tag manager.
• Full tracking setup (page, order, product, user) incl. partner-specific tracking (Emarsys, Channelpilot, etc.).
• Detailed event and error tracking to proactively identify technical drop-offs.

Technologies: Shopware, Adobe Analytics, Usercentrics, Tag Manager, PHP, MySQL, GDPR

AI/LLM search engine with RAG and hybrid search (Python, Elasticsearch)

• Goal: Build an AI-powered search engine with RAG architecture and hybrid search to accurately match service providers from over 500,000 company records.
• Developed an automated data pipeline (web scraping + LLM) that continuously crawls company data and converts it into structured formats using LLMs.
• Implemented a RAG workflow incl. vectorization for semantic search to increase search accuracy and relevance.
• Configured and fine-tuned Elasticsearch for hybrid search (vector + keyword search).
• End-to-end development of backend API, frontend and deployment on live servers.

Technologies: Python, FastAPI, Elasticsearch, LLM, RAG, React, Docker, Web Scraping

AI/computer vision system (Python, ML) – object detection under difficult conditions

• Goal: Develop an AI-powered recognition system with reliable performance even in rain, fog, snow and darkness.
• Built and annotated a large training dataset incl. difficult conditions.
• Trained a YOLO-based object detection model; carried out systematic error analysis and improved data quality and preprocessing.
• Coordinated with stakeholders through regular status updates.

Technologies: Python, Machine Learning, TensorFlow, PyTorch, YOLO, OpenCV

• Development of automated software tests (unit, integration, regression and end-to-end tests).
• Applied technologies: Playwright, Vitest, JavaScript, TypeScript, Vue3, Go, Laravel, REST API, CI/CD, Docker, Git, GitHub, Scrum, Jira.

• Building and scaling cloud infrastructure on GCP to support a SaaS platform for industrial clients
• Designing and implementing a data-driven DevOps pipeline for streamlined deployment and CI/CD workflows
• Collaborating with Data Science team on MLOps workflow to automate integrated retraining

• Architected and built a GenAI-based automated asset-generation tool for social media campaigns using Nano Banana and Python. It takes a campaign brief, target audience, and two products as input, generates optimized prompts for image and text creation, and uses functions for text positioning, visually appealing overlays, resizing, and structured uploads to AWS S3.
• Engineered and built a multi-agent news intelligence platform with specialized roles including retriever agents (Tavily web scraping), synthesizer agents, and Claude as curator/orchestrator, designing autonomous agent collaboration patterns using LangChain and RAG.
• Built an autonomous customer service agent using n8n and LLMs, delivering end-to-end support automation with transparent reasoning, governance controls, and scalable workflow orchestration using Python and vector databases.
• Developed a financial validation engine featuring ML-powered anomaly detection for invoice plausibility, compliance automation, and risk mitigation using TensorFlow and SQL.
• Created a cost optimization application using OCR, AI, Pandas, and NumPy for data analysis to identify cost optimization potential.

• Led comprehensive AI workshops for professionals, focusing on AI-driven process automation.
• Tech Stack: n8n, Make, LLMs (OpenAI, Anthropic), Prompt Engineering, Process Mapping Tools.

• Further development and release support for a white-label ePA component for health insurance companies
• Technologies: Android (Kotlin), Kotlin Multiplatform, Coroutines, Jetpack Compose, MVVM, StateFlow, Gradle, ProGuard

• Further training to become a certified AI expert in the company
• Fundamentals of AI
• AI tools
• Prompt engineering (creation of professional prompts)
• (Advanced) Process automation with AI and make.com
• AI in marketing and sales
• Legally compliant use of AI in companies
• Intelligent knowledge management
• AI in customer management
• Developing AI guidelines for the company
• AI integration into the company

• Led the vision, strategy, and roadmap for the Analytics and Data Visualization module of a Reputation Management platform for hotels, restaurants, and points of interest, resulting in increased user engagement.
• Conducted 10-15 experiments and A/B tests per month to validate hypotheses through user feedback and data-driven insights to improve adoption, engagement and iteratively enhance product features.
• Defined product specifications with clear requirements (Jobs to Be Done, user stories), user flows, and AI-generated prototypes, while establishing accuracy, precision, and recall benchmarks for LLM models.
• Collaborated with the product trio to apply web scraping, embedded BI, and RAG techniques, enhancing sentiment analysis and expanding the product into new verticals (restaurants, points of interest).
• Developed go-to-market strategies and utilized Ring Deployment framework to launch product features.
• Applied the WSJF framework to manage the product backlog, ensuring development efforts aligned with business goals and stakeholder priorities.
• Effectively communicated product strategy and results to C-level executives, securing buy-in for critical initiatives.
• Employed Opportunity Solution Tree model to identify opportunities, refining product strategy accordingly.

• Pioneer work in personalized AI: development of a framework for “Interactive Content” (RAG) for novels, lectures, expert debriefing
• Successful launch of Einbug, the Pantopia chatbot, with media resonance (SZ interview)
• Creation of compelling AI personalities: AI blog ([link]), 100% personalized learning environments, Perry Rhodan, and others.

• Development & deployment of an interactive dashboard that allows users to select datasets for visual analysis.

• The application supports filters, AI-based interpretations, and a chatbot for user interactions.

• shiny, openai, mirai, plotly, mapgl, duckdb, AWS, ShinyProxy, Docker Swarm

• Set up and operated data-driven analysis and reporting processes in Power BI, Tableau, and SAP

• Integrated SAP FICO and Workday data into Power Platform workflows to automate HR reports

• Developed predictive ML models for workforce planning and KPI management

• Used Azure and GCP (BigQuery, Dataflow) to process large data volumes (Big Data pipelines)

• Automated reporting increased analysis efficiency by 40%

• Introduced a GCP-based analysis model for employee turnover