OpenSearch Consultant (m/f/d)

A company is looking for an experienced OpenSearch consultant who will be responsible for analyzing, designing, and re-designing an existing OpenSearch platform. The focus is on developing a future-ready target architecture that supports the upcoming data center migration, without handling the migration or operational implementation itself. The consultant acts as a technical architect and sparring partner, providing solid decision-making foundations for the subsequent implementation.

The starting point is a very large, historically grown OpenSearch platform with clusters spread across more than two data centers, about 500 TB of storage, and around 20,000 shards. The platform features complex data and index structures and demands high performance, availability, operational stability, and cost control. The upcoming move is used intentionally to identify and fix architectural weaknesses and inefficiencies.

Analysis of the current architecture:

• Assessment of the existing OpenSearch/Elasticsearch environment
• Analysis of cluster topology, shard and index strategies, data volumes, and growth assumptions
• Identification of technical and structural debt
• Evaluation of operational and stability risks

Target architecture & re-design:

• Conceptualization of a scalable and high-performance target architecture
• Re-design of index and shard concepts as well as data models and structures
• Optimization of data and structural concepts with a focus on reduction potentials
• Development of self-service mechanisms and cost transparency models
• Derivation of clear architecture and design principles

Design artifacts & handover:

• Documentation of the target architecture (logical & conceptual)
• Description of architecture variants including evaluation of risks, assumptions, and dependencies
• Recommendations for the later implementation

• Transfer of know-how to internal architecture and operations teams
• Several years of experience in designing and operating OpenSearch or Elasticsearch platforms
• Deep knowledge in architecture design, scaling large clusters, and performance optimization
• Proven experience with very large and distributed environments
• Expertise in re-design and transformation processes
• Experience in critically assessing historically grown architectures
• Ability to translate existing solutions into optimized target designs
• Experience in contexts such as data center migration, platform modernization, and technical consolidation