OpenSearch Consultant (m/f/d)

A company is looking for an experienced OpenSearch consultant who is responsible for the analysis, design and redesign of an existing OpenSearch platform. The focus is on developing a future-proof target architecture that supports the upcoming data center migration, without carrying out the migration or operational implementation itself. The consultant acts as a technical architect and sparring partner and provides solid decision-making foundations for the subsequent implementation.

The starting point is a very large, historically grown OpenSearch platform with clusters spread across more than two data centers, about 500 TB of storage and around 20,000 shards. The platform has complex data and index structures and places high demands on performance, availability, operational stability and cost control. The upcoming move is being deliberately used to identify and fix architectural weaknesses and inefficiencies.

Analysis of the current architecture:

• Assessment of the existing OpenSearch/Elasticsearch environment
• Analysis of cluster topology, shard and index strategies, data volumes and growth assumptions
• Identification of technical and structural debt
• Evaluation of operational and stability risks

Target architecture & redesign:

• Conceptualization of a scalable and high-performance target architecture
• Redesign of index and shard concepts as well as data models and structures
• Optimization of data and structural concepts with a focus on reduction potential
• Development of self-service mechanisms and cost transparency models
• Derivation of clear architecture and design principles

Design artifacts & handover:

• Documentation of the target architecture (logical & conceptual)
• Description of architecture variants including assessment of risks, assumptions and dependencies
• Recommendations for action for the subsequent implementation

• Know-how transfer to internal architecture and operations teams
• Several years of experience in designing and operating OpenSearch or Elasticsearch platforms
• Deep knowledge of architecture design, scaling large clusters and performance optimization
• Proven experience with very large and distributed environments
• Expertise in redesign and transformation processes
• Experience in critically evaluating historically grown architectures
• Ability to convert existing solutions into optimized target states
• Experience in contexts such as data center migration, platform modernization and technical consolidation