Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Day 1: Core Foundations, Architectural Overview, and Technical Distinctions (ELK vs. OpenSearch)
Morning Session: Fundamental Concepts & Architectural Review
- Introduction & Historical Context:
- Tracing the origins of the ELK Stack (Elasticsearch, Logstash, Kibana)
- The 2021 divergence: Rationale behind OpenSearch (AWS vs. Elastic licensing changes, Apache 2.0 vs. SSPL/Elastic License) - Under the Hood (Shared Heritage):
- Apache Lucene core engine: Shards, segments, inverted indices, and document storage mechanisms
- Distributed cluster architecture: Node roles (Master, Data, Coordinator), cluster formation, and state management
- Fundamentals of Data Ingestion and Processing:
- Logstash pipelines, Beats, and contemporary alternatives (Fluentbit, OpenTelemetry/Data Prepper)
Afternoon Session: Feature Divergence & Ecosystem Variations
- Security & Enterprise Capabilities Comparison:
- Elasticsearch: Limitations of free-tier security versus premium features (SSO, advanced alerting, machine learning, cross-cluster replication tiers)
- OpenSearch: Comprehensive free fine-grained access control, integrated user database, SAML/LDAP integration, and native security plugins - User Interfaces & Query Languages:
- Kibana vs. OpenSearch Dashboards: Comparative analysis of interface layouts, administrative tools, and developer workflows
- Query Syntax: Elasticsearch's ES|QL compared to OpenSearch's PPL (Piped Processing Language) and SQL capabilities - Advanced Workloads (Vector Search & AI):
- HNSW implementations, k-NN search efficiency, and approaches to machine learning integration.
Day 2: Installation, Migration Pathways, Operational Management, and Diagnostic Techniques
Morning Session: Installation & Cluster Configuration
- Deploying OpenSearch:
- System prerequisites, kernel adjustments (vm.max_map_count), and JVM heap optimization
- Installation on bare-metal/VM environments via tarball or package managers
- Containerized deployment leveraging Docker and Docker Compose
- Multi-node cluster initialization and security plugin setup (opensearch-security-install) - Configuring OpenSearch Dashboards:
- Establishing connectivity between Dashboards and the OpenSearch cluster
- Configuring SSL/TLS certificates and authentication mechanisms
Afternoon Session: Migration Pathways, Operations & Best Practices
- Migration Strategies (ELK to OpenSearch):
- Evaluating current ES version compatibility (optimal migration paths from pre-7.10/7.11 versus newer releases)
- Snapshot & Restore Technique: Utilizing shared repository storage (AWS S3, NFS) for efficient data transfer
- Reindex-from-Remote & Logstash Rolling Migrations: Managing live data transitions with minimal service interruption
- API and client SDK adaptations (updating endpoints, connection strings, and client libraries) - Lifecycle Management & Operational Nuances:
- Elasticsearch ILM (Index Lifecycle Management) contrasted with OpenSearch ISM (Index State Management) syntax and policy structures
- Rollover, shrinking, downsampling, and index retention methodologies - Monitoring, Backup, and Diagnostic Procedures:
- Utilizing cluster health APIs, statistics, and tracking shard allocation anomalies
- Addressing common failure modes (circuit breaker exceptions, JVM garbage collection pauses, split-brain mitigation)
Q&A and Conclusion: Open discussion for company-specific migration challenges and architectural reviews
Practical exercises and Hands-On Labs are central to this course. Participants will gain proficiency in OpenSearch deployment, configuration, data ingestion, security, migration, monitoring, and troubleshooting through realistic, industry-relevant scenarios.
Requirements
Attendees are expected to possess the following competencies:
- Fundamental proficiency with Linux command-line operations.
- Working knowledge of networking protocols, including TCP/IP, HTTP/HTTPS, and DNS.
- A basic grasp of log management and monitoring principles.
- General familiarity with containerization technologies (Docker) is advantageous, though not mandatory.
- Initial experience working with Elasticsearch or the broader ELK Stack.
Testimonials (2)
The content is very helpful, and the trainer makes it more easier to understand
Ibrahim Al mayahi - Vastech SA
Course - Advanced Elasticsearch and Kibana Administration
the profesionalism of the trainer; the way he tried to respond to all the questions; the review questions we had to ask: engaging us in conversations
