OpenSearch Data Architecture

< Back to all guides
Cold Storage in OpenSearch

With cold storage, OpenSearch provides an advanced & efficient storage solution that complements the existing UltraWarm feature. To use...

Elasticsearch ILM VS. OpenSearch ISM Policy - Comparison, Explanation and Instructions (OpenSearch ILM)

Elasticsearch ILM (Index Lifecycle Management) & OpenSearch ISM (Index State Management) have the same goal, but their execution differs...

How to configure all OpenSearch node roles (master, data, coordinating..)

Follow these steps to configure all OpenSearch node role types (master, data, coordinating, ingest, machine learning, remote eligible...

How to Define Efficient Mapping in OpenSearch

Mappings are the core element of index creation in OpenSearch. Defining them correctly can improve performance. Mapping types include...

How to leverage ingest pipelines to transform data transparently in OpenSearch

Ingest pipelines sit within the OpenSearch node and will perform a set of alterations on your data that you...

How to Model Relationships Between Documents in OpenSearch Using Join

The join data type field allows users to establish parent-child relationships between documents in OpenSearch. To use join, you need to...

How to Model Relationships Between Documents in OpenSearch Using Nesting

OpenSearch has many methods for defining relationships between documents, such as nested documents. An OpenSearch nested query...

How to Model Relationships Between Documents in OpenSearch Using Object

OpenSearch object types can be used to define relationships between documents. Here's how to use the object field type for that purpose.

How to Reduce the Number of Shards in an OpenSearch Cluster

When you have too many shards in your OpenSearch cluster, there are a few steps you can take in order to reduce the number of shards...

Index Templates in OpenSearch - How to Use Composable Templates

OpenSearch index templates allow us to create indices with user defined configuration. An index can pull the configuration from these...

Object Fields VS. Nested Field Types in OpenSearch

Nested is a special object type that is indexed as a separate document. To demonstrate the use of OpenSearch nested fields VS. object...

OpenSearch AWS UltraWarm/Cold vs Elasticsearch Searchable Snapshots

Elasticsearch & OpenSearch offer ways to save costs by putting older data into cheaper machines. OpenSearch uses UltraWarm and...

OpenSearch Cross Cluster Search and Cross Cluster Replication

This guide will go over the OpenSearch Cross Cluster Search (CCS) & Cross Cluster Replication (CCR) features, how to configure CCR and more.

OpenSearch Data Types: A Comprehensive Guide

In this article, we will delve into the different data types supported by OpenSearch and how to use them effectively.

OpenSearch Field Size - How to Calculate the Storage Size of Specific Fields in an Index 

The 2 methods in OpenSsearch to calculate the storage size of specific fields in an index are: creating dedicated indices & using the Luke....

OpenSearch Global Ordinals, Eager Global Ordinals & High Cardinality Fields

Terms aggregations rely on an internal data structure known as global ordinals. The eager_global_ordinals parameter is used to...

OpenSearch match_only_text Field Type (For Storage Optimization)

The new match_only_text feature in OpenSearch can save up to 10% of disk space on logging datasets. This field type will set a flat...

OpenSearch Remote Backed Storage

Remote-backed storage is an experimental OpenSearch feature. Here's how to enable it, recover data from remote repositories & its limitations.

OpenSearch Searchable Snapshots

OpenSearch searchable snapshots allows to search snapshots in remote repositories without pre-downloading all index data to disks. To use...

OpenSearch Segment Replication

The OpenSearch segment replication feature copies segments directly to the replica nodes disk after refresh. The architecture design...

OpenSearch Source Filtering, Stored Fields, Fields and Docvalues Fields

There are various methods for retrieving fields in OpenSearch, including: _source, stored_fields, fields & docvalue_fields. To retrieve...

OpenSearch Split Index API

By using the Split Index API in OpenSearch, an existing index can be split to create a new index with extra primary shards. To do this...

OpenSearch Text Analyzers - Tokenizers, Standard Analyzers, Stopwords and More

The text analysis process in OpenSearch is tasked with two functions: tokenization & normalization and is carried out by employing analyzers.

OpenSearch Token Filters

A tokenizer decides how OpenSearch will take a set of words and divide it into separated terms called “tokens”. To work with synonyms...

OpenSearch Transforms: How to Leverage OpenSearch Index Transforms

OpenSearch transforms allow users to generate new indices based on existing data aggregations. Here's to create index transforms.

Setting up Hot-Warm architecture for ISM in OpenSearch

OpenSearch offers an easy way to configure a hot-warm architecture under specific conditions. To set up a hot-warm architecture for ISM...

SLM in Elasticsearch vs Snapshot Management in OpenSearch

Here are the similarities and differences between Elasticsearch Snapshot Lifecycle Management (SLM) and OpenSearch Snapshot Management (SM).

When You Should Transform Your OpenSearch Data Instead of Using Aggregations

There are at least three use cases where you should consider using transforms instead of aggregations in OpenSearch. First, when the...

g2crowd

Loved by the Community ❤️

Our products are loved by over 12,000 users from the community. Thank you to our customers from all around the world!
soc2-type2