Data architecture

< Back to all guides
An Overview of Source Filtering, Stored Fields, Fields and Docvalues Fields

There are various methods for retrieving fields in Elasticsearch, including: _source, stored_fields, fields & docvalue_fields. To retrieve...

Elasticsearch Compression

Elasticsearch provides various compression techniques to optimize storage and network usage. Here's how to compress an index, source and...

Elasticsearch Data Stream

The Elasticsearch data stream is an abstraction layer between the names used by applications to facilitate ingestion and search operations...

Elasticsearch Delete Document

In this guide, we will discuss the process of deleting documents in Elasticsearch as well as best practices for deleting documents.

Elasticsearch Document Size Limit

This guide discusses the default document size limit in Elasticsearch, the reasons behind it, and how to handle larger documents effectively.

Elasticsearch Field Size - How to Calculate the Storage Size of Specific Fields in an Index 

The 3 main methods in Elasticsearch to calculate the storage size of specific fields in an index are: using the _disk_usage API, creating...

Elasticsearch Filtered Aliases

Elasticsearch filtered aliases can help you filter data more efficiently. To create a filtered alias, you need to define the criteria for...

Elasticsearch Global Ordinals, Eager Global Ordinals & High Cardinality Fields

Terms aggregations rely on an internal data structure known as global ordinals. The eager_global_ordinals parameter is used to...

Elasticsearch Index Pattern

Elasticsearch index patterns allow you to define how to match & interact with multiple indices. The best practices for index pattern usage...

Elasticsearch Insert Document

This guide will discuss best practices & performance optimization techniques for inserting documents into Elasticsearch. First, use the API...

Elasticsearch match_only_text Field Type (For Storage Optimization)

The new match_only_text feature in Elasticsearch can save up to 10% of disk space on logging datasets. This field type will set a flat...

Elasticsearch Nested Aggregation 

Elasticsearch nested aggregation is a powerful technique for analyzing complex data structures that contain nested documents. To use...

Elasticsearch Not Indexed Field

This guide focuses on how to handle not indexed fields in Elasticsearch, including use cases, how to configure them, and examples.

Elasticsearch Searchable Snapshots

Elasticsearch searchable snapshots allow data exploration. They can be controlled with ILM Policies or be manually mounted. To implement...

Elasticsearch Split Index API

By using the Elasticsearch Split Index API, an existing index can be split to create a new index with extra primary shards. To do this...

Elasticsearch Sum Aggregation

The Elasticsearch sum aggregation allows you to calculate the sum of a numeric field for a set of documents. To implement...

Elasticsearch Text Analyzers - Tokenizers, Standard Analyzers, Stopwords and More

The text analysis process is tasked with two functions: tokenization and normalization and is carried out by employing analyzers. When you...

Elasticsearch Token Filters

A tokenizer decides how Elasticsearch will take a set of words and divide it into separated terms called “tokens”. To work with synonyms...

Elasticsearch Upsert

Upsert in Elasticsearch allows you to perform both update and insert actions in a single request. To perform an upsert operation...

How to configure all Elasticsearch node roles (master, data, coordinating..)

Follow these steps to configure all Elasticsearch node role types (master, data, coordinating, ingest, machine learning, remote eligible...

How to Define Efficient Mapping in Elasticsearch

Mappings are the core element of index creation in Elasticsearch. Defining them correctly can improve performance. Mapping types include...

How to leverage ingest pipelines to transform data transparently in Elasticsearch

Ingest pipelines sit within the Elasticsearch node and will perform a set of alterations on your data that you...

How to Model Relationships Between Documents in Elasticsearch Using Join

The join data type field allows users to establish parent-child relationships between documents in Elasticsearch. To use it, you need to...

How to Model Relationships Between Documents in Elasticsearch Using Nesting

Elasticsearch has many methods for defining relationships between documents, such as nested documents. To use the nested field type...

How to Model Relationships Between Documents in Elasticsearch Using Object

Object types in Elasticsearch can be used to define relationships between documents. Here's how to use the object field type for that purpose.

How to Reduce the Number of Shards in an Elasticsearch Cluster

When you have too many shards in your Elasticsearch cluster, there are a few steps you can take in order to reduce the number of shards...

Index Lifecycle Management & Policy

Index lifecycle management helps automate the creation, management & removal of an Elasticsearch index. Define the index lifecycle policy...

Index Templating in Elasticsearch - How to Use Composable Templates

Elasticsearch index templates allow us to create indices with user defined configuration. An index can pull the configuration from these...

Object Fields VS. Nested Field Types in Elasticsearch

Nested is a special object type that is indexed as a separate document. To demonstrate the use of Elasticsearch nested VS. object fields...

SLM in Elasticsearch vs Snapshot Management in OpenSearch

Here are the similarities and differences between Elasticsearch Snapshot Lifecycle Management (SLM) and OpenSearch Snapshot Management (SM).

Transform APIs in Elasticsearch

The Elasticsearch Transform APIs can be used to turn existing indices into summarized indices. To create a transform API...

When You Should Transform Your Data Instead of Using Aggregations

There are at least three use cases where you should consider using transforms instead of aggregations in Elasticsearch. First, when the...

g2crowd

Loved by the Community ❤️

Our products are loved by over 12,000 users from the community. Thank you to our customers from all around the world!
soc2-type2
Skip to content