Node ceased to be master during ML memory tracker refresh – How to solve this Elasticsearch exception

Opster Team

August-23, Version: 7.12-8.9

Before you dig into reading this guide, have you tried asking OpsGPT what this log means? You’ll receive a customized analysis of your log.

Try OpsGPT now for step-by-step guidance and tailored insights into your Elasticsearch operation.

Briefly, this error occurs when the Elasticsearch node, which was acting as the master, loses its master status during a Machine Learning (ML) memory tracker refresh. This could be due to network issues, resource constraints, or a new master being elected. To resolve this, ensure the cluster’s health is green and stable. Check for network issues and resolve them. If the cluster is under heavy load, consider adding more nodes or increasing resources. Also, ensure the master node election process is working correctly. If the issue persists, consider disabling ML jobs temporarily until the issue is resolved.

For a complete solution to your to your search operation, try for free AutoOps for Elasticsearch & OpenSearch . With AutoOps and Opster’s proactive support, you don’t have to worry about your search operation – we take charge of it. Get improved performance & stability with less hardware.

This guide will help you check for common problems that cause the log ” Node ceased to be master during ML memory tracker refresh ” to appear. To understand the issues related to this log, read the explanation below about the following Elasticsearch concepts: plugin, memory, master, refresh, node.

Log Context

Log “Node ceased to be master during ML memory tracker refresh” class name is MlMemoryTracker.java. We extracted the following from Elasticsearch source code for those seeking an in-depth context :

 for (ActionListener listener : fullRefreshCompletionListeners) {
 listener.onResponse(null);
 }
 logger.debug("ML memory tracker last update time now [{}] and listeners called"; lastUpdateTime);
 } else {
 Exception e = new NotMasterException("Node ceased to be master during ML memory tracker refresh");
 for (ActionListener listener : fullRefreshCompletionListeners) {
 listener.onFailure(e);
 }
 logger.debug(e.getMessage());
 }

 

How helpful was this guide?

We are sorry that this post was not useful for you!

Let us improve this post!

Tell us how we can improve this post?