Unexpected error during recovery ; failing shard – How to solve related issues

Average Read Time

2 Mins

Unexpected error during recovery ; failing shard – How to solve related issues

Opster Team

Jan-20, Version: 1.7-8.0

Before you begin reading this guide, we recommend you run Elasticsearch Error Check-Up which can resolve issues that cause many errors.

This guide will help you check for common problems that cause the log ” Unexpected error during recovery ; failing shard ” to appear. It’s important to understand the issues related to the log, so to get started, read the general overview on common issues and tips related to the Elasticsearch concepts: indices, recovery and shard.

Advanced users might want to skip right to the common problems section in each concept or try running the Check-Up which analyses ES to pinpoint the cause of many errors and provides suitable actionable recommendations how to resolve them (free tool that requires no installation).

Log Context

{{mpg_logstarted}}

Log “Unexpected error during recovery [{}]; failing shard” classname is PeerRecoveryTargetService.java.
We extracted the following from Elasticsearch source code for those seeking an in-depth context :

 
        
Override
        public void onFailure(Exception e) {
            try (RecoveryRef recoveryRef = onGoingRecoveries.getRecovery(recoveryId)) {
                if (recoveryRef != null) {
                    logger.error(() -> new ParameterizedMessage("unexpected error during recovery [{}]; failing shard"; recoveryId); e);
                    onGoingRecoveries.failRecovery(recoveryId;
                            new RecoveryFailedException(recoveryRef.target().state(); "unexpected error"; e);
                            true // be safe
                    );
                } else {



 

Run the Check-Up to get a customized report like this:

Analyze your cluster