Stopping an Elasticsearch snapshot

elasticsearch

We do nightly snapshots to S3. They normally take ~2hrs. I have one that has been running for 4 days now.
I've tried to stop it with this command:

time curl -XDELETE -s localhost:9200/_snapshot/sim-s3-backup/sim-autobackup_2015-05-15/?pretty

However, even that command hangs. So I let it run for a while, here's the full output:

time curl -XDELETE -s localhost:9200/_snapshot/sim-s3-backup/sim-autobackup_2015-05-15/?pretty
^C

real    1544m19.284s
user    0m0.508s
sys     0m2.580s

Is there any other way to get this snapshot to stop? For reference, this is the output of the status:

curl -XGET -s localhost:9200/_snapshot/sim-s3-backup/sim-autobackup_2015-05-15/?pretty                        
{
  "snapshots" : [ {
    "snapshot" : "sim-autobackup_2015-05-15",
    "indices" : [ "7199", "7399", "7299", "7499", "7599", "6202085", "6202082", "6202083", "8099", "6202059", "6202055", "5099", "5299", "5199", "6202076", "6202075", "6202078", "6202077", "6202079", "5899", "6202071", "6202073", "5699", "40061", "40064", "40065", "5599", "6201572", "3001", "3002", "3008", "3007", "3006", "3005", "5999", "6202044", "6202018", "6202013", "10109", "10009", "6099", "70005", "6201266", "6199", "6299", "10309", "10409", "10609", "10509", "7099", "6799", "6899", "40054", "40057", "40055", "40056", "6202068", "6202067", "6202060", "6699" ],
    "state" : "IN_PROGRESS",
    "start_time" : "2015-05-16T09:30:06.303Z",
    "start_time_in_millis" : 1431768606303,
    "failures" : [ ],
    "shards" : {
      "total" : 0,
      "failed" : 0,
      "successful" : 0
    }
  } ]
}

I just want to stop it somehow (without stopping the entire cluster). I can then delete it or re-run a new snapshot and get today's date on it.

Best Answer

I fixed it, albeit not the ideal way. Simply restarting one node at a time (simple two node cluster) has made the snapshot fail. Good news is due to the clustering nature, there was no downtime to the services that utilize ES.

Related Topic