Riak issue after power outage

Guido Medina gmedina at temetra.com
Thu Jun 1 07:13:21 EDT 2017


*Correction:* I replied to an old e-mail instead of creating a new one 
and forgot to change the subject.

Hi all,

My impression of Riak has always been that it would recover from 
anything but yesterday we had the worst happened, there was a power 
outage so all the servers in a Riak cluster went down, once they were 
back we have been having these constant so my questions are:

  * How can I recover from this?
  * Isn't Riak supposed to restore corrupted hashes from other nodes?

> 2017-06-01 12:07:43.795 [info] 
> <0.659.0>@riak_kv_vnode:maybe_create_hashtrees:234 
> riak_kv/1164634117248063262943561351070788031288321245184: unable to 
> start index_hashtree: {error,{{badmatch,{error,{db_open,"Corruption: 
> truncated record at end of 
> file"}}},[{hashtree,new_segment_store,2,[{file,"src/hashtree.erl"},{line,725}]},{hashtree,new,2,[{file,"src/hashtree.erl"},{line,246}]},{riak_kv_index_hashtree,do_new_tree,3,[{file,"src/riak_kv_index_hashtree.erl"},{line,712}]},{lists,foldl,3,[{file,"lists.erl"},{line,1248}]},{riak_kv_index_hashtree,init_trees,3,[{file,"src/riak_kv_index_hashtree.erl"},{line,565}]},{riak_kv_index_hashtree,init,1,[{file,"src/riak_kv_index_hashtree.erl"},{line,308}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,304}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,239}]}]}}
> 2017-06-01 12:07:45.457 [error] <0.27505.112> CRASH REPORT Process 
> <0.27505.112> with 0 neighbours exited with reason: no match of right 
> hand value {error,{db_open,"Corruption: truncated record at end of 
> file"}} in hashtree:new_segment_store/2 line 725 in 
> gen_server:init_it/6 line 328

This is not our production cluster but our development is now stuck 
because all the data we had there would take days to restore from 
another cluster, I hope there is a solvable problem.

Regards,

Guido.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20170601/d4bfac4b/attachment-0002.html>


More information about the riak-users mailing list