AAE Alredy held by process

fenix.serega at gmail.com fenix.serega at gmail.com
Tue Jun 24 08:37:05 EDT 2014


Riak cluster 7 nodes, 1.3.2 ....

Sometime riak node crashes and not responde at all.

On one node:

2014-06-24 14:29:56 =ERROR REPORT====
Error in process <0.8303.2> on node 'riak at de3' with exit value:
{badarg,[{erlang,binary_to_term,[<<19047
bytes>>],[]},{hashtree,get_disk_bucket,3,[{file,"src/hashtree.erl"},{line,597}]},{hashtree,'-update_levels/3-fun-1-',3,[{file,"src/hashtree.erl"},{line,539}]},{lists,foldl,3,[{file,"lists.erl"},{line,1197}]},{hashtree...

2014-06-24 14:29:56 =CRASH REPORT====
  crasher:
    initial call: riak_kv_index_hashtree:init/1
    pid: <0.8936.2>
    registered_name: []
    exception exit: {{{badmatch,{error,{db_open,"IO error: lock
./data/anti_entropy/1358739803456073806767488242915919369836374786048/LOCK:
already held by
process"}}},[{hashtree,new_segment_store,2,[{file,"src/hashtree.erl"},{line,499}]},{hashtree,new,2,[{file,"src/hashtree.erl"},{line,215}]},{riak_kv_index_hashtree,do_new_tree,2,[{file,"src/riak_kv_index_hashtree.erl"},{line,426}]},{lists,foldl,3,[{file,"lists.erl"},{line,1197}]},{riak_kv_index_hashtree,init_trees,2,[{file,"src/riak_kv_index_hashtree.erl"},{line,368}]},{riak_kv_index_hashtree,init,1,[{file,"src/riak_kv_index_hashtree.erl"},{line,225}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,304}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,227}]}]},[{gen_server,init_it,6,[{file,"gen_server.erl"},{line,328}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,227}]}]}
    ancestors: [<0.1665.0>,riak_core_vnode_sup,riak_core_sup,<0.129.0>]
    messages: []
    links: []
    dictionary: []
    trap_exit: false
    status: running
    heap_size: 987
    stack_size: 24
    reductions: 604
  neighbours:
2014-06-24 14:30:50 =ERROR REPORT====
Error in process <0.9292.2> on node 'riak at de3' with exit value:
{badarg,[{erlang,binary_to_term,[<<19399
bytes>>],[]},{hashtree,get_disk_bucket,3,[{file,"src/hashtree.erl"},{line,597}]},{hashtree,'-update_levels/3-fun-1-',3,[{file,"src/hashtree.erl"},{line,539}]},{lists,foldl,3,[{file,"lists.erl"},{line,1197}]},{hashtree...

2014-06-24 14:30:50 =CRASH REPORT====
  crasher:
    initial call: riak_kv_index_hashtree:init/1
    pid: <0.10819.2>
    registered_name: []
    exception exit: {{{badmatch,{error,{db_open,"IO error: lock
./data/anti_entropy/536645132457440915277915524513010171279912730624/LOCK:
already held by
process"}}},[{hashtree,new_segment_store,2,[{file,"src/hashtree.erl"},{line,499}]},{hashtree,new,2,[{file,"src/hashtree.erl"},{line,215}]},{riak_kv_index_hashtree,do_new_tree,2,[{file,"src/riak_kv_index_hashtree.erl"},{line,426}]},{lists,foldl,3,[{file,"lists.erl"},{line,1197}]},{riak_kv_index_hashtree,init_trees,2,[{file,"src/riak_kv_index_hashtree.erl"},{line,368}]},{riak_kv_index_hashtree,init,1,[{file,"src/riak_kv_index_hashtree.erl"},{line,225}]},{gen_server,init_it,6,[{file,"gen_server.erl"},{line,304}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,227}]}]},[{gen_server,init_it,6,[{file,"gen_server.erl"},{line,328}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,227}]}]}
    ancestors: [<0.1140.0>,riak_core_vnode_sup,riak_core_sup,<0.129.0>]
    messages: []
    links: []
    dictionary: []
    trap_exit: false
    status: running
    heap_size: 987
    stack_size: 24
    reductions: 601
  neighbours:


What does it mean ?

It seems - always same partitions:

536645132457440915277915524513010171279912730624
924856504873462002925769308203272848376019812352

Thanks.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20140624/0f6deadb/attachment.html>


More information about the riak-users mailing list