Still merge errors in patched riak_kv_bitcask_backend

Damien Krotkine damien.krotkine at booking.com
Thu Sep 25 10:11:02 EDT 2014


Hi,

I'm using Riak 2.0 and the latest riak_kv_bitcask_backend.beam patch 
from this very mailing list [0], but I'm still experiencing merge errors:

$ md5sum /usr/lib64/riak/lib/basho-patches/riak_kv_bitcask_backend.beam
751dcf22ba4ce17630db062b0c646305

riak attach shows:
 > code:which(riak_kv_bitcask_backend).
"/usr/lib64/riak/lib/basho-patches/riak_kv_bitcask_backend.beam"

Alas, I still get a lot of merging errors [1]. Note that I use a merging 
strategy that is maybe not too common: I make sure Riak waits before a 
file is completely full of out-dated keys, before it tries to merge it.

Any hint ? Shall I open a github issue ?

Thanks,
dams.

[0] 
http://lists.basho.com/pipermail/riak-users_lists.basho.com/2014-September/015897.html

[1]
2014-09-25 14:07:16.291 [info] <0.16612.8> All keys expired in: 
"/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/112.bitcask.data" 
scheduling file for deletion
2014-09-25 14:07:16.298 [error] <0.16612.8> Failed to merge 
{["/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/96.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/94.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/92.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/91.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/90.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/89.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/125.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/124.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/123.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/122.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/121.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/120.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/118.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/117.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/116.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/114.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/112.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/110.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/108.bitcask.data","/var/lib/riak/bitcask_mult_events/822094670998632891489572718402909198556462055424/106.bi...",...],...}: 
{generic_failure,error,badarg,[{bitcask_nifs,keydir_remove_int,[<<>>,{tombstone,<<2,0,6,101,118,101,110,116,115,49,52,49,49,49,54,49,53,56,49,58,49,58,69,88,80,58,58,48>>},1411161602,114,<<133,167,151,16,0,0,0,0>>,1411654036],[]},{bitcask,'-expiry_merge/4-fun-0-',7,[{file,"src/bitcask.erl"},{line,1912}]},{bitcask_fileops,fold_hintfile_loop,5,[{file,"src/bitcask_fileops.erl"},{line,660}]},{bitcask_fileops,fold_file_loop,8,[{file,"src/bitcask_fileops.erl"},{line,720}]},{bitcask_fileops,fold_hintfile,3,[{file,"src/bitcask_fileops.erl"},{line,624}]},{bitcask,expiry_merge,4,[{file,"src/bitcask.erl"},{line,1915}]},{bitcask,merge1,4,[{file,"src/bitcask.erl"},{line,686}]},{bitcask,merge,3,[{file,"src/bitcask.erl"},{line,566}]}]}





-- 
Damien Krotkine, IT Developer, Paris, France.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20140925/88f3327b/attachment.html>


More information about the riak-users mailing list