anti_entropy and solr taking up suspiciously large amounts of space

Rohit Sanbhadti sanbhadtirohit at vmware.com
Tue Mar 21 20:00:09 EDT 2017


Running Riak 2.2.0 on Ubuntu 16.04.1, we’ve noticed that anti_entropy is taking up way too much space on all of our nodes. We use multi_backend with mostly bitcask backends (relevant part of config pasted below). Has anyone seen this before, or does anyone have an idea what might be causing this? 

storage_backend = multi
multi_backend.bitcask_1day.storage_backend = bitcask
multi_backend.bitcask_1day.bitcask.data_root = /var/lib/riak/bitcask_1day
multi_backend.bitcask_1day.bitcask.expiry = 1d
multi_backend.bitcask_1day.bitcask.expiry.grace_time = 1h
multi_backend.bitcask_2day.storage_backend = bitcask
multi_backend.bitcask_2day.bitcask.data_root = /var/lib/riak/bitcask_2day
multi_backend.bitcask_2day.bitcask.expiry = 2d
multi_backend.bitcask_2day.bitcask.expiry.grace_time = 1h
multi_backend.bitcask_4day.storage_backend = bitcask
multi_backend.bitcask_4day.bitcask.data_root = /var/lib/riak/bitcask_4day
multi_backend.bitcask_4day.bitcask.expiry = 4d
multi_backend.bitcask_4day.bitcask.expiry.grace_time = 1h
multi_backend.bitcask_8day.storage_backend = bitcask
multi_backend.bitcask_8day.bitcask.data_root = /var/lib/riak/bitcask_8day
multi_backend.bitcask_8day.bitcask.expiry = 8d
multi_backend.bitcask_8day.bitcask.expiry.grace_time = 1h
multi_backend.leveldb_mult.storage_backend = leveldb
multi_backend.leveldb_mult.leveldb.maximum_memory.percent = 30
multi_backend.leveldb_mult.leveldb.data_root = /var/lib/riak/leveldb_mult
multi_backend.bitcask_mult.storage_backend = bitcask
multi_backend.bitcask_mult.bitcask.data_root = /var/lib/riak/bitcask_mult
multi_backend.default = leveldb_mult

$ du –h –d 1 /var/lib/riak

4.0K    /var/lib/riak/riak_kv_exchange_fsm
52K     /var/lib/riak/generated.configs
224K    /var/lib/riak/cluster_meta
424K    /var/lib/riak/ring
1.1M    /var/lib/riak/kv_vnode
2.1M    /var/lib/riak/bitcask_1day
3.6M    /var/lib/riak/bitcask_4day
33M     /var/lib/riak/yz_temp
1.1G    /var/lib/riak/bitcask_2day
5.9G    /var/lib/riak/yz_anti_entropy
20G     /var/lib/riak/yz
24G     /var/lib/riak/leveldb_mult
25G     /var/lib/riak/bitcask_mult
27G     /var/lib/riak/bitcask_8day
139G    /var/lib/riak/anti_entropy
240G    /var/lib/riak


-- 
Rohit S.



More information about the riak-users mailing list