Riak Merge On Restarts Only

Ian Ha ian at blutrumpet.com
Tue Jan 22 12:17:48 EST 2013


There is another file in the that partition. It's at 340 MB, and has the
filename 4.bitcask.data.

My understanding is because the other file is at 2.1G, and we have the
default at 2Gb, wouldn't that warrant the file to be closed and therefore
appear in vnode_status?

Looks like after i ran the erlang code in riak attach I got the following:

[{frag_merge_trigger,40},
 {dead_bytes_merge_trigger,268435456},
 {frag_threshold,40},
 {included_applications,[]},
 {data_root,"/var/lib/riak/bitcask"},
 {open_timeout,4},
 {require_hint_crc,false},
 {dead_bytes_threshold,134217728},
 {max_file_size,2147483648},
 {max_fold_puts,0},
 {max_fold_age,-1},
 {small_file_threshold,10485760},
 {sync_strategy,none},
 {expiry_secs,3888000},
 {merge_window,always}]

So the max file size is a t 2.14 and the file is at 2.12, so I guess that's
why it didn't merge. Since I didn't set that value in the config, does that
appear to be the correct default value?

Thanks for the log config, I will add that to our cluster.


On Tue, Jan 22, 2013 at 11:42 AM, Brian Sparrow <bsparrow at basho.com> wrote:

>  If the file is not reported in vnode_status then the file has not yet
> been closed. Is there a more recent(and smaller size) .data file in that
> partition? That file could just be on the edge of being closed.
>
> To confirm you bitcask settings, from `riak attach` on any node run
> `application:get_all_env(bitcask).`
>
> Further, you can enable logging whenever a file passes the merge triggers
> with the log_needs_merge setting in the bitcask settings in app.config. ex:
> {log_needs_merge, true},
>
> This will log anytime a file is ready to be merged. If you do not see a
> subsequent merge after the log entry then the file did not pass one of the
> thresholds to allow the merge.
>
> -Brian
>
> --
> Brian Sparrow
> Developer Advocate
> Basho Technologies
>
> Sent with Sparrow <http://www.sparrowmailapp.com/?sig>
>
> On Tuesday, January 22, 2013 at 11:18 AM, Ian Ha wrote:
>
> Brian, here's the dump for vnode_status. Interesetingly enough, the 2.1G
> file at 271177061614132377401074334195404075912721858560/5.bitcask.data is
> not part of this dump. Not sure why or if that is a concern?
>
> Vnode status information
> -------------------------------------------
>
> VNode: 8563486156235759286349715816696970818296479744
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185800},
>
>  {status,[{"/var/lib/riak/bitcask/8563486156235759286349715816696970818296479744/4.bitcask.data",
>            5,31874309,338046717}]}]
>
> VNode: 19981467697883438334816003572292931909358452736
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185635},
>
>  {status,[{"/var/lib/riak/bitcask/19981467697883438334816003572292931909358452736/4.bitcask.data",
>            5,34907347,342699456}]}]
>
> VNode: 31399449239531117383282291327888893000420425728
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,184771},
>
>  {status,[{"/var/lib/riak/bitcask/31399449239531117383282291327888893000420425728/4.bitcask.data",
>            5,32830995,329973073}]}]
>
> VNode: 42817430781178796431748579083484854091482398720
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,184847},
>
>  {status,[{"/var/lib/riak/bitcask/42817430781178796431748579083484854091482398720/7.bitcask.data",
>            1,18113882,91425091},
>
> {"/var/lib/riak/bitcask/42817430781178796431748579083484854091482398720/4.bitcask.data",
>            5,31974540,334178572}]}]
>
> VNode: 54235412322826475480214866839080815182544371712
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186027},
>
>  {status,[{"/var/lib/riak/bitcask/54235412322826475480214866839080815182544371712/4.bitcask.data",
>            5,31978319,338241457}]}]
>
> VNode: 65653393864474154528681154594676776273606344704
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185753},
>
>  {status,[{"/var/lib/riak/bitcask/65653393864474154528681154594676776273606344704/4.bitcask.data",
>            5,33745910,339735357}]}]
>
> VNode: 77071375406121833577147442350272737364668317696
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185840},
>
>  {status,[{"/var/lib/riak/bitcask/77071375406121833577147442350272737364668317696/4.bitcask.data",
>            5,30572735,337791556}]}]
>
> VNode: 88489356947769512625613730105868698455730290688
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186673},
>
>  {status,[{"/var/lib/riak/bitcask/88489356947769512625613730105868698455730290688/4.bitcask.data",
>            5,32874502,336092493}]}]
>
> VNode: 99907338489417191674080017861464659546792263680
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,184970},
>
>  {status,[{"/var/lib/riak/bitcask/99907338489417191674080017861464659546792263680/4.bitcask.data",
>            5,32396426,330001394}]}]
>
> VNode: 111325320031064870722546305617060620637854236672
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185248},
>
>  {status,[{"/var/lib/riak/bitcask/111325320031064870722546305617060620637854236672/4.bitcask.data",
>            5,34161176,335074205}]}]
>
> VNode: 122743301572712549771012593372656581728916209664
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185760},
>
>  {status,[{"/var/lib/riak/bitcask/122743301572712549771012593372656581728916209664/4.bitcask.data",
>            5,30889834,335031242}]}]
>
> VNode: 134161283114360228819478881128252542819978182656
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185590},
>
>  {status,[{"/var/lib/riak/bitcask/134161283114360228819478881128252542819978182656/4.bitcask.data",
>            5,32798615,337772144}]}]
>
> VNode: 145579264656007907867945168883848503911040155648
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185460},
>
>  {status,[{"/var/lib/riak/bitcask/145579264656007907867945168883848503911040155648/4.bitcask.data",
>            5,33085394,336272206}]}]
>
> VNode: 156997246197655586916411456639444465002102128640
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186096},
>
>  {status,[{"/var/lib/riak/bitcask/156997246197655586916411456639444465002102128640/4.bitcask.data",
>            5,34342279,336669714}]}]
>
> VNode: 168415227739303265964877744395040426093164101632
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185756},
>
>  {status,[{"/var/lib/riak/bitcask/168415227739303265964877744395040426093164101632/4.bitcask.data",
>            5,29834588,334221105}]}]
>
> VNode: 179833209280950945013344032150636387184226074624
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185663},
>
>  {status,[{"/var/lib/riak/bitcask/179833209280950945013344032150636387184226074624/7.bitcask.data",
>            1,4326604,84769249},
>
> {"/var/lib/riak/bitcask/179833209280950945013344032150636387184226074624/4.bitcask.data",
>            5,32222921,327833678}]}]
>
> VNode: 191251190822598624061810319906232348275288047616
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185930},
>
>  {status,[{"/var/lib/riak/bitcask/191251190822598624061810319906232348275288047616/4.bitcask.data",
>            5,32790298,341206859}]}]
>
> VNode: 202669172364246303110276607661828309366350020608
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185911},
>
>  {status,[{"/var/lib/riak/bitcask/202669172364246303110276607661828309366350020608/4.bitcask.data",
>            5,30258774,334550584}]}]
>
> VNode: 214087153905893982158742895417424270457411993600
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185180},
>
>  {status,[{"/var/lib/riak/bitcask/214087153905893982158742895417424270457411993600/4.bitcask.data",
>            5,34331320,338067428}]}]
>
> VNode: 225505135447541661207209183173020231548473966592
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185486},
>
>  {status,[{"/var/lib/riak/bitcask/225505135447541661207209183173020231548473966592/4.bitcask.data",
>            5,33282502,336653351}]}]
>
> VNode: 236923116989189340255675470928616192639535939584
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185553},
>
>  {status,[{"/var/lib/riak/bitcask/236923116989189340255675470928616192639535939584/4.bitcask.data",
>            5,35582186,339871589}]}]
>
> VNode: 248341098530837019304141758684212153730597912576
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185181},
>
>  {status,[{"/var/lib/riak/bitcask/248341098530837019304141758684212153730597912576/4.bitcask.data",
>            5,33057915,343594362}]}]
>
> VNode: 259759080072484698352608046439808114821659885568
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185155},
>
>  {status,[{"/var/lib/riak/bitcask/259759080072484698352608046439808114821659885568/4.bitcask.data",
>            5,31763402,336956394}]}]
>
> VNode: 271177061614132377401074334195404075912721858560
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185760},
>
>  {status,[{"/var/lib/riak/bitcask/271177061614132377401074334195404075912721858560/4.bitcask.data",
>            5,35371762,340778827}]}]
>
> VNode: 282595043155780056449540621951000037003783831552
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185797},
>
>  {status,[{"/var/lib/riak/bitcask/282595043155780056449540621951000037003783831552/4.bitcask.data",
>            5,31127659,341388940}]}]
>
> VNode: 294013024697427735498006909706595998094845804544
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185400},
>
>  {status,[{"/var/lib/riak/bitcask/294013024697427735498006909706595998094845804544/4.bitcask.data",
>            5,33172810,335029860}]}]
>
> VNode: 305431006239075414546473197462191959185907777536
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185370},
>
>  {status,[{"/var/lib/riak/bitcask/305431006239075414546473197462191959185907777536/4.bitcask.data",
>            5,35447783,339131698}]}]
>
> VNode: 316848987780723093594939485217787920276969750528
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185306},
>
>  {status,[{"/var/lib/riak/bitcask/316848987780723093594939485217787920276969750528/4.bitcask.data",
>            5,33100563,334514005}]}]
>
> VNode: 328266969322370772643405772973383881368031723520
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185587},
>
>  {status,[{"/var/lib/riak/bitcask/328266969322370772643405772973383881368031723520/4.bitcask.data",
>            5,31554776,329354531}]}]
>
> VNode: 339684950864018451691872060728979842459093696512
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,184990},
>
>  {status,[{"/var/lib/riak/bitcask/339684950864018451691872060728979842459093696512/7.bitcask.data",
>            2,17893708,87660389},
>
> {"/var/lib/riak/bitcask/339684950864018451691872060728979842459093696512/4.bitcask.data",
>            5,32530630,332735318}]}]
>
> VNode: 351102932405666130740338348484575803550155669504
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185489},
>
>  {status,[{"/var/lib/riak/bitcask/351102932405666130740338348484575803550155669504/7.bitcask.data",
>            1,16949080,90740582},
>
> {"/var/lib/riak/bitcask/351102932405666130740338348484575803550155669504/4.bitcask.data",
>            5,31736396,336629981}]}]
>
> VNode: 362520913947313809788804636240171764641217642496
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185317},
>
>  {status,[{"/var/lib/riak/bitcask/362520913947313809788804636240171764641217642496/4.bitcask.data",
>            5,34728997,335644618}]}]
>
> VNode: 373938895488961488837270923995767725732279615488
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185189},
>
>  {status,[{"/var/lib/riak/bitcask/373938895488961488837270923995767725732279615488/4.bitcask.data",
>            5,33860427,338229690}]}]
>
> VNode: 385356877030609167885737211751363686823341588480
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185076},
>
>  {status,[{"/var/lib/riak/bitcask/385356877030609167885737211751363686823341588480/4.bitcask.data",
>            5,32015829,331802410}]}]
>
> VNode: 396774858572256846934203499506959647914403561472
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185502},
>
>  {status,[{"/var/lib/riak/bitcask/396774858572256846934203499506959647914403561472/4.bitcask.data",
>            5,34371519,338605515}]}]
>
> VNode: 408192840113904525982669787262555609005465534464
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186081},
>
>  {status,[{"/var/lib/riak/bitcask/408192840113904525982669787262555609005465534464/10.bitcask.data",
>            6,490500,3116567},
>
> {"/var/lib/riak/bitcask/408192840113904525982669787262555609005465534464/8.bitcask.data",
>            5,26188498,171694974},
>
> {"/var/lib/riak/bitcask/408192840113904525982669787262555609005465534464/6.bitcask.data",
>            17,11782388,73101186},
>
> {"/var/lib/riak/bitcask/408192840113904525982669787262555609005465534464/4.bitcask.data",
>            13,20195069,117631531}]}]
>
> VNode: 419610821655552205031136075018151570096527507456
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185717},
>
>  {status,[{"/var/lib/riak/bitcask/419610821655552205031136075018151570096527507456/4.bitcask.data",
>            5,31829307,331435676}]}]
>
> VNode: 431028803197199884079602362773747531187589480448
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185947},
>
>  {status,[{"/var/lib/riak/bitcask/431028803197199884079602362773747531187589480448/4.bitcask.data",
>            5,32173706,338148596}]}]
>
> VNode: 442446784738847563128068650529343492278651453440
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185537},
>
>  {status,[{"/var/lib/riak/bitcask/442446784738847563128068650529343492278651453440/4.bitcask.data",
>            5,35813666,338837080}]}]
>
> VNode: 453864766280495242176534938284939453369713426432
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185746},
>
>  {status,[{"/var/lib/riak/bitcask/453864766280495242176534938284939453369713426432/4.bitcask.data",
>            5,32624042,334740185}]}]
>
> VNode: 465282747822142921225001226040535414460775399424
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185468},
>
>  {status,[{"/var/lib/riak/bitcask/465282747822142921225001226040535414460775399424/7.bitcask.data",
>            2,20331282,91766521},
>
> {"/var/lib/riak/bitcask/465282747822142921225001226040535414460775399424/4.bitcask.data",
>            5,32647444,344746992}]}]
>
> VNode: 476700729363790600273467513796131375551837372416
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185831},
>
>  {status,[{"/var/lib/riak/bitcask/476700729363790600273467513796131375551837372416/4.bitcask.data",
>            5,32209907,332813073}]}]
>
> VNode: 488118710905438279321933801551727336642899345408
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186592},
>
>  {status,[{"/var/lib/riak/bitcask/488118710905438279321933801551727336642899345408/4.bitcask.data",
>            5,33320036,333898295}]}]
>
> VNode: 499536692447085958370400089307323297733961318400
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185629},
>
>  {status,[{"/var/lib/riak/bitcask/499536692447085958370400089307323297733961318400/4.bitcask.data",
>            5,33497617,343082792}]}]
>
> VNode: 510954673988733637418866377062919258825023291392
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185481},
>
>  {status,[{"/var/lib/riak/bitcask/510954673988733637418866377062919258825023291392/4.bitcask.data",
>            5,32209418,336325646}]}]
>
> VNode: 522372655530381316467332664818515219916085264384
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185230},
>
>  {status,[{"/var/lib/riak/bitcask/522372655530381316467332664818515219916085264384/4.bitcask.data",
>            5,34077445,337997080}]}]
>
> VNode: 533790637072028995515798952574111181007147237376
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186355},
>
>  {status,[{"/var/lib/riak/bitcask/533790637072028995515798952574111181007147237376/4.bitcask.data",
>            5,30786415,335334027}]}]
>
> VNode: 545208618613676674564265240329707142098209210368
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186271},
>
>  {status,[{"/var/lib/riak/bitcask/545208618613676674564265240329707142098209210368/4.bitcask.data",
>            5,32730917,335737716}]}]
>
> VNode: 556626600155324353612731528085303103189271183360
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186035},
>
>  {status,[{"/var/lib/riak/bitcask/556626600155324353612731528085303103189271183360/7.bitcask.data",
>            1,4873700,85319443},
>
> {"/var/lib/riak/bitcask/556626600155324353612731528085303103189271183360/4.bitcask.data",
>            5,31326139,336025933}]}]
>
> VNode: 568044581696972032661197815840899064280333156352
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,184440},
>
>  {status,[{"/var/lib/riak/bitcask/568044581696972032661197815840899064280333156352/4.bitcask.data",
>            5,32950443,333793428}]}]
>
> VNode: 579462563238619711709664103596495025371395129344
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185118},
>
>  {status,[{"/var/lib/riak/bitcask/579462563238619711709664103596495025371395129344/4.bitcask.data",
>            5,31707260,338029164}]}]
>
> VNode: 590880544780267390758130391352090986462457102336
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185254},
>
>  {status,[{"/var/lib/riak/bitcask/590880544780267390758130391352090986462457102336/4.bitcask.data",
>            5,33033620,333558333}]}]
>
> VNode: 602298526321915069806596679107686947553519075328
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185817},
>
>  {status,[{"/var/lib/riak/bitcask/602298526321915069806596679107686947553519075328/4.bitcask.data",
>            5,33359523,340174269}]}]
>
> VNode: 613716507863562748855062966863282908644581048320
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185892},
>
>  {status,[{"/var/lib/riak/bitcask/613716507863562748855062966863282908644581048320/4.bitcask.data",
>            5,32059047,335268151}]}]
>
> VNode: 625134489405210427903529254618878869735643021312
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185479},
>
>  {status,[{"/var/lib/riak/bitcask/625134489405210427903529254618878869735643021312/4.bitcask.data",
>            5,31377434,333663874}]}]
>
> VNode: 636552470946858106951995542374474830826704994304
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186471},
>
>  {status,[{"/var/lib/riak/bitcask/636552470946858106951995542374474830826704994304/4.bitcask.data",
>            5,31637370,331456191}]}]
>
> VNode: 647970452488505786000461830130070791917766967296
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185696},
>
>  {status,[{"/var/lib/riak/bitcask/647970452488505786000461830130070791917766967296/4.bitcask.data",
>            5,33490059,341805230}]}]
>
> VNode: 659388434030153465048928117885666753008828940288
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185111},
>
>  {status,[{"/var/lib/riak/bitcask/659388434030153465048928117885666753008828940288/4.bitcask.data",
>            5,33355158,339718408}]}]
>
> VNode: 670806415571801144097394405641262714099890913280
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185663},
>
>  {status,[{"/var/lib/riak/bitcask/670806415571801144097394405641262714099890913280/4.bitcask.data",
>            5,33049532,339186274}]}]
>
> VNode: 682224397113448823145860693396858675190952886272
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185580},
>
>  {status,[{"/var/lib/riak/bitcask/682224397113448823145860693396858675190952886272/4.bitcask.data",
>            5,34273270,336960838}]}]
>
> VNode: 693642378655096502194326981152454636282014859264
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185571},
>
>  {status,[{"/var/lib/riak/bitcask/693642378655096502194326981152454636282014859264/4.bitcask.data",
>            5,33173397,331159169}]}]
>
> VNode: 705060360196744181242793268908050597373076832256
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186008},
>
>  {status,[{"/var/lib/riak/bitcask/705060360196744181242793268908050597373076832256/4.bitcask.data",
>            5,32475858,334556980}]}]
>
> VNode: 716478341738391860291259556663646558464138805248
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185593},
>
>  {status,[{"/var/lib/riak/bitcask/716478341738391860291259556663646558464138805248/4.bitcask.data",
>            5,33130883,341173503}]}]
>
> VNode: 727896323280039539339725844419242519555200778240
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185629},
>
>  {status,[{"/var/lib/riak/bitcask/727896323280039539339725844419242519555200778240/4.bitcask.data",
>            5,33103829,336311860}]}]
>
> VNode: 739314304821687218388192132174838480646262751232
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185624},
>
>  {status,[{"/var/lib/riak/bitcask/739314304821687218388192132174838480646262751232/4.bitcask.data",
>            5,31556811,334381544}]}]
>
> VNode: 750732286363334897436658419930434441737324724224
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186224},
>
>  {status,[{"/var/lib/riak/bitcask/750732286363334897436658419930434441737324724224/4.bitcask.data",
>            5,30142108,342742989}]}]
>
> VNode: 762150267904982576485124707686030402828386697216
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185299},
>
>  {status,[{"/var/lib/riak/bitcask/762150267904982576485124707686030402828386697216/4.bitcask.data",
>            5,32275793,339187482}]}]
>
> VNode: 773568249446630255533590995441626363919448670208
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185603},
>
>  {status,[{"/var/lib/riak/bitcask/773568249446630255533590995441626363919448670208/4.bitcask.data",
>            5,30237450,330464324}]}]
>
> VNode: 784986230988277934582057283197222325010510643200
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186145},
>
>  {status,[{"/var/lib/riak/bitcask/784986230988277934582057283197222325010510643200/4.bitcask.data",
>            5,30762226,337042253}]}]
>
> VNode: 796404212529925613630523570952818286101572616192
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186029},
>
>  {status,[{"/var/lib/riak/bitcask/796404212529925613630523570952818286101572616192/4.bitcask.data",
>            5,33089921,342650037}]}]
>
> VNode: 807822194071573292678989858708414247192634589184
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186228},
>
>  {status,[{"/var/lib/riak/bitcask/807822194071573292678989858708414247192634589184/4.bitcask.data",
>            5,31644203,336945269}]}]
>
> VNode: 819240175613220971727456146464010208283696562176
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185946},
>
>  {status,[{"/var/lib/riak/bitcask/819240175613220971727456146464010208283696562176/4.bitcask.data",
>            5,34478537,335108377}]}]
>
> VNode: 830658157154868650775922434219606169374758535168
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185938},
>
>  {status,[{"/var/lib/riak/bitcask/830658157154868650775922434219606169374758535168/4.bitcask.data",
>            5,32153080,336335603}]}]
>
> VNode: 842076138696516329824388721975202130465820508160
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185119},
>
>  {status,[{"/var/lib/riak/bitcask/842076138696516329824388721975202130465820508160/4.bitcask.data",
>            5,32662173,342685946}]}]
>
> VNode: 853494120238164008872855009730798091556882481152
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186095},
>
>  {status,[{"/var/lib/riak/bitcask/853494120238164008872855009730798091556882481152/4.bitcask.data",
>            5,31724299,338609269}]}]
>
> VNode: 864912101779811687921321297486394052647944454144
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185978},
>
>  {status,[{"/var/lib/riak/bitcask/864912101779811687921321297486394052647944454144/4.bitcask.data",
>            5,31688977,332396013}]}]
>
> VNode: 876330083321459366969787585241990013739006427136
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186038},
>
>  {status,[{"/var/lib/riak/bitcask/876330083321459366969787585241990013739006427136/9.bitcask.data",
>            1,82942,4223127},
>
> {"/var/lib/riak/bitcask/876330083321459366969787585241990013739006427136/8.bitcask.data",
>            2,20442384,94777157},
>
> {"/var/lib/riak/bitcask/876330083321459366969787585241990013739006427136/5.bitcask.data",
>            5,26398003,329299684}]}]
>
> VNode: 887748064863107046018253872997585974830068400128
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185605},
>
>  {status,[{"/var/lib/riak/bitcask/887748064863107046018253872997585974830068400128/4.bitcask.data",
>            5,32415353,335591556}]}]
>
> VNode: 1173197603404299022229911066887485002106617724928
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185976},
>
>  {status,[{"/var/lib/riak/bitcask/1173197603404299022229911066887485002106617724928/4.bitcask.data",
>            5,32719451,334916473}]}]
>
> VNode: 1184615584945946701278377354643080963197679697920
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186439},
>
>  {status,[{"/var/lib/riak/bitcask/1184615584945946701278377354643080963197679697920/7.bitcask.data",
>            2,20171431,87739364},
>
> {"/var/lib/riak/bitcask/1184615584945946701278377354643080963197679697920/4.bitcask.data",
>            5,34315029,334169356}]}]
>
> VNode: 1196033566487594380326843642398676924288741670912
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185659},
>
>  {status,[{"/var/lib/riak/bitcask/1196033566487594380326843642398676924288741670912/4.bitcask.data",
>            5,34544534,339094321}]}]
>
> VNode: 1207451548029242059375309930154272885379803643904
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185309},
>
>  {status,[{"/var/lib/riak/bitcask/1207451548029242059375309930154272885379803643904/4.bitcask.data",
>            5,34049175,334609625}]}]
>
> VNode: 1218869529570889738423776217909868846470865616896
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185067},
>
>  {status,[{"/var/lib/riak/bitcask/1218869529570889738423776217909868846470865616896/9.bitcask.data",
>            5,21798031,55300856},
>
> {"/var/lib/riak/bitcask/1218869529570889738423776217909868846470865616896/6.bitcask.data",
>            7,19228418,50004789},
>
> {"/var/lib/riak/bitcask/1218869529570889738423776217909868846470865616896/5.bitcask.data",
>            7,25130869,298276178}]}]
>
> VNode: 1230287511112537417472242505665464807561927589888
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185677},
>
>  {status,[{"/var/lib/riak/bitcask/1230287511112537417472242505665464807561927589888/4.bitcask.data",
>            5,34162507,338171429}]}]
>
> VNode: 1241705492654185096520708793421060768652989562880
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185480},
>
>  {status,[{"/var/lib/riak/bitcask/1241705492654185096520708793421060768652989562880/4.bitcask.data",
>            5,32122493,340603091}]}]
>
> VNode: 1253123474195832775569175081176656729744051535872
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186191},
>
>  {status,[{"/var/lib/riak/bitcask/1253123474195832775569175081176656729744051535872/4.bitcask.data",
>            5,32683442,337318456}]}]
>
> VNode: 1264541455737480454617641368932252690835113508864
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185594},
>
>  {status,[{"/var/lib/riak/bitcask/1264541455737480454617641368932252690835113508864/4.bitcask.data",
>            5,33864031,342388629}]}]
>
> VNode: 1275959437279128133666107656687848651926175481856
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185644},
>
>  {status,[{"/var/lib/riak/bitcask/1275959437279128133666107656687848651926175481856/4.bitcask.data",
>            5,33250712,338253781}]}]
>
> VNode: 1287377418820775812714573944443444613017237454848
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185323},
>
>  {status,[{"/var/lib/riak/bitcask/1287377418820775812714573944443444613017237454848/4.bitcask.data",
>            5,32485461,339612430}]}]
>
> VNode: 1298795400362423491763040232199040574108299427840
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185903},
>
>  {status,[{"/var/lib/riak/bitcask/1298795400362423491763040232199040574108299427840/4.bitcask.data",
>            5,32102630,336913196}]}]
>
> VNode: 1310213381904071170811506519954636535199361400832
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185513},
>
>  {status,[{"/var/lib/riak/bitcask/1310213381904071170811506519954636535199361400832/4.bitcask.data",
>            5,32704593,337827399}]}]
>
> VNode: 1321631363445718849859972807710232496290423373824
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185796},
>
>  {status,[{"/var/lib/riak/bitcask/1321631363445718849859972807710232496290423373824/4.bitcask.data",
>            5,31667414,344554808}]}]
>
> VNode: 1333049344987366528908439095465828457381485346816
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,184729},
>
>  {status,[{"/var/lib/riak/bitcask/1333049344987366528908439095465828457381485346816/4.bitcask.data",
>            5,31916929,331982952}]}]
>
> VNode: 1344467326529014207956905383221424418472547319808
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186374},
>
>  {status,[{"/var/lib/riak/bitcask/1344467326529014207956905383221424418472547319808/4.bitcask.data",
>            5,32011535,336838669}]}]
>
> VNode: 1355885308070661887005371670977020379563609292800
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185097},
>
>  {status,[{"/var/lib/riak/bitcask/1355885308070661887005371670977020379563609292800/4.bitcask.data",
>            5,31257938,327694910}]}]
>
> VNode: 1367303289612309566053837958732616340654671265792
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185280},
>
>  {status,[{"/var/lib/riak/bitcask/1367303289612309566053837958732616340654671265792/4.bitcask.data",
>            5,33641764,341085585}]}]
>
> VNode: 1378721271153957245102304246488212301745733238784
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185792},
>
>  {status,[{"/var/lib/riak/bitcask/1378721271153957245102304246488212301745733238784/5.bitcask.data",
>            5,32139774,336659768}]}]
>
> VNode: 1390139252695604924150770534243808262836795211776
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185647},
>
>  {status,[{"/var/lib/riak/bitcask/1390139252695604924150770534243808262836795211776/5.bitcask.data",
>            5,31422173,335753645}]}]
>
> VNode: 1401557234237252603199236821999404223927857184768
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185641},
>
>  {status,[{"/var/lib/riak/bitcask/1401557234237252603199236821999404223927857184768/5.bitcask.data",
>            5,32892084,335640971}]}]
>
> VNode: 1412975215778900282247703109755000185018919157760
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185982},
>
>  {status,[{"/var/lib/riak/bitcask/1412975215778900282247703109755000185018919157760/5.bitcask.data",
>            5,32650794,337720285}]}]
>
> VNode: 1424393197320547961296169397510596146109981130752
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186569},
>
>  {status,[{"/var/lib/riak/bitcask/1424393197320547961296169397510596146109981130752/5.bitcask.data",
>            5,31520831,340970872}]}]
>
> VNode: 1435811178862195640344635685266192107201043103744
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186322},
>
>  {status,[{"/var/lib/riak/bitcask/1435811178862195640344635685266192107201043103744/5.bitcask.data",
>            5,32047072,337905167}]}]
>
> VNode: 1447229160403843319393101973021788068292105076736
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,186082},
>
>  {status,[{"/var/lib/riak/bitcask/1447229160403843319393101973021788068292105076736/5.bitcask.data",
>            5,32158728,335402990}]}]
>
> VNode: 1458647141945490998441568260777384029383167049728
> Backend: riak_kv_bitcask_backend
> Status:
> [{key_count,185244},
>
>  {status,[{"/var/lib/riak/bitcask/1458647141945490998441568260777384029383167049728/7.bitcask.data",
>            3,20056866,73970408},
>
> {"/var/lib/riak/bitcask/1458647141945490998441568260777384029383167049728/5.bitcask.data",
>            5,32748739,331478355}]}]
>
>
> On Tue, Jan 22, 2013 at 11:03 AM, Brian Sparrow <bsparrow at basho.com>wrote:
>
>  What is reported by riak-admin vnode_status?
>
> Thanks,
> Brian
>
> --
> Brian Sparrow
> Developer Advocate
> Basho Technologies
>
> Sent with Sparrow <http://www.sparrowmailapp.com/?sig>
>
> On Tuesday, January 22, 2013 at 10:49 AM, Ian Ha wrote:
>
> Thanks Brian. This is very helpful and informative!
>
> Only question is we do indeed have data files that are > 2GB that haven't
> merged. I have a data file at 2.1G, as of today. The last merged happened
> Jan 20, which was two days ago.
>
> Anything we are missing here?
>
>
> On Sat, Jan 19, 2013 at 2:01 PM, Brian Sparrow <bsparrow at basho.com> wrote:
>
>  Hi Ian,
>
> Q: Why does this happen on a restart only and not at other times, even
> though we have set our merge_window config setting to 'always'?
>
> A: The merge_window setting defaults to always and that simply means that
> bitcask will merge anytime the merge_triggers and thresholds set in the
> app.config are satisfied on a closed bitcask file. A bitcask data file is
> closed when it reaches the max_file_size threshold set in
> app.config(default of 2GB) or the node is stopped. Merging is happening on
> restart because this file is now closed and eligible for merge. You are not
> seeing merging during normal operation because the files are not reaching
> the 2GB max_file_size.
>
> Q: I'm assuming our config values are correct as the restart considers the
> thresholds met to go ahead with a merge.
>
> A: I do not see anything wrong with your configuration with the exception
> of no max_file_size being set. If you want to merge more often, reduce the
> max_file size to 1GB or lower(the lower the file size, the more merging). A
> good way to estimate the appropriate size is to look at how large your
> .data files are getting in your bitcask data directory and deciding from
> there what size threshold you would like to set based on your disk usage
> needs.
>
> Q: Also: Are there any tools out there that I can run on my data directory
> that will tell me the size of the dead byte ratios? Would be nice to see
> what the dead byte 'state' of my data dir is in so I can tell whether
> indeed merge conditions are met.
>
> A: The command you are looking for is riak-admin vnode_status. This will
> list all partitions on the local node as well as the number of keys in each
> partition and a list of closed bitcask data files in the format:
>
> {CLOSE_DATA_FILE_NAME, FRAG_PERCENTAGE, DEAD_BYTES, TOTAL_FILE_SIZE}
>
> Again, a data file must be closed(reached max_file_size or closed by node
> stop) to be reported in this command.
>
> Hope this answers all your questions.
>
> Thanks!
>
>
> --
> Brian Sparrow
> Customer Service Engineer
> Basho Technologies
>
> On Friday, January 18, 2013 at 5:14 PM, Ian Ha wrote:
>
> Hi,
>
> In our production system, we notice that merges are not taking place. We
> have noticed, however, that when we restart riak (via a 'riak stop' then a
> 'riak start'), then the merges are triggered and our disk usage goes way
> day (which is what we want). We use bitcask.
>
> Why does this happen on a restart only and not at other times, even though
> we have set our merge_window config setting to 'always'?
>
> I'm assuming our config values are correct as the restart considers the
> thresholds met to go ahead with a merge.
>
> Also: Are there any tools out there that I can run on my data directory
> that will tell me the size of the dead byte ratios? Would be nice to see
> what the dead byte 'state' of my data dir is in so I can tell whether
> indeed merge conditions are met.
>
> Our bit cask configs are as follows in app.config:
>
> {bitcask, [
>                 {data_root, "/var/lib/riak/bitcask"},
>                 {dead_bytes_merge_trigger, 268435456},
>                 {dead_bytes_threshold, 134217728},
>                 {expiry_secs, 3888000},
>                 {frag_merge_trigger, 40},
>                 {frag_threshold, 20},
>                 {merge_window, always},
>                 {small_file_threshold, 10485760},
>                 {sync_strategy, none}
>         ]},
>
>
> Thanks!
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
>
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20130122/69f632dc/attachment.html>


More information about the riak-users mailing list