Riak Merge On Restarts Only

Brian Sparrow bsparrow at basho.com
Tue Jan 22 11:42:22 EST 2013


If the file is not reported in vnode_status then the file has not yet been closed. Is there a more recent(and smaller size) .data file in that partition? That file could just be on the edge of being closed.

To confirm you bitcask settings, from `riak attach` on any node run `application:get_all_env(bitcask).`

Further, you can enable logging whenever a file passes the merge triggers with the log_needs_merge setting in the bitcask settings in app.config. ex: {log_needs_merge, true},

This will log anytime a file is ready to be merged. If you do not see a subsequent merge after the log entry then the file did not pass one of the thresholds to allow the merge.

-Brian 

-- 
Brian Sparrow
Developer Advocate
Basho Technologies

Sent with Sparrow (http://www.sparrowmailapp.com/?sig)


On Tuesday, January 22, 2013 at 11:18 AM, Ian Ha wrote:

> Brian, here's the dump for vnode_status. Interesetingly enough, the 2.1G file at 271177061614132377401074334195404075912721858560/5.bitcask.data is not part of this dump. Not sure why or if that is a concern?
> 
> Vnode status information
> -------------------------------------------
> 
> VNode: 8563486156235759286349715816696970818296479744
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185800},
>  {status,[{"/var/lib/riak/bitcask/8563486156235759286349715816696970818296479744/4.bitcask.data",
>            5,31874309,338046717}]}]
> 
> VNode: 19981467697883438334816003572292931909358452736
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185635},
>  {status,[{"/var/lib/riak/bitcask/19981467697883438334816003572292931909358452736/4.bitcask.data",
>            5,34907347,342699456}]}]
> 
> VNode: 31399449239531117383282291327888893000420425728
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,184771},
>  {status,[{"/var/lib/riak/bitcask/31399449239531117383282291327888893000420425728/4.bitcask.data",
>            5,32830995,329973073}]}]
> 
> VNode: 42817430781178796431748579083484854091482398720 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,184847},
>  {status,[{"/var/lib/riak/bitcask/42817430781178796431748579083484854091482398720/7.bitcask.data",
>            1,18113882,91425091},
>           {"/var/lib/riak/bitcask/42817430781178796431748579083484854091482398720/4.bitcask.data",
>            5,31974540,334178572}]}]
> 
> VNode: 54235412322826475480214866839080815182544371712 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186027},
>  {status,[{"/var/lib/riak/bitcask/54235412322826475480214866839080815182544371712/4.bitcask.data",
>            5,31978319,338241457}]}]
> 
> VNode: 65653393864474154528681154594676776273606344704
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185753},
>  {status,[{"/var/lib/riak/bitcask/65653393864474154528681154594676776273606344704/4.bitcask.data",
>            5,33745910,339735357}]}]
> 
> VNode: 77071375406121833577147442350272737364668317696
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185840},
>  {status,[{"/var/lib/riak/bitcask/77071375406121833577147442350272737364668317696/4.bitcask.data",
>            5,30572735,337791556}]}]
> 
> VNode: 88489356947769512625613730105868698455730290688 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186673},
>  {status,[{"/var/lib/riak/bitcask/88489356947769512625613730105868698455730290688/4.bitcask.data",
>            5,32874502,336092493}]}]
> 
> VNode: 99907338489417191674080017861464659546792263680
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,184970},
>  {status,[{"/var/lib/riak/bitcask/99907338489417191674080017861464659546792263680/4.bitcask.data",
>            5,32396426,330001394}]}]
> 
> VNode: 111325320031064870722546305617060620637854236672
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185248},
>  {status,[{"/var/lib/riak/bitcask/111325320031064870722546305617060620637854236672/4.bitcask.data",
>            5,34161176,335074205}]}]
> 
> VNode: 122743301572712549771012593372656581728916209664 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185760},
>  {status,[{"/var/lib/riak/bitcask/122743301572712549771012593372656581728916209664/4.bitcask.data",
>            5,30889834,335031242}]}]
> 
> VNode: 134161283114360228819478881128252542819978182656
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185590},
>  {status,[{"/var/lib/riak/bitcask/134161283114360228819478881128252542819978182656/4.bitcask.data",
>            5,32798615,337772144}]}]
> 
> VNode: 145579264656007907867945168883848503911040155648
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185460},
>  {status,[{"/var/lib/riak/bitcask/145579264656007907867945168883848503911040155648/4.bitcask.data",
>            5,33085394,336272206}]}]
> 
> VNode: 156997246197655586916411456639444465002102128640 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186096},
>  {status,[{"/var/lib/riak/bitcask/156997246197655586916411456639444465002102128640/4.bitcask.data",
>            5,34342279,336669714}]}]
> 
> VNode: 168415227739303265964877744395040426093164101632
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185756},
>  {status,[{"/var/lib/riak/bitcask/168415227739303265964877744395040426093164101632/4.bitcask.data",
>            5,29834588,334221105}]}]
> 
> VNode: 179833209280950945013344032150636387184226074624
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185663},
>  {status,[{"/var/lib/riak/bitcask/179833209280950945013344032150636387184226074624/7.bitcask.data",
>            1,4326604,84769249},
>           {"/var/lib/riak/bitcask/179833209280950945013344032150636387184226074624/4.bitcask.data",
>            5,32222921,327833678}]}]
> 
> VNode: 191251190822598624061810319906232348275288047616
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185930},
>  {status,[{"/var/lib/riak/bitcask/191251190822598624061810319906232348275288047616/4.bitcask.data",
>            5,32790298,341206859}]}]
> 
> VNode: 202669172364246303110276607661828309366350020608 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185911},
>  {status,[{"/var/lib/riak/bitcask/202669172364246303110276607661828309366350020608/4.bitcask.data",
>            5,30258774,334550584}]}]
> 
> VNode: 214087153905893982158742895417424270457411993600
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185180},
>  {status,[{"/var/lib/riak/bitcask/214087153905893982158742895417424270457411993600/4.bitcask.data",
>            5,34331320,338067428}]}]
> 
> VNode: 225505135447541661207209183173020231548473966592
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185486},
>  {status,[{"/var/lib/riak/bitcask/225505135447541661207209183173020231548473966592/4.bitcask.data",
>            5,33282502,336653351}]}]
> 
> VNode: 236923116989189340255675470928616192639535939584 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185553},
>  {status,[{"/var/lib/riak/bitcask/236923116989189340255675470928616192639535939584/4.bitcask.data",
>            5,35582186,339871589}]}]
> 
> VNode: 248341098530837019304141758684212153730597912576
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185181},
>  {status,[{"/var/lib/riak/bitcask/248341098530837019304141758684212153730597912576/4.bitcask.data",
>            5,33057915,343594362}]}]
> 
> VNode: 259759080072484698352608046439808114821659885568
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185155},
>  {status,[{"/var/lib/riak/bitcask/259759080072484698352608046439808114821659885568/4.bitcask.data",
>            5,31763402,336956394}]}]
> 
> VNode: 271177061614132377401074334195404075912721858560 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185760},
>  {status,[{"/var/lib/riak/bitcask/271177061614132377401074334195404075912721858560/4.bitcask.data",
>            5,35371762,340778827}]}]
> 
> VNode: 282595043155780056449540621951000037003783831552
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185797},
>  {status,[{"/var/lib/riak/bitcask/282595043155780056449540621951000037003783831552/4.bitcask.data",
>            5,31127659,341388940}]}]
> 
> VNode: 294013024697427735498006909706595998094845804544
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185400},
>  {status,[{"/var/lib/riak/bitcask/294013024697427735498006909706595998094845804544/4.bitcask.data",
>            5,33172810,335029860}]}]
> 
> VNode: 305431006239075414546473197462191959185907777536 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185370},
>  {status,[{"/var/lib/riak/bitcask/305431006239075414546473197462191959185907777536/4.bitcask.data",
>            5,35447783,339131698}]}]
> 
> VNode: 316848987780723093594939485217787920276969750528
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185306},
>  {status,[{"/var/lib/riak/bitcask/316848987780723093594939485217787920276969750528/4.bitcask.data",
>            5,33100563,334514005}]}]
> 
> VNode: 328266969322370772643405772973383881368031723520
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185587},
>  {status,[{"/var/lib/riak/bitcask/328266969322370772643405772973383881368031723520/4.bitcask.data",
>            5,31554776,329354531}]}]
> 
> VNode: 339684950864018451691872060728979842459093696512 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,184990},
>  {status,[{"/var/lib/riak/bitcask/339684950864018451691872060728979842459093696512/7.bitcask.data",
>            2,17893708,87660389},
>           {"/var/lib/riak/bitcask/339684950864018451691872060728979842459093696512/4.bitcask.data",
>            5,32530630,332735318}]}]
> 
> VNode: 351102932405666130740338348484575803550155669504 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185489},
>  {status,[{"/var/lib/riak/bitcask/351102932405666130740338348484575803550155669504/7.bitcask.data",
>            1,16949080,90740582},
>           {"/var/lib/riak/bitcask/351102932405666130740338348484575803550155669504/4.bitcask.data",
>            5,31736396,336629981}]}]
> 
> VNode: 362520913947313809788804636240171764641217642496 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185317},
>  {status,[{"/var/lib/riak/bitcask/362520913947313809788804636240171764641217642496/4.bitcask.data",
>            5,34728997,335644618}]}]
> 
> VNode: 373938895488961488837270923995767725732279615488
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185189},
>  {status,[{"/var/lib/riak/bitcask/373938895488961488837270923995767725732279615488/4.bitcask.data",
>            5,33860427,338229690}]}]
> 
> VNode: 385356877030609167885737211751363686823341588480
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185076},
>  {status,[{"/var/lib/riak/bitcask/385356877030609167885737211751363686823341588480/4.bitcask.data",
>            5,32015829,331802410}]}]
> 
> VNode: 396774858572256846934203499506959647914403561472 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185502},
>  {status,[{"/var/lib/riak/bitcask/396774858572256846934203499506959647914403561472/4.bitcask.data",
>            5,34371519,338605515}]}]
> 
> VNode: 408192840113904525982669787262555609005465534464
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186081},
>  {status,[{"/var/lib/riak/bitcask/408192840113904525982669787262555609005465534464/10.bitcask.data",
>            6,490500,3116567},
>           {"/var/lib/riak/bitcask/408192840113904525982669787262555609005465534464/8.bitcask.data",
>            5,26188498,171694974},
>           {"/var/lib/riak/bitcask/408192840113904525982669787262555609005465534464/6.bitcask.data",
>            17,11782388,73101186},
>           {"/var/lib/riak/bitcask/408192840113904525982669787262555609005465534464/4.bitcask.data",
>            13,20195069,117631531}]}]
> 
> VNode: 419610821655552205031136075018151570096527507456
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185717},
>  {status,[{"/var/lib/riak/bitcask/419610821655552205031136075018151570096527507456/4.bitcask.data",
>            5,31829307,331435676}]}]
> 
> VNode: 431028803197199884079602362773747531187589480448
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185947},
>  {status,[{"/var/lib/riak/bitcask/431028803197199884079602362773747531187589480448/4.bitcask.data",
>            5,32173706,338148596}]}]
> 
> VNode: 442446784738847563128068650529343492278651453440 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185537},
>  {status,[{"/var/lib/riak/bitcask/442446784738847563128068650529343492278651453440/4.bitcask.data",
>            5,35813666,338837080}]}]
> 
> VNode: 453864766280495242176534938284939453369713426432
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185746},
>  {status,[{"/var/lib/riak/bitcask/453864766280495242176534938284939453369713426432/4.bitcask.data",
>            5,32624042,334740185}]}]
> 
> VNode: 465282747822142921225001226040535414460775399424
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185468},
>  {status,[{"/var/lib/riak/bitcask/465282747822142921225001226040535414460775399424/7.bitcask.data",
>            2,20331282,91766521},
>           {"/var/lib/riak/bitcask/465282747822142921225001226040535414460775399424/4.bitcask.data",
>            5,32647444,344746992}]}]
> 
> VNode: 476700729363790600273467513796131375551837372416
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185831},
>  {status,[{"/var/lib/riak/bitcask/476700729363790600273467513796131375551837372416/4.bitcask.data",
>            5,32209907,332813073}]}]
> 
> VNode: 488118710905438279321933801551727336642899345408 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186592},
>  {status,[{"/var/lib/riak/bitcask/488118710905438279321933801551727336642899345408/4.bitcask.data",
>            5,33320036,333898295}]}]
> 
> VNode: 499536692447085958370400089307323297733961318400
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185629},
>  {status,[{"/var/lib/riak/bitcask/499536692447085958370400089307323297733961318400/4.bitcask.data",
>            5,33497617,343082792}]}]
> 
> VNode: 510954673988733637418866377062919258825023291392
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185481},
>  {status,[{"/var/lib/riak/bitcask/510954673988733637418866377062919258825023291392/4.bitcask.data",
>            5,32209418,336325646}]}]
> 
> VNode: 522372655530381316467332664818515219916085264384 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185230},
>  {status,[{"/var/lib/riak/bitcask/522372655530381316467332664818515219916085264384/4.bitcask.data",
>            5,34077445,337997080}]}]
> 
> VNode: 533790637072028995515798952574111181007147237376
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186355},
>  {status,[{"/var/lib/riak/bitcask/533790637072028995515798952574111181007147237376/4.bitcask.data",
>            5,30786415,335334027}]}]
> 
> VNode: 545208618613676674564265240329707142098209210368
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186271},
>  {status,[{"/var/lib/riak/bitcask/545208618613676674564265240329707142098209210368/4.bitcask.data",
>            5,32730917,335737716}]}]
> 
> VNode: 556626600155324353612731528085303103189271183360 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186035},
>  {status,[{"/var/lib/riak/bitcask/556626600155324353612731528085303103189271183360/7.bitcask.data",
>            1,4873700,85319443},
>           {"/var/lib/riak/bitcask/556626600155324353612731528085303103189271183360/4.bitcask.data",
>            5,31326139,336025933}]}]
> 
> VNode: 568044581696972032661197815840899064280333156352 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,184440},
>  {status,[{"/var/lib/riak/bitcask/568044581696972032661197815840899064280333156352/4.bitcask.data",
>            5,32950443,333793428}]}]
> 
> VNode: 579462563238619711709664103596495025371395129344
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185118},
>  {status,[{"/var/lib/riak/bitcask/579462563238619711709664103596495025371395129344/4.bitcask.data",
>            5,31707260,338029164}]}]
> 
> VNode: 590880544780267390758130391352090986462457102336
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185254},
>  {status,[{"/var/lib/riak/bitcask/590880544780267390758130391352090986462457102336/4.bitcask.data",
>            5,33033620,333558333}]}]
> 
> VNode: 602298526321915069806596679107686947553519075328 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185817},
>  {status,[{"/var/lib/riak/bitcask/602298526321915069806596679107686947553519075328/4.bitcask.data",
>            5,33359523,340174269}]}]
> 
> VNode: 613716507863562748855062966863282908644581048320
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185892},
>  {status,[{"/var/lib/riak/bitcask/613716507863562748855062966863282908644581048320/4.bitcask.data",
>            5,32059047,335268151}]}]
> 
> VNode: 625134489405210427903529254618878869735643021312
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185479},
>  {status,[{"/var/lib/riak/bitcask/625134489405210427903529254618878869735643021312/4.bitcask.data",
>            5,31377434,333663874}]}]
> 
> VNode: 636552470946858106951995542374474830826704994304 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186471},
>  {status,[{"/var/lib/riak/bitcask/636552470946858106951995542374474830826704994304/4.bitcask.data",
>            5,31637370,331456191}]}]
> 
> VNode: 647970452488505786000461830130070791917766967296
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185696},
>  {status,[{"/var/lib/riak/bitcask/647970452488505786000461830130070791917766967296/4.bitcask.data",
>            5,33490059,341805230}]}]
> 
> VNode: 659388434030153465048928117885666753008828940288
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185111},
>  {status,[{"/var/lib/riak/bitcask/659388434030153465048928117885666753008828940288/4.bitcask.data",
>            5,33355158,339718408}]}]
> 
> VNode: 670806415571801144097394405641262714099890913280 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185663},
>  {status,[{"/var/lib/riak/bitcask/670806415571801144097394405641262714099890913280/4.bitcask.data",
>            5,33049532,339186274}]}]
> 
> VNode: 682224397113448823145860693396858675190952886272
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185580},
>  {status,[{"/var/lib/riak/bitcask/682224397113448823145860693396858675190952886272/4.bitcask.data",
>            5,34273270,336960838}]}]
> 
> VNode: 693642378655096502194326981152454636282014859264
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185571},
>  {status,[{"/var/lib/riak/bitcask/693642378655096502194326981152454636282014859264/4.bitcask.data",
>            5,33173397,331159169}]}]
> 
> VNode: 705060360196744181242793268908050597373076832256 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186008},
>  {status,[{"/var/lib/riak/bitcask/705060360196744181242793268908050597373076832256/4.bitcask.data",
>            5,32475858,334556980}]}]
> 
> VNode: 716478341738391860291259556663646558464138805248
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185593},
>  {status,[{"/var/lib/riak/bitcask/716478341738391860291259556663646558464138805248/4.bitcask.data",
>            5,33130883,341173503}]}]
> 
> VNode: 727896323280039539339725844419242519555200778240
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185629},
>  {status,[{"/var/lib/riak/bitcask/727896323280039539339725844419242519555200778240/4.bitcask.data",
>            5,33103829,336311860}]}]
> 
> VNode: 739314304821687218388192132174838480646262751232 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185624},
>  {status,[{"/var/lib/riak/bitcask/739314304821687218388192132174838480646262751232/4.bitcask.data",
>            5,31556811,334381544}]}]
> 
> VNode: 750732286363334897436658419930434441737324724224
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186224},
>  {status,[{"/var/lib/riak/bitcask/750732286363334897436658419930434441737324724224/4.bitcask.data",
>            5,30142108,342742989}]}]
> 
> VNode: 762150267904982576485124707686030402828386697216
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185299},
>  {status,[{"/var/lib/riak/bitcask/762150267904982576485124707686030402828386697216/4.bitcask.data",
>            5,32275793,339187482}]}]
> 
> VNode: 773568249446630255533590995441626363919448670208 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185603},
>  {status,[{"/var/lib/riak/bitcask/773568249446630255533590995441626363919448670208/4.bitcask.data",
>            5,30237450,330464324}]}]
> 
> VNode: 784986230988277934582057283197222325010510643200
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186145},
>  {status,[{"/var/lib/riak/bitcask/784986230988277934582057283197222325010510643200/4.bitcask.data",
>            5,30762226,337042253}]}]
> 
> VNode: 796404212529925613630523570952818286101572616192
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186029},
>  {status,[{"/var/lib/riak/bitcask/796404212529925613630523570952818286101572616192/4.bitcask.data",
>            5,33089921,342650037}]}]
> 
> VNode: 807822194071573292678989858708414247192634589184 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186228},
>  {status,[{"/var/lib/riak/bitcask/807822194071573292678989858708414247192634589184/4.bitcask.data",
>            5,31644203,336945269}]}]
> 
> VNode: 819240175613220971727456146464010208283696562176
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185946},
>  {status,[{"/var/lib/riak/bitcask/819240175613220971727456146464010208283696562176/4.bitcask.data",
>            5,34478537,335108377}]}]
> 
> VNode: 830658157154868650775922434219606169374758535168
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185938},
>  {status,[{"/var/lib/riak/bitcask/830658157154868650775922434219606169374758535168/4.bitcask.data",
>            5,32153080,336335603}]}]
> 
> VNode: 842076138696516329824388721975202130465820508160 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185119},
>  {status,[{"/var/lib/riak/bitcask/842076138696516329824388721975202130465820508160/4.bitcask.data",
>            5,32662173,342685946}]}]
> 
> VNode: 853494120238164008872855009730798091556882481152
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186095},
>  {status,[{"/var/lib/riak/bitcask/853494120238164008872855009730798091556882481152/4.bitcask.data",
>            5,31724299,338609269}]}]
> 
> VNode: 864912101779811687921321297486394052647944454144
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185978},
>  {status,[{"/var/lib/riak/bitcask/864912101779811687921321297486394052647944454144/4.bitcask.data",
>            5,31688977,332396013}]}]
> 
> VNode: 876330083321459366969787585241990013739006427136 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186038},
>  {status,[{"/var/lib/riak/bitcask/876330083321459366969787585241990013739006427136/9.bitcask.data",
>            1,82942,4223127},
>           {"/var/lib/riak/bitcask/876330083321459366969787585241990013739006427136/8.bitcask.data",
>            2,20442384,94777157},
>           {"/var/lib/riak/bitcask/876330083321459366969787585241990013739006427136/5.bitcask.data",
>            5,26398003,329299684}]}]
> 
> VNode: 887748064863107046018253872997585974830068400128
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185605},
>  {status,[{"/var/lib/riak/bitcask/887748064863107046018253872997585974830068400128/4.bitcask.data",
>            5,32415353,335591556}]}]
> 
> VNode: 1173197603404299022229911066887485002106617724928 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185976},
>  {status,[{"/var/lib/riak/bitcask/1173197603404299022229911066887485002106617724928/4.bitcask.data",
>            5,32719451,334916473}]}]
> 
> VNode: 1184615584945946701278377354643080963197679697920
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186439},
>  {status,[{"/var/lib/riak/bitcask/1184615584945946701278377354643080963197679697920/7.bitcask.data",
>            2,20171431,87739364},
>           {"/var/lib/riak/bitcask/1184615584945946701278377354643080963197679697920/4.bitcask.data",
>            5,34315029,334169356}]}]
> 
> VNode: 1196033566487594380326843642398676924288741670912
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185659},
>  {status,[{"/var/lib/riak/bitcask/1196033566487594380326843642398676924288741670912/4.bitcask.data",
>            5,34544534,339094321}]}]
> 
> VNode: 1207451548029242059375309930154272885379803643904
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185309},
>  {status,[{"/var/lib/riak/bitcask/1207451548029242059375309930154272885379803643904/4.bitcask.data",
>            5,34049175,334609625}]}]
> 
> VNode: 1218869529570889738423776217909868846470865616896 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185067},
>  {status,[{"/var/lib/riak/bitcask/1218869529570889738423776217909868846470865616896/9.bitcask.data",
>            5,21798031,55300856},
>           {"/var/lib/riak/bitcask/1218869529570889738423776217909868846470865616896/6.bitcask.data",
>            7,19228418,50004789},
>           {"/var/lib/riak/bitcask/1218869529570889738423776217909868846470865616896/5.bitcask.data",
>            7,25130869,298276178}]}]
> 
> VNode: 1230287511112537417472242505665464807561927589888
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185677},
>  {status,[{"/var/lib/riak/bitcask/1230287511112537417472242505665464807561927589888/4.bitcask.data",
>            5,34162507,338171429}]}]
> 
> VNode: 1241705492654185096520708793421060768652989562880 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185480},
>  {status,[{"/var/lib/riak/bitcask/1241705492654185096520708793421060768652989562880/4.bitcask.data",
>            5,32122493,340603091}]}]
> 
> VNode: 1253123474195832775569175081176656729744051535872
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186191},
>  {status,[{"/var/lib/riak/bitcask/1253123474195832775569175081176656729744051535872/4.bitcask.data",
>            5,32683442,337318456}]}]
> 
> VNode: 1264541455737480454617641368932252690835113508864
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185594},
>  {status,[{"/var/lib/riak/bitcask/1264541455737480454617641368932252690835113508864/4.bitcask.data",
>            5,33864031,342388629}]}]
> 
> VNode: 1275959437279128133666107656687848651926175481856 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185644},
>  {status,[{"/var/lib/riak/bitcask/1275959437279128133666107656687848651926175481856/4.bitcask.data",
>            5,33250712,338253781}]}]
> 
> VNode: 1287377418820775812714573944443444613017237454848
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185323},
>  {status,[{"/var/lib/riak/bitcask/1287377418820775812714573944443444613017237454848/4.bitcask.data",
>            5,32485461,339612430}]}]
> 
> VNode: 1298795400362423491763040232199040574108299427840
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185903},
>  {status,[{"/var/lib/riak/bitcask/1298795400362423491763040232199040574108299427840/4.bitcask.data",
>            5,32102630,336913196}]}]
> 
> VNode: 1310213381904071170811506519954636535199361400832 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185513},
>  {status,[{"/var/lib/riak/bitcask/1310213381904071170811506519954636535199361400832/4.bitcask.data",
>            5,32704593,337827399}]}]
> 
> VNode: 1321631363445718849859972807710232496290423373824
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185796},
>  {status,[{"/var/lib/riak/bitcask/1321631363445718849859972807710232496290423373824/4.bitcask.data",
>            5,31667414,344554808}]}]
> 
> VNode: 1333049344987366528908439095465828457381485346816
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,184729},
>  {status,[{"/var/lib/riak/bitcask/1333049344987366528908439095465828457381485346816/4.bitcask.data",
>            5,31916929,331982952}]}]
> 
> VNode: 1344467326529014207956905383221424418472547319808 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186374},
>  {status,[{"/var/lib/riak/bitcask/1344467326529014207956905383221424418472547319808/4.bitcask.data",
>            5,32011535,336838669}]}]
> 
> VNode: 1355885308070661887005371670977020379563609292800
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185097},
>  {status,[{"/var/lib/riak/bitcask/1355885308070661887005371670977020379563609292800/4.bitcask.data",
>            5,31257938,327694910}]}]
> 
> VNode: 1367303289612309566053837958732616340654671265792
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185280},
>  {status,[{"/var/lib/riak/bitcask/1367303289612309566053837958732616340654671265792/4.bitcask.data",
>            5,33641764,341085585}]}]
> 
> VNode: 1378721271153957245102304246488212301745733238784 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185792},
>  {status,[{"/var/lib/riak/bitcask/1378721271153957245102304246488212301745733238784/5.bitcask.data",
>            5,32139774,336659768}]}]
> 
> VNode: 1390139252695604924150770534243808262836795211776
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185647},
>  {status,[{"/var/lib/riak/bitcask/1390139252695604924150770534243808262836795211776/5.bitcask.data",
>            5,31422173,335753645}]}]
> 
> VNode: 1401557234237252603199236821999404223927857184768
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185641},
>  {status,[{"/var/lib/riak/bitcask/1401557234237252603199236821999404223927857184768/5.bitcask.data",
>            5,32892084,335640971}]}]
> 
> VNode: 1412975215778900282247703109755000185018919157760 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185982},
>  {status,[{"/var/lib/riak/bitcask/1412975215778900282247703109755000185018919157760/5.bitcask.data",
>            5,32650794,337720285}]}]
> 
> VNode: 1424393197320547961296169397510596146109981130752
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186569},
>  {status,[{"/var/lib/riak/bitcask/1424393197320547961296169397510596146109981130752/5.bitcask.data",
>            5,31520831,340970872}]}]
> 
> VNode: 1435811178862195640344635685266192107201043103744
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186322},
>  {status,[{"/var/lib/riak/bitcask/1435811178862195640344635685266192107201043103744/5.bitcask.data",
>            5,32047072,337905167}]}]
> 
> VNode: 1447229160403843319393101973021788068292105076736 
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,186082},
>  {status,[{"/var/lib/riak/bitcask/1447229160403843319393101973021788068292105076736/5.bitcask.data",
>            5,32158728,335402990}]}]
> 
> VNode: 1458647141945490998441568260777384029383167049728
> Backend: riak_kv_bitcask_backend
> Status: 
> [{key_count,185244},
>  {status,[{"/var/lib/riak/bitcask/1458647141945490998441568260777384029383167049728/7.bitcask.data",
>            3,20056866,73970408},
>           {"/var/lib/riak/bitcask/1458647141945490998441568260777384029383167049728/5.bitcask.data",
>            5,32748739,331478355}]}]
> 
> 
> 
> 
> On Tue, Jan 22, 2013 at 11:03 AM, Brian Sparrow <bsparrow at basho.com (mailto:bsparrow at basho.com)> wrote:
> > What is reported by riak-admin vnode_status? 
> > 
> > Thanks,
> > Brian
> > 
> > -- 
> > Brian Sparrow
> > Developer Advocate
> > Basho Technologies
> > 
> > Sent with Sparrow (http://www.sparrowmailapp.com/?sig) 
> > 
> > 
> > On Tuesday, January 22, 2013 at 10:49 AM, Ian Ha wrote:
> > 
> > > Thanks Brian. This is very helpful and informative!
> > > 
> > > Only question is we do indeed have data files that are > 2GB that haven't merged. I have a data file at 2.1G, as of today. The last merged happened Jan 20, which was two days ago.  
> > > 
> > > Anything we are missing here?
> > > 
> > > 
> > > On Sat, Jan 19, 2013 at 2:01 PM, Brian Sparrow <bsparrow at basho.com (mailto:bsparrow at basho.com)> wrote:
> > > > Hi Ian, 
> > > > 
> > > > Q: Why does this happen on a restart only and not at other times, even though we have set our merge_window config setting to 'always'?
> > > > 
> > > > A: The merge_window setting defaults to always and that simply means that bitcask will merge anytime the merge_triggers and thresholds set in the app.config are satisfied on a closed bitcask file. A bitcask data file is closed when it reaches the max_file_size threshold set in app.config(default of 2GB) or the node is stopped. Merging is happening on restart because this file is now closed and eligible for merge. You are not seeing merging during normal operation because the files are not reaching the 2GB max_file_size. 
> > > > 
> > > > Q: I'm assuming our config values are correct as the restart considers the thresholds met to go ahead with a merge.
> > > > 
> > > > A: I do not see anything wrong with your configuration with the exception of no max_file_size being set. If you want to merge more often, reduce the max_file size to 1GB or lower(the lower the file size, the more merging). A good way to estimate the appropriate size is to look at how large your .data files are getting in your bitcask data directory and deciding from there what size threshold you would like to set based on your disk usage needs. 
> > > > 
> > > > Q: Also: Are there any tools out there that I can run on my data directory that will tell me the size of the dead byte ratios? Would be nice to see what the dead byte 'state' of my data dir is in so I can tell whether indeed merge conditions are met. 
> > > > 
> > > > A: The command you are looking for is riak-admin vnode_status. This will list all partitions on the local node as well as the number of keys in each partition and a list of closed bitcask data files in the format: 
> > > > 
> > > > {CLOSE_DATA_FILE_NAME, FRAG_PERCENTAGE, DEAD_BYTES, TOTAL_FILE_SIZE}
> > > > 
> > > > Again, a data file must be closed(reached max_file_size or closed by node stop) to be reported in this command. 
> > > > 
> > > > Hope this answers all your questions.
> > > > 
> > > > Thanks!
> > > > 
> > > > 
> > > > -- 
> > > > Brian Sparrow
> > > > Customer Service Engineer
> > > > Basho Technologies
> > > > 
> > > > 
> > > > On Friday, January 18, 2013 at 5:14 PM, Ian Ha wrote:
> > > > 
> > > > 
> > > > 
> > > > > Hi,
> > > > > 
> > > > > In our production system, we notice that merges are not taking place. We have noticed, however, that when we restart riak (via a 'riak stop' then a 'riak start'), then the merges are triggered and our disk usage goes way day (which is what we want). We use bitcask. 
> > > > > 
> > > > > Why does this happen on a restart only and not at other times, even though we have set our merge_window config setting to 'always'?
> > > > > 
> > > > > I'm assuming our config values are correct as the restart considers the thresholds met to go ahead with a merge. 
> > > > > 
> > > > > Also: Are there any tools out there that I can run on my data directory that will tell me the size of the dead byte ratios? Would be nice to see what the dead byte 'state' of my data dir is in so I can tell whether indeed merge conditions are met. 
> > > > > 
> > > > > Our bit cask configs are as follows in app.config:
> > > > > 
> > > > > {bitcask, [
> > > > >                 {data_root, "/var/lib/riak/bitcask"},
> > > > >                 {dead_bytes_merge_trigger, 268435456},
> > > > >                 {dead_bytes_threshold, 134217728},
> > > > >                 {expiry_secs, 3888000},
> > > > >                 {frag_merge_trigger, 40},
> > > > >                 {frag_threshold, 20},
> > > > >                 {merge_window, always},
> > > > >                 {small_file_threshold, 10485760},
> > > > >                 {sync_strategy, none}
> > > > >         ]},
> > > > > 
> > > > > 
> > > > > 
> > > > > Thanks! 
> > > > > _______________________________________________
> > > > > riak-users mailing list
> > > > > riak-users at lists.basho.com (mailto:riak-users at lists.basho.com)
> > > > > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> > > > > 
> > > > > 
> > > > > 
> > > > 
> > > > 
> > > 
> > 
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20130122/9120bdfd/attachment.html>


More information about the riak-users mailing list