Riak Merge On Restarts Only

Ian Ha ian at blutrumpet.com
Tue Jan 22 11:18:01 EST 2013


Brian, here's the dump for vnode_status. Interesetingly enough, the 2.1G
file at 271177061614132377401074334195404075912721858560/5.bitcask.data is
not part of this dump. Not sure why or if that is a concern?

Vnode status information
-------------------------------------------

VNode: 8563486156235759286349715816696970818296479744
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185800},
 {status,[{"/var/lib/riak/bitcask/8563486156235759286349715816696970818296479744/4.bitcask.data",
           5,31874309,338046717}]}]

VNode: 19981467697883438334816003572292931909358452736
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185635},
 {status,[{"/var/lib/riak/bitcask/19981467697883438334816003572292931909358452736/4.bitcask.data",
           5,34907347,342699456}]}]

VNode: 31399449239531117383282291327888893000420425728
Backend: riak_kv_bitcask_backend
Status:
[{key_count,184771},
 {status,[{"/var/lib/riak/bitcask/31399449239531117383282291327888893000420425728/4.bitcask.data",
           5,32830995,329973073}]}]

VNode: 42817430781178796431748579083484854091482398720
Backend: riak_kv_bitcask_backend
Status:
[{key_count,184847},
 {status,[{"/var/lib/riak/bitcask/42817430781178796431748579083484854091482398720/7.bitcask.data",
           1,18113882,91425091},

{"/var/lib/riak/bitcask/42817430781178796431748579083484854091482398720/4.bitcask.data",
           5,31974540,334178572}]}]

VNode: 54235412322826475480214866839080815182544371712
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186027},
 {status,[{"/var/lib/riak/bitcask/54235412322826475480214866839080815182544371712/4.bitcask.data",
           5,31978319,338241457}]}]

VNode: 65653393864474154528681154594676776273606344704
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185753},
 {status,[{"/var/lib/riak/bitcask/65653393864474154528681154594676776273606344704/4.bitcask.data",
           5,33745910,339735357}]}]

VNode: 77071375406121833577147442350272737364668317696
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185840},
 {status,[{"/var/lib/riak/bitcask/77071375406121833577147442350272737364668317696/4.bitcask.data",
           5,30572735,337791556}]}]

VNode: 88489356947769512625613730105868698455730290688
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186673},
 {status,[{"/var/lib/riak/bitcask/88489356947769512625613730105868698455730290688/4.bitcask.data",
           5,32874502,336092493}]}]

VNode: 99907338489417191674080017861464659546792263680
Backend: riak_kv_bitcask_backend
Status:
[{key_count,184970},
 {status,[{"/var/lib/riak/bitcask/99907338489417191674080017861464659546792263680/4.bitcask.data",
           5,32396426,330001394}]}]

VNode: 111325320031064870722546305617060620637854236672
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185248},
 {status,[{"/var/lib/riak/bitcask/111325320031064870722546305617060620637854236672/4.bitcask.data",
           5,34161176,335074205}]}]

VNode: 122743301572712549771012593372656581728916209664
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185760},
 {status,[{"/var/lib/riak/bitcask/122743301572712549771012593372656581728916209664/4.bitcask.data",
           5,30889834,335031242}]}]

VNode: 134161283114360228819478881128252542819978182656
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185590},
 {status,[{"/var/lib/riak/bitcask/134161283114360228819478881128252542819978182656/4.bitcask.data",
           5,32798615,337772144}]}]

VNode: 145579264656007907867945168883848503911040155648
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185460},
 {status,[{"/var/lib/riak/bitcask/145579264656007907867945168883848503911040155648/4.bitcask.data",
           5,33085394,336272206}]}]

VNode: 156997246197655586916411456639444465002102128640
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186096},
 {status,[{"/var/lib/riak/bitcask/156997246197655586916411456639444465002102128640/4.bitcask.data",
           5,34342279,336669714}]}]

VNode: 168415227739303265964877744395040426093164101632
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185756},
 {status,[{"/var/lib/riak/bitcask/168415227739303265964877744395040426093164101632/4.bitcask.data",
           5,29834588,334221105}]}]

VNode: 179833209280950945013344032150636387184226074624
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185663},
 {status,[{"/var/lib/riak/bitcask/179833209280950945013344032150636387184226074624/7.bitcask.data",
           1,4326604,84769249},

{"/var/lib/riak/bitcask/179833209280950945013344032150636387184226074624/4.bitcask.data",
           5,32222921,327833678}]}]

VNode: 191251190822598624061810319906232348275288047616
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185930},
 {status,[{"/var/lib/riak/bitcask/191251190822598624061810319906232348275288047616/4.bitcask.data",
           5,32790298,341206859}]}]

VNode: 202669172364246303110276607661828309366350020608
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185911},
 {status,[{"/var/lib/riak/bitcask/202669172364246303110276607661828309366350020608/4.bitcask.data",
           5,30258774,334550584}]}]

VNode: 214087153905893982158742895417424270457411993600
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185180},
 {status,[{"/var/lib/riak/bitcask/214087153905893982158742895417424270457411993600/4.bitcask.data",
           5,34331320,338067428}]}]

VNode: 225505135447541661207209183173020231548473966592
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185486},
 {status,[{"/var/lib/riak/bitcask/225505135447541661207209183173020231548473966592/4.bitcask.data",
           5,33282502,336653351}]}]

VNode: 236923116989189340255675470928616192639535939584
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185553},
 {status,[{"/var/lib/riak/bitcask/236923116989189340255675470928616192639535939584/4.bitcask.data",
           5,35582186,339871589}]}]

VNode: 248341098530837019304141758684212153730597912576
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185181},
 {status,[{"/var/lib/riak/bitcask/248341098530837019304141758684212153730597912576/4.bitcask.data",
           5,33057915,343594362}]}]

VNode: 259759080072484698352608046439808114821659885568
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185155},
 {status,[{"/var/lib/riak/bitcask/259759080072484698352608046439808114821659885568/4.bitcask.data",
           5,31763402,336956394}]}]

VNode: 271177061614132377401074334195404075912721858560
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185760},
 {status,[{"/var/lib/riak/bitcask/271177061614132377401074334195404075912721858560/4.bitcask.data",
           5,35371762,340778827}]}]

VNode: 282595043155780056449540621951000037003783831552
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185797},
 {status,[{"/var/lib/riak/bitcask/282595043155780056449540621951000037003783831552/4.bitcask.data",
           5,31127659,341388940}]}]

VNode: 294013024697427735498006909706595998094845804544
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185400},
 {status,[{"/var/lib/riak/bitcask/294013024697427735498006909706595998094845804544/4.bitcask.data",
           5,33172810,335029860}]}]

VNode: 305431006239075414546473197462191959185907777536
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185370},
 {status,[{"/var/lib/riak/bitcask/305431006239075414546473197462191959185907777536/4.bitcask.data",
           5,35447783,339131698}]}]

VNode: 316848987780723093594939485217787920276969750528
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185306},
 {status,[{"/var/lib/riak/bitcask/316848987780723093594939485217787920276969750528/4.bitcask.data",
           5,33100563,334514005}]}]

VNode: 328266969322370772643405772973383881368031723520
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185587},
 {status,[{"/var/lib/riak/bitcask/328266969322370772643405772973383881368031723520/4.bitcask.data",
           5,31554776,329354531}]}]

VNode: 339684950864018451691872060728979842459093696512
Backend: riak_kv_bitcask_backend
Status:
[{key_count,184990},
 {status,[{"/var/lib/riak/bitcask/339684950864018451691872060728979842459093696512/7.bitcask.data",
           2,17893708,87660389},

{"/var/lib/riak/bitcask/339684950864018451691872060728979842459093696512/4.bitcask.data",
           5,32530630,332735318}]}]

VNode: 351102932405666130740338348484575803550155669504
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185489},
 {status,[{"/var/lib/riak/bitcask/351102932405666130740338348484575803550155669504/7.bitcask.data",
           1,16949080,90740582},

{"/var/lib/riak/bitcask/351102932405666130740338348484575803550155669504/4.bitcask.data",
           5,31736396,336629981}]}]

VNode: 362520913947313809788804636240171764641217642496
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185317},
 {status,[{"/var/lib/riak/bitcask/362520913947313809788804636240171764641217642496/4.bitcask.data",
           5,34728997,335644618}]}]

VNode: 373938895488961488837270923995767725732279615488
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185189},
 {status,[{"/var/lib/riak/bitcask/373938895488961488837270923995767725732279615488/4.bitcask.data",
           5,33860427,338229690}]}]

VNode: 385356877030609167885737211751363686823341588480
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185076},
 {status,[{"/var/lib/riak/bitcask/385356877030609167885737211751363686823341588480/4.bitcask.data",
           5,32015829,331802410}]}]

VNode: 396774858572256846934203499506959647914403561472
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185502},
 {status,[{"/var/lib/riak/bitcask/396774858572256846934203499506959647914403561472/4.bitcask.data",
           5,34371519,338605515}]}]

VNode: 408192840113904525982669787262555609005465534464
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186081},
 {status,[{"/var/lib/riak/bitcask/408192840113904525982669787262555609005465534464/10.bitcask.data",
           6,490500,3116567},

{"/var/lib/riak/bitcask/408192840113904525982669787262555609005465534464/8.bitcask.data",
           5,26188498,171694974},

{"/var/lib/riak/bitcask/408192840113904525982669787262555609005465534464/6.bitcask.data",
           17,11782388,73101186},

{"/var/lib/riak/bitcask/408192840113904525982669787262555609005465534464/4.bitcask.data",
           13,20195069,117631531}]}]

VNode: 419610821655552205031136075018151570096527507456
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185717},
 {status,[{"/var/lib/riak/bitcask/419610821655552205031136075018151570096527507456/4.bitcask.data",
           5,31829307,331435676}]}]

VNode: 431028803197199884079602362773747531187589480448
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185947},
 {status,[{"/var/lib/riak/bitcask/431028803197199884079602362773747531187589480448/4.bitcask.data",
           5,32173706,338148596}]}]

VNode: 442446784738847563128068650529343492278651453440
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185537},
 {status,[{"/var/lib/riak/bitcask/442446784738847563128068650529343492278651453440/4.bitcask.data",
           5,35813666,338837080}]}]

VNode: 453864766280495242176534938284939453369713426432
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185746},
 {status,[{"/var/lib/riak/bitcask/453864766280495242176534938284939453369713426432/4.bitcask.data",
           5,32624042,334740185}]}]

VNode: 465282747822142921225001226040535414460775399424
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185468},
 {status,[{"/var/lib/riak/bitcask/465282747822142921225001226040535414460775399424/7.bitcask.data",
           2,20331282,91766521},

{"/var/lib/riak/bitcask/465282747822142921225001226040535414460775399424/4.bitcask.data",
           5,32647444,344746992}]}]

VNode: 476700729363790600273467513796131375551837372416
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185831},
 {status,[{"/var/lib/riak/bitcask/476700729363790600273467513796131375551837372416/4.bitcask.data",
           5,32209907,332813073}]}]

VNode: 488118710905438279321933801551727336642899345408
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186592},
 {status,[{"/var/lib/riak/bitcask/488118710905438279321933801551727336642899345408/4.bitcask.data",
           5,33320036,333898295}]}]

VNode: 499536692447085958370400089307323297733961318400
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185629},
 {status,[{"/var/lib/riak/bitcask/499536692447085958370400089307323297733961318400/4.bitcask.data",
           5,33497617,343082792}]}]

VNode: 510954673988733637418866377062919258825023291392
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185481},
 {status,[{"/var/lib/riak/bitcask/510954673988733637418866377062919258825023291392/4.bitcask.data",
           5,32209418,336325646}]}]

VNode: 522372655530381316467332664818515219916085264384
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185230},
 {status,[{"/var/lib/riak/bitcask/522372655530381316467332664818515219916085264384/4.bitcask.data",
           5,34077445,337997080}]}]

VNode: 533790637072028995515798952574111181007147237376
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186355},
 {status,[{"/var/lib/riak/bitcask/533790637072028995515798952574111181007147237376/4.bitcask.data",
           5,30786415,335334027}]}]

VNode: 545208618613676674564265240329707142098209210368
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186271},
 {status,[{"/var/lib/riak/bitcask/545208618613676674564265240329707142098209210368/4.bitcask.data",
           5,32730917,335737716}]}]

VNode: 556626600155324353612731528085303103189271183360
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186035},
 {status,[{"/var/lib/riak/bitcask/556626600155324353612731528085303103189271183360/7.bitcask.data",
           1,4873700,85319443},

{"/var/lib/riak/bitcask/556626600155324353612731528085303103189271183360/4.bitcask.data",
           5,31326139,336025933}]}]

VNode: 568044581696972032661197815840899064280333156352
Backend: riak_kv_bitcask_backend
Status:
[{key_count,184440},
 {status,[{"/var/lib/riak/bitcask/568044581696972032661197815840899064280333156352/4.bitcask.data",
           5,32950443,333793428}]}]

VNode: 579462563238619711709664103596495025371395129344
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185118},
 {status,[{"/var/lib/riak/bitcask/579462563238619711709664103596495025371395129344/4.bitcask.data",
           5,31707260,338029164}]}]

VNode: 590880544780267390758130391352090986462457102336
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185254},
 {status,[{"/var/lib/riak/bitcask/590880544780267390758130391352090986462457102336/4.bitcask.data",
           5,33033620,333558333}]}]

VNode: 602298526321915069806596679107686947553519075328
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185817},
 {status,[{"/var/lib/riak/bitcask/602298526321915069806596679107686947553519075328/4.bitcask.data",
           5,33359523,340174269}]}]

VNode: 613716507863562748855062966863282908644581048320
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185892},
 {status,[{"/var/lib/riak/bitcask/613716507863562748855062966863282908644581048320/4.bitcask.data",
           5,32059047,335268151}]}]

VNode: 625134489405210427903529254618878869735643021312
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185479},
 {status,[{"/var/lib/riak/bitcask/625134489405210427903529254618878869735643021312/4.bitcask.data",
           5,31377434,333663874}]}]

VNode: 636552470946858106951995542374474830826704994304
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186471},
 {status,[{"/var/lib/riak/bitcask/636552470946858106951995542374474830826704994304/4.bitcask.data",
           5,31637370,331456191}]}]

VNode: 647970452488505786000461830130070791917766967296
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185696},
 {status,[{"/var/lib/riak/bitcask/647970452488505786000461830130070791917766967296/4.bitcask.data",
           5,33490059,341805230}]}]

VNode: 659388434030153465048928117885666753008828940288
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185111},
 {status,[{"/var/lib/riak/bitcask/659388434030153465048928117885666753008828940288/4.bitcask.data",
           5,33355158,339718408}]}]

VNode: 670806415571801144097394405641262714099890913280
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185663},
 {status,[{"/var/lib/riak/bitcask/670806415571801144097394405641262714099890913280/4.bitcask.data",
           5,33049532,339186274}]}]

VNode: 682224397113448823145860693396858675190952886272
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185580},
 {status,[{"/var/lib/riak/bitcask/682224397113448823145860693396858675190952886272/4.bitcask.data",
           5,34273270,336960838}]}]

VNode: 693642378655096502194326981152454636282014859264
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185571},
 {status,[{"/var/lib/riak/bitcask/693642378655096502194326981152454636282014859264/4.bitcask.data",
           5,33173397,331159169}]}]

VNode: 705060360196744181242793268908050597373076832256
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186008},
 {status,[{"/var/lib/riak/bitcask/705060360196744181242793268908050597373076832256/4.bitcask.data",
           5,32475858,334556980}]}]

VNode: 716478341738391860291259556663646558464138805248
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185593},
 {status,[{"/var/lib/riak/bitcask/716478341738391860291259556663646558464138805248/4.bitcask.data",
           5,33130883,341173503}]}]

VNode: 727896323280039539339725844419242519555200778240
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185629},
 {status,[{"/var/lib/riak/bitcask/727896323280039539339725844419242519555200778240/4.bitcask.data",
           5,33103829,336311860}]}]

VNode: 739314304821687218388192132174838480646262751232
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185624},
 {status,[{"/var/lib/riak/bitcask/739314304821687218388192132174838480646262751232/4.bitcask.data",
           5,31556811,334381544}]}]

VNode: 750732286363334897436658419930434441737324724224
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186224},
 {status,[{"/var/lib/riak/bitcask/750732286363334897436658419930434441737324724224/4.bitcask.data",
           5,30142108,342742989}]}]

VNode: 762150267904982576485124707686030402828386697216
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185299},
 {status,[{"/var/lib/riak/bitcask/762150267904982576485124707686030402828386697216/4.bitcask.data",
           5,32275793,339187482}]}]

VNode: 773568249446630255533590995441626363919448670208
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185603},
 {status,[{"/var/lib/riak/bitcask/773568249446630255533590995441626363919448670208/4.bitcask.data",
           5,30237450,330464324}]}]

VNode: 784986230988277934582057283197222325010510643200
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186145},
 {status,[{"/var/lib/riak/bitcask/784986230988277934582057283197222325010510643200/4.bitcask.data",
           5,30762226,337042253}]}]

VNode: 796404212529925613630523570952818286101572616192
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186029},
 {status,[{"/var/lib/riak/bitcask/796404212529925613630523570952818286101572616192/4.bitcask.data",
           5,33089921,342650037}]}]

VNode: 807822194071573292678989858708414247192634589184
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186228},
 {status,[{"/var/lib/riak/bitcask/807822194071573292678989858708414247192634589184/4.bitcask.data",
           5,31644203,336945269}]}]

VNode: 819240175613220971727456146464010208283696562176
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185946},
 {status,[{"/var/lib/riak/bitcask/819240175613220971727456146464010208283696562176/4.bitcask.data",
           5,34478537,335108377}]}]

VNode: 830658157154868650775922434219606169374758535168
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185938},
 {status,[{"/var/lib/riak/bitcask/830658157154868650775922434219606169374758535168/4.bitcask.data",
           5,32153080,336335603}]}]

VNode: 842076138696516329824388721975202130465820508160
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185119},
 {status,[{"/var/lib/riak/bitcask/842076138696516329824388721975202130465820508160/4.bitcask.data",
           5,32662173,342685946}]}]

VNode: 853494120238164008872855009730798091556882481152
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186095},
 {status,[{"/var/lib/riak/bitcask/853494120238164008872855009730798091556882481152/4.bitcask.data",
           5,31724299,338609269}]}]

VNode: 864912101779811687921321297486394052647944454144
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185978},
 {status,[{"/var/lib/riak/bitcask/864912101779811687921321297486394052647944454144/4.bitcask.data",
           5,31688977,332396013}]}]

VNode: 876330083321459366969787585241990013739006427136
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186038},
 {status,[{"/var/lib/riak/bitcask/876330083321459366969787585241990013739006427136/9.bitcask.data",
           1,82942,4223127},

{"/var/lib/riak/bitcask/876330083321459366969787585241990013739006427136/8.bitcask.data",
           2,20442384,94777157},

{"/var/lib/riak/bitcask/876330083321459366969787585241990013739006427136/5.bitcask.data",
           5,26398003,329299684}]}]

VNode: 887748064863107046018253872997585974830068400128
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185605},
 {status,[{"/var/lib/riak/bitcask/887748064863107046018253872997585974830068400128/4.bitcask.data",
           5,32415353,335591556}]}]

VNode: 1173197603404299022229911066887485002106617724928
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185976},
 {status,[{"/var/lib/riak/bitcask/1173197603404299022229911066887485002106617724928/4.bitcask.data",
           5,32719451,334916473}]}]

VNode: 1184615584945946701278377354643080963197679697920
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186439},
 {status,[{"/var/lib/riak/bitcask/1184615584945946701278377354643080963197679697920/7.bitcask.data",
           2,20171431,87739364},

{"/var/lib/riak/bitcask/1184615584945946701278377354643080963197679697920/4.bitcask.data",
           5,34315029,334169356}]}]

VNode: 1196033566487594380326843642398676924288741670912
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185659},
 {status,[{"/var/lib/riak/bitcask/1196033566487594380326843642398676924288741670912/4.bitcask.data",
           5,34544534,339094321}]}]

VNode: 1207451548029242059375309930154272885379803643904
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185309},
 {status,[{"/var/lib/riak/bitcask/1207451548029242059375309930154272885379803643904/4.bitcask.data",
           5,34049175,334609625}]}]

VNode: 1218869529570889738423776217909868846470865616896
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185067},
 {status,[{"/var/lib/riak/bitcask/1218869529570889738423776217909868846470865616896/9.bitcask.data",
           5,21798031,55300856},

{"/var/lib/riak/bitcask/1218869529570889738423776217909868846470865616896/6.bitcask.data",
           7,19228418,50004789},

{"/var/lib/riak/bitcask/1218869529570889738423776217909868846470865616896/5.bitcask.data",
           7,25130869,298276178}]}]

VNode: 1230287511112537417472242505665464807561927589888
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185677},
 {status,[{"/var/lib/riak/bitcask/1230287511112537417472242505665464807561927589888/4.bitcask.data",
           5,34162507,338171429}]}]

VNode: 1241705492654185096520708793421060768652989562880
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185480},
 {status,[{"/var/lib/riak/bitcask/1241705492654185096520708793421060768652989562880/4.bitcask.data",
           5,32122493,340603091}]}]

VNode: 1253123474195832775569175081176656729744051535872
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186191},
 {status,[{"/var/lib/riak/bitcask/1253123474195832775569175081176656729744051535872/4.bitcask.data",
           5,32683442,337318456}]}]

VNode: 1264541455737480454617641368932252690835113508864
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185594},
 {status,[{"/var/lib/riak/bitcask/1264541455737480454617641368932252690835113508864/4.bitcask.data",
           5,33864031,342388629}]}]

VNode: 1275959437279128133666107656687848651926175481856
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185644},
 {status,[{"/var/lib/riak/bitcask/1275959437279128133666107656687848651926175481856/4.bitcask.data",
           5,33250712,338253781}]}]

VNode: 1287377418820775812714573944443444613017237454848
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185323},
 {status,[{"/var/lib/riak/bitcask/1287377418820775812714573944443444613017237454848/4.bitcask.data",
           5,32485461,339612430}]}]

VNode: 1298795400362423491763040232199040574108299427840
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185903},
 {status,[{"/var/lib/riak/bitcask/1298795400362423491763040232199040574108299427840/4.bitcask.data",
           5,32102630,336913196}]}]

VNode: 1310213381904071170811506519954636535199361400832
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185513},
 {status,[{"/var/lib/riak/bitcask/1310213381904071170811506519954636535199361400832/4.bitcask.data",
           5,32704593,337827399}]}]

VNode: 1321631363445718849859972807710232496290423373824
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185796},
 {status,[{"/var/lib/riak/bitcask/1321631363445718849859972807710232496290423373824/4.bitcask.data",
           5,31667414,344554808}]}]

VNode: 1333049344987366528908439095465828457381485346816
Backend: riak_kv_bitcask_backend
Status:
[{key_count,184729},
 {status,[{"/var/lib/riak/bitcask/1333049344987366528908439095465828457381485346816/4.bitcask.data",
           5,31916929,331982952}]}]

VNode: 1344467326529014207956905383221424418472547319808
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186374},
 {status,[{"/var/lib/riak/bitcask/1344467326529014207956905383221424418472547319808/4.bitcask.data",
           5,32011535,336838669}]}]

VNode: 1355885308070661887005371670977020379563609292800
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185097},
 {status,[{"/var/lib/riak/bitcask/1355885308070661887005371670977020379563609292800/4.bitcask.data",
           5,31257938,327694910}]}]

VNode: 1367303289612309566053837958732616340654671265792
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185280},
 {status,[{"/var/lib/riak/bitcask/1367303289612309566053837958732616340654671265792/4.bitcask.data",
           5,33641764,341085585}]}]

VNode: 1378721271153957245102304246488212301745733238784
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185792},
 {status,[{"/var/lib/riak/bitcask/1378721271153957245102304246488212301745733238784/5.bitcask.data",
           5,32139774,336659768}]}]

VNode: 1390139252695604924150770534243808262836795211776
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185647},
 {status,[{"/var/lib/riak/bitcask/1390139252695604924150770534243808262836795211776/5.bitcask.data",
           5,31422173,335753645}]}]

VNode: 1401557234237252603199236821999404223927857184768
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185641},
 {status,[{"/var/lib/riak/bitcask/1401557234237252603199236821999404223927857184768/5.bitcask.data",
           5,32892084,335640971}]}]

VNode: 1412975215778900282247703109755000185018919157760
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185982},
 {status,[{"/var/lib/riak/bitcask/1412975215778900282247703109755000185018919157760/5.bitcask.data",
           5,32650794,337720285}]}]

VNode: 1424393197320547961296169397510596146109981130752
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186569},
 {status,[{"/var/lib/riak/bitcask/1424393197320547961296169397510596146109981130752/5.bitcask.data",
           5,31520831,340970872}]}]

VNode: 1435811178862195640344635685266192107201043103744
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186322},
 {status,[{"/var/lib/riak/bitcask/1435811178862195640344635685266192107201043103744/5.bitcask.data",
           5,32047072,337905167}]}]

VNode: 1447229160403843319393101973021788068292105076736
Backend: riak_kv_bitcask_backend
Status:
[{key_count,186082},
 {status,[{"/var/lib/riak/bitcask/1447229160403843319393101973021788068292105076736/5.bitcask.data",
           5,32158728,335402990}]}]

VNode: 1458647141945490998441568260777384029383167049728
Backend: riak_kv_bitcask_backend
Status:
[{key_count,185244},
 {status,[{"/var/lib/riak/bitcask/1458647141945490998441568260777384029383167049728/7.bitcask.data",
           3,20056866,73970408},

{"/var/lib/riak/bitcask/1458647141945490998441568260777384029383167049728/5.bitcask.data",
           5,32748739,331478355}]}]


On Tue, Jan 22, 2013 at 11:03 AM, Brian Sparrow <bsparrow at basho.com> wrote:

>  What is reported by riak-admin vnode_status?
>
> Thanks,
> Brian
>
> --
> Brian Sparrow
> Developer Advocate
> Basho Technologies
>
> Sent with Sparrow <http://www.sparrowmailapp.com/?sig>
>
> On Tuesday, January 22, 2013 at 10:49 AM, Ian Ha wrote:
>
> Thanks Brian. This is very helpful and informative!
>
> Only question is we do indeed have data files that are > 2GB that haven't
> merged. I have a data file at 2.1G, as of today. The last merged happened
> Jan 20, which was two days ago.
>
> Anything we are missing here?
>
>
> On Sat, Jan 19, 2013 at 2:01 PM, Brian Sparrow <bsparrow at basho.com> wrote:
>
>  Hi Ian,
>
> Q: Why does this happen on a restart only and not at other times, even
> though we have set our merge_window config setting to 'always'?
>
> A: The merge_window setting defaults to always and that simply means that
> bitcask will merge anytime the merge_triggers and thresholds set in the
> app.config are satisfied on a closed bitcask file. A bitcask data file is
> closed when it reaches the max_file_size threshold set in
> app.config(default of 2GB) or the node is stopped. Merging is happening on
> restart because this file is now closed and eligible for merge. You are not
> seeing merging during normal operation because the files are not reaching
> the 2GB max_file_size.
>
> Q: I'm assuming our config values are correct as the restart considers the
> thresholds met to go ahead with a merge.
>
> A: I do not see anything wrong with your configuration with the exception
> of no max_file_size being set. If you want to merge more often, reduce the
> max_file size to 1GB or lower(the lower the file size, the more merging). A
> good way to estimate the appropriate size is to look at how large your
> .data files are getting in your bitcask data directory and deciding from
> there what size threshold you would like to set based on your disk usage
> needs.
>
> Q: Also: Are there any tools out there that I can run on my data directory
> that will tell me the size of the dead byte ratios? Would be nice to see
> what the dead byte 'state' of my data dir is in so I can tell whether
> indeed merge conditions are met.
>
> A: The command you are looking for is riak-admin vnode_status. This will
> list all partitions on the local node as well as the number of keys in each
> partition and a list of closed bitcask data files in the format:
>
> {CLOSE_DATA_FILE_NAME, FRAG_PERCENTAGE, DEAD_BYTES, TOTAL_FILE_SIZE}
>
> Again, a data file must be closed(reached max_file_size or closed by node
> stop) to be reported in this command.
>
> Hope this answers all your questions.
>
> Thanks!
>
>
> --
> Brian Sparrow
> Customer Service Engineer
> Basho Technologies
>
> On Friday, January 18, 2013 at 5:14 PM, Ian Ha wrote:
>
> Hi,
>
> In our production system, we notice that merges are not taking place. We
> have noticed, however, that when we restart riak (via a 'riak stop' then a
> 'riak start'), then the merges are triggered and our disk usage goes way
> day (which is what we want). We use bitcask.
>
> Why does this happen on a restart only and not at other times, even though
> we have set our merge_window config setting to 'always'?
>
> I'm assuming our config values are correct as the restart considers the
> thresholds met to go ahead with a merge.
>
> Also: Are there any tools out there that I can run on my data directory
> that will tell me the size of the dead byte ratios? Would be nice to see
> what the dead byte 'state' of my data dir is in so I can tell whether
> indeed merge conditions are met.
>
> Our bit cask configs are as follows in app.config:
>
> {bitcask, [
>                 {data_root, "/var/lib/riak/bitcask"},
>                 {dead_bytes_merge_trigger, 268435456},
>                 {dead_bytes_threshold, 134217728},
>                 {expiry_secs, 3888000},
>                 {frag_merge_trigger, 40},
>                 {frag_threshold, 20},
>                 {merge_window, always},
>                 {small_file_threshold, 10485760},
>                 {sync_strategy, none}
>         ]},
>
>
> Thanks!
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20130122/4b294278/attachment.html>


More information about the riak-users mailing list