Riak 1.4.0: *Massive* disk space saving with eLevelDB

Dave Brady dbrady at weborama.com
Fri Jul 26 11:01:04 EDT 2013


Hi Matthew, 


Thanks for correcting my misunderstanding! 

-- 
Dave Brady 

----- Original Message ----- 
From: "Matthew Von-Maszewski" <matthewv at basho.com> 
To: "Dave Brady" <dbrady at weborama.com> 
Cc: riak-users at lists.basho.com 
Sent: Friday, July 26, 2013 4:31:36 PM GMT +01:00 Amsterdam / Berlin / Bern / Rome / Stockholm / Vienna 
Subject: Re: Riak 1.4.0: *Massive* disk space saving with eLevelDB 

Dave, 


Glad you are happy. 


The truth is that you gained space via the backup/restore process. The data formats of 1.3.1 and 1.4 are the same. 


leveldb only removes dead / old key/values during its background compaction. It could be days, even weeks in some cases, between when you write fresh key/values and when their old version are discarded. 


Your restore process only put the fresh keys back into the database. The old versions were never part of the backup. 


Matthew 





On Jul 26, 2013, at 7:52 AM, Dave Brady < dbrady at weborama.com > wrote: 





Thank you Basho for the new on-disk format changes to eLevelDB! 

We have just migrating from 1.3.1 to 1.4.0, and since we wanted to change the ring size too, we used Dan Kerrigan's Data Migrator to backup/restore our buckets. 


The space savings are very impressive! Each node went from using about 410 GB to about 250 GB. 


Terrific! 

-- 
Dave Brady 
_______________________________________________ 
riak-users mailing list 
riak-users at lists.basho.com 
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20130726/72498c77/attachment.html>


More information about the riak-users mailing list