Backuping a cluster takes too much time !

Preston Marshall preston at synergyeoc.com
Wed May 12 19:07:45 EDT 2010


Well I don't know if that's normal or not.  I just know from erlang experience that DETS is super-slow, especially when restoring or backup up etc.
On May 12, 2010, at 6:04 PM, Germain Maurice wrote:

> I'm using Innostore (10-1) and riak_0.10.1 on an ubuntu 9.10.
> 
> 
> Le 13/05/2010 00:28, Alan McConnell a écrit :
>> 
>> I get similar behavior using the innostore storage engine.  In addition, beam.smp memory footprint balloons to using all available system memory.
>> 
>> I'm running latest binary installs of riak and innostore (0.10.1) on ubuntu 8.04.
>> 
>> On Wed, May 12, 2010 at 3:07 PM, Preston Marshall <preston at synergyeoc.com> wrote:
>> What storage engine are you using?
>> On May 12, 2010, at 4:57 PM, Germain Maurice wrote:
>> 
>> > Hi,
>> >
>> > I'm testing the backup process of a node and all nodes.
>> > I'm very surprised by the time it took.
>> >
>> > The beginning using 'date' :
>> > # date ; ls -lh
>> > mardi 11 mai 2010, 14:31:54 (UTC+0200)
>> > total 8,0K
>> > -rw-r--r-- 1 riak riak    8 2010-05-11 14:31 backup-20100511
>> > drwxr-xr-x 2 riak riak 4,1K 2010-05-05 16:22 dets
>> > drwxr-xr-x 3 riak riak  168 2010-05-05 16:25 innodb
>> > drwxr-xr-x 2 riak riak  272 2010-05-11 14:26 ring
>> > # date ; ls -lh
>> > mercredi 12 mai 2010, 23:35:44 (UTC+0200)
>> > total 300G
>> > -rw-r--r-- 1 riak riak 300G 2010-05-12 21:42 backup-20100511
>> > drwxr-xr-x 3 riak riak  168 2010-05-05 16:25 innodb
>> > drwxr-xr-x 2 riak riak  272 2010-05-11 14:26 ring
>> >
>> > On each of my two nodes i have :
>> > 194G    /reiser/riak/innodb/innokeystore/
>> >
>> > The backup process of all nodes took more than 33 hours !!
>> > I hope it's not a normal behavior because we expect that the cluster will store up 4TB or more.
>> >
>> > Regards,
>> > Germain
>> >
>> >
>> > _______________________________________________
>> > riak-users mailing list
>> > riak-users at lists.basho.com
>> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>> 
>> 
>> _______________________________________________
>> riak-users mailing list
>> riak-users at lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>> 
>> 
> 
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20100512/2204608e/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4663 bytes
Desc: not available
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20100512/2204608e/attachment.p7s>


More information about the riak-users mailing list