Riak Disk Usage

Sean Cribbs sean at basho.com
Tue Apr 17 12:04:15 EDT 2012


Yes, your number is 128MB.

On Tue, Apr 17, 2012 at 11:27 AM, Fábio Sato <fabiosato at gmail.com> wrote:

> The default value for max_file_size is "16#8000000". Is this hexadecimal
> format?
>
> Isn't this 128MB? The documentation says that this is 2GB but I can't
> reproduce this value converting this to decimal...
>
> Thanks,
> ---
> Fábio Sato
>
>
> 2012/4/17 Fábio Sato <fabiosato at gmail.com>
>
>> Thanks Sean!
>>
>> I'll change the max_file_size and monitor disk usage.
>>
>> I hope that does the trick!
>> ---
>> Fábio Sato
>>
>> 2012/4/17 Sean Cribbs <sean at basho.com>
>>
>>> Fabio,
>>>
>>> If you are using Bitcask (the default storage engine), it won't compact
>>> its data files until they reach the 2GB default max file size. Since your
>>> disk space is constrained, I suggest you tune the max_file_size down
>>> (128-256MB should be sufficient for your purposes) and merging
>>> threshold/triggers. More info about those settings can be found on this
>>> page: http://wiki.basho.com/Bitcask.html#Disk-Usage-and-Merging-Settings
>>>
>>> Hope that helps!
>>>
>>> On Tue, Apr 17, 2012 at 9:20 AM, Fábio Sato <fabiosato at gmail.com> wrote:
>>>
>>>> Hello all,
>>>>
>>>> I've started using Riak as a data store for images and documents and
>>>> I'm having trouble understanding its disk usage behaviour.
>>>>
>>>> We developed a web system and unfortunately it went into production
>>>> without the appropriate hardware infrastructure, and we are currently
>>>> running only one instance of Riak right now (I know this is dead wrong but
>>>> I'm waiting for more hardware).
>>>>
>>>> Currently we have like 100 keys and update their content every 5
>>>> minutes. Every image has approximately 300kB so I would expect a disk usage
>>>> around  300MB-1GB and also that riak would keep it constant. But every 2
>>>> weeks we get a full filesystem (10GB) and have to restart Riak (or
>>>> temporally add another instance) to make it release space.
>>>>
>>>> To me it seems like it is maintaining the previous values for each key
>>>> like a versioning system, but can't confirm that based on what I've read on
>>>> the documentation.
>>>>
>>>> Could someone give me a hint why the disk space grows even if I'm not
>>>> adding no new keys?
>>>>
>>>> Any feedback would be appreciated.
>>>>
>>>> Thanks!
>>>> --
>>>> Fábio Sato
>>>>
>>>> _______________________________________________
>>>> riak-users mailing list
>>>> riak-users at lists.basho.com
>>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>>
>>>>
>>>
>>>
>>> --
>>> Sean Cribbs <sean at basho.com>
>>> Software Engineer
>>> Basho Technologies, Inc.
>>> http://basho.com/
>>>
>>>
>>
>>
>> --
>> Fábio Sato
>>
>
>
>
> --
> Fábio Sato
>
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>


-- 
Sean Cribbs <sean at basho.com>
Software Engineer
Basho Technologies, Inc.
http://basho.com/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20120417/e9627a1b/attachment.html>


More information about the riak-users mailing list