How much memory for 20GB of data?

Justin Sheehy justin at basho.com
Thu Jul 14 19:08:25 EDT 2011


Do you perhaps mean disk space instead of memory?

If so, and if you have left the N-val at the default of 3, then you
will need at least 60G of space before any other overhead is accounted
for.

-Justin



On Thu, Jul 14, 2011 at 7:04 PM, Maria Neise
<maria.neise1 at googlemail.com> wrote:
> Hey,
> thank you a lot for your hints.
> I have 20000000 records à 1KB. The key is a string like
> "user123456789". I am using the default backend bitcask. There is just
> one machine in the cluster and I didn't change the N-val. I already
> tried to insert the 20GB of data, but 40GB of memory were obviously
> not enough, because only 7000000 records were inserted. So I thought
> mybe 150GB should be enough?
>
> Cheers,
> Maria
>
> 2011/7/15 Justin Sheehy <justin at basho.com>:
>> Hi, Maria.
>>
>> In addition to what others have said, I would note that (at least) the
>> following issues matter quite a bit for such planning:
>>
>> - how many items the data is broken up into
>> - how large the keys will be (especially if they are very large due to
>> embedded structure)
>> - what storage engine ("backend") is in use
>> - how many machines are in the cluster
>> - the N-val, or how many replicas are being stored (default is 3)
>>
>> If you know those things, then you can make a more meaningful estimation.
>>
>> I hope that this helps.
>>
>> -Justin
>>
>>
>>
>>
>> On Thu, Jul 14, 2011 at 6:02 PM, Maria Neise
>> <maria.neise1 at googlemail.com> wrote:
>>> Hey,
>>> I would like to store 20GB of data with Riak. Does anyone know how
>>> much memory Riak would need for that?
>>>
>>> Cheers,
>>> Maria
>>>
>>> _______________________________________________
>>> riak-users mailing list
>>> riak-users at lists.basho.com
>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>
>>
>




More information about the riak-users mailing list