Riak ring size

Alexander Sicular siculars at gmail.com
Thu Oct 3 13:23:13 EDT 2013


You know you're old when 128GB ram is omgwtflol.

-Alexander Sicular

@siculars

On Oct 3, 2013, at 12:18 PM, John Kavanagh <john at kavanista.com> wrote:

> Thanks Matthew , we are actually using Bitcask with 128Gb RAM per node. 
> 
> John
> 
> On 3 Oct 2013, at 17:10, Matthew Von-Maszewski <matthewv at basho.com> wrote:
> 
> John,
> 
> If you are using leveldb as Riak's backend, keep in mind that each vnode requires a fixed amount of memory (set via max_open_files and cache_size in app.config).  Recently had one user attempt too many vnodes on a 4Gbyte machine.  He populated data to the point of memory overflow … then migration out of that mess took days.
> 
> Matthew
> 
> On Oct 3, 2013, at 11:52 AM, John Kavanagh <john at kavanista.com> wrote:
> 
>> Thanks Sean ! 
>> 
>> 
>> On Thu, Oct 3, 2013 at 4:33 PM, Sean Cribbs <sean at basho.com> wrote:
>> Hi John,
>> 
>> Our rule-of-thumb is 8-64 partitions per physical node, so a good starting point for a 6-node cluster would be 128 or 256. 256 will let you expand up to about 30 nodes without needing a ring resize.
>> 
>> 
>> On Thu, Oct 3, 2013 at 10:14 AM, John Kavanagh <john at kavanista.com> wrote:
>> Hi all,
>> 
>> I'm trying to understand the optimal ring size / vnode config for a 6 node Riak cluster, which will most likely expand to many more nodes over time .  Does everyone bump from the default of 64 to 1024 to facilitate future growth ?  I can provide more detailed capacity metrics off list if necessary.
>> 
>> Thanks,
>> 
>> John 
>> 
>> _______________________________________________
>> riak-users mailing list
>> riak-users at lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>> 
>> 
>> 
>> 
>> -- 
>> Sean Cribbs <sean at basho.com>
>> Software Engineer
>> Basho Technologies, Inc.
>> http://basho.com/
>> 
>> _______________________________________________
>> riak-users mailing list
>> riak-users at lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> 
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20131003/18133d69/attachment.html>


More information about the riak-users mailing list