Performance testing different virtual machine cluster configurations

Daniel Rathbone rathbone1200cc at gmail.com
Tue Aug 26 14:52:25 EDT 2014


Hi group,

I've been happily using Riak in production on VMs for years.  It's time to
scale up so I'm running performance tests with basho_bench and my own app
code on a new VM cluster.

Here's an example question I'd like to answer: will a cluster perform
better with 5 VMs at 8gb each, or 10 VMs at 4gb each?  The cost of the VMs
is the same, and I'm guessing the performance will not be exactly the same.

As I'm going through the trouble, I'll share my results. I hope this will
be interesting to other people, especially with all the changes in Riak 2.0.

I really like Riak so I want to make sure I give it a fair showing.  Please
review my config and initial results below.

So far I've set up the first cluster of 5 VMs with 8gb each.  I'm driving
the test off a separate (6th) VM.  I anticipate I'll set up the second
cluster with 10 VMs at 4GB each in the next few days. Please let me know if
you have any suggestions.

Thanks!
Daniel

--

initial results:

basho_bench riakc_pb for 5vm cluster, 8gb on each machine:
https://www.dropbox.com/s/mpt9ame3t082lct/5vm-8gb-riakc_pb.png

basho_bench counters for 5vm cluster, 8gb on each machine:
https://www.dropbox.com/s/8eyp1zbpy5h16s1/5vm-8gb-counters.png

riak.conf used for these tests:
https://www.dropbox.com/s/krufixa2wmnaxum/base.riak.conf.txt

I'm currently loading records in to the cluster through my app code.  After
18h and 68M records, they're still going in at 1k records/second.  The
records are around 750 bytes each.  They're each indexed with either 4 or 6
different 2i values.  Search indexing is on as well.  I'm going to use this
test dataset to compare 2i vs search for my application.


system stuff:

VM plan through linode:
8 GB RAM
6 CPU Cores
192 GB SSD Storage
8 TB Transfer
40 Gbit Network In
1000 Mbit Network Out

filesystem:
/dev/xvda on / type ext4 (rw,noatime,errors=remount-ro)

file limits:
riak soft nofile 65536
riak hard nofile 65536
root soft nofile 65536
root hard nofile 65536
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20140826/cff68ff2/attachment.html>


More information about the riak-users mailing list