50-100 ops/sec on a 5 Node cluster

Sean O'Connor sean at focuslab.io
Fri Jun 29 12:28:50 EDT 2012

There are a few things you probably want to look at in regard to how your using ELB. 

If your using the straight ELB offering (e.g. not part of a virtual private cloud), that's probably your problem.  This form of ELB was really only designed for routing traffic from outside the AWS network to servers within EC2.  Using it route traffic with the AWS tends to be very slow/throttled as your traffic has to go out to the public network and then back into the private AWS network.

Recently (i.e. the last two or three weeks) Amazon announced a new version of ELB that you can use with virtual private cloud to route traffic between VPC networks.  I haven't tried it yet but in theory this should avoid many of the problems mentioned above.

One last thing to be aware of with ELB is it can often take a while for an ELB instance to deal with spikes in capacity (e.g. load tests).  Under the covers ELB is basically as series of managed EC2 instances running a load balancer program.  When your capacity exceeds what one instance can handle, they'll spin up more instances but that takes time to happen.  Accordingly when doing load testing with ELB, you often need to "prime" the ELB by running test traffic for 10-15 minutes and then start recording your benchmark data.

With the possible exception of the new VPC ELB offering, I would strongly recommend against using ELB to load balance traffic to your riak cluster. 

Sean O'Connor

On Thursday, June 28, 2012 at 4:03 PM, Ruslan Bukin wrote:

> On Tue, Jun 26, 2012 at 04:29:38PM +0530, Yousuf Fauzan wrote:
> > Hello,
> > 
> > Here is my setup of Riak 1.1.4
> > 
> > - 5 Nodes
> > - ami-a29943cb (EC2 AMI)
> > - m1.large (7.5GB Ram, 4 EC2 compute instances)
> > - EBS storage
> > - LevelDB backend
> > - Python Client with Protobuf (on a separate machine)
> > 
> > While loading data I am getting around 50 ops/sec.
> > 
> > I tried running basho benchmark on the setup and it showed 100 ops/sec
> > throughput.
> > 
> > After talking to people or Riak IRC, I realized that upwards of 1.5K
> > ops/sec is what I should be getting.
> > 
> > Could anyone help me in figuring out what I am doing wrong?
> are your riak nodes located in the same DC?
> -Ruslan
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com (mailto:riak-users at lists.basho.com)
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20120629/160a7674/attachment.html>

More information about the riak-users mailing list