Throughput issue contd. On Joyend Riak Smartmachine

Eric Anderson anderson at
Wed Jun 27 06:32:58 EDT 2012

On Jun 27, 2012, at 5:13 AM, Yousuf Fauzan <yousuffauzan at> wrote:

> Hi,
> I setup a 3 machine riak SM cluster. Each machine used 4GB Ram and riak OpenSource SmartMachine Image.
> Afterwards I tried loading data by following two methods
> 1. Bash script
> #!/bin/bash
> echo $(date)
> for (( c=1; c<=1000; c++ ))
> do
> 	curl -s -d 'this is a test' -H "Content-Type: text/plain"
> done
> echo $(date)
> 2. Python Riak Client
> c=riak.RiakClient("") 
> b=c.bucket("test")
> for i in xrange(10000), str(i)).store()
> For case 1, throughput was 25 writes/sec
> For case 2, throughput was 200 writes/sec
> Maybe I am making a fundamental mistake somewhere. I tried the above two scripts on EC2 clusters too and still got the same performance.
> Please, someone help

The major difference between these two is the first is executing a binary, which has to basically create everything (connection, payload, etc) every time through the loop.  The second does not - it creates the client once, then iterates over it keeping the same client and presumably the same connection as well.  That makes a huge difference.

I would not use curl to do performance testing.  What you probably want is something like your python script that will work on many threads/processes at once (or fire them up many times).

Eric Anderson

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <>

More information about the riak-users mailing list