tuning riak for 100s of concurrent connections

Wilson MacGyver wmacgyver at gmail.com
Thu Feb 24 23:07:40 EST 2011


We too are using haproxy, though we are using HTTP client instead of protocol
buffer. When we developed it, protobuf support didn't exist in java client yet.

server load isn't the issue, the issue is any GET seems to be taking around 80ms
to return data.

On Wed, Feb 23, 2011 at 3:08 PM, Bob Feldbauer <bob at completefusion.com> wrote:
> After importing data into Riak, I'm in a basically 100% GET scenario. I
> haven't done much load testing other than throwing live traffic at it, but
> with that I've seen ~150 concurrent connections.
>
> I'm using Jetty app servers (Riak Java client) which are using protobufs to
> hit an HAProxy server, which load balances my 7 Riak nodes. I really haven't
> done anything special, other than using protobufs and fronting Riak with
> HAProxy.
>
> Other than that, I would just say "use fast disks" and/or add nodes as
> needed to hit your capacity targets -- because with that traffic and 7 nodes
> with 1 1TB disk per node, I'm seeing ~0.5-<1.0 load average on Riak nodes as
> iowait.
>
> Feel free to hop on the #riak IRC channel and I'd be happy to try to answer
> any other questions about our setup.
>
> - Bob Feldbauer
>
>> ---------- Forwarded message ----------
>> From: Wilson MacGyver<wmacgyver at gmail.com>
>> Date: Tue, Feb 22, 2011 at 7:15 PM
>> Subject: tuning riak for 100s of concurrent connections
>> To: riak-users Users<riak-users at lists.basho.com>
>>
>>
>> Are there any guidelines/howtos on tuning riak nodes for 100s
>> (200-500) of concurrent connections
>> which are 99.9% HTTP GET?
>>
>> Thanks,
>>
>> --
>> Omnem crede diem tibi diluxisse supremum.
>>
>> _______________________________________________
>> riak-users mailing list
>> riak-users at lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>



-- 
Omnem crede diem tibi diluxisse supremum.



More information about the riak-users mailing list