throughput test & connection fail

Magnus Kessler mkessler at basho.com
Mon Nov 14 07:27:10 EST 2016


On 12 November 2016 at 03:00, Jing Liu <jingliu.cs at gmail.com> wrote:

> Hi,
>
> When I try to simply test the throughput of Risk in the setting that
> just start a single node and utilize two clients to issue requests, I
> got connection refused after the client's thread of sending GET
> request overcome about 400. Actually the server crashed. Why is it and
> how can I fix?
>
> Thanks
> J.
>

Hi Jing,

You do not specify exactly how you perform your throughput test, so let me
first ask a few questions. How many concurrent requests are active against
the server at any given time? Can you clarify what you mean by "the server
crashed"? Did the riak process actually terminate?

What hardware environment does Riak run on? Please provide some information
about CPU, memory and most importantly your disk IO subsystem.

How big are the objects that you send to / request from Riak?

Even on moderate hardware, a single node should be able to serve hundreds
of requests per second. However, every system can be pushed to the limits
of what the hardware can support, and Riak is no exception. Depending on
the bottlenecks, an overload can manifest itself in a multitude of
different ways.

For load tests, I recommend to start with a small, sustainable load and
ramp it up to establish which subsystem is the bottleneck. Please monitor
the OS and Riak's performance carefully during the test. Riak exposes many
performance metrics as JSON through its HTTP stats endpoint
(http://<node>:8098/stats).
Consider ingesting these into your favourite monitoring solution. OS
metrics like CPU, network and IO usage should also be collected and
graphed. One easy open source solution that's gaining traction recently is
netdata (https://github.com/firehol/netdata).

Kind Regards,

Magnus

-- 
Magnus Kessler
Client Services Engineer
Basho Technologies Limited

Registered Office - 8 Lincoln’s Inn Fields London WC2A 3BP Reg 07970431
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20161114/3e5b5172/attachment-0002.html>


More information about the riak-users mailing list