Bulk loading data and "Could not contact Riak Server" error
riak at uhls.com
Wed Aug 3 18:23:51 EDT 2011
Appreciate the responses.
Since posting I've tried running up to 8 vnodes on this same physical
machine. Even with 8 the machine is under virtually no load when I have as
many loaders as possible running so it could be this sort of hardware isn't
a good candidate for a riak node.
Adding more vnodes does allow me to fire up more loaders, but as soon as I
cross the 4-5 loader mark on any specific node it stops responding for a few
seconds. I think I got it up to about 1600 inserts/sec at peak with 8 nodes
and a couple dozen loaders running.
It could also be that I am just trying to fit a workload on Riak that isn't
suitable. On this same machine with a single untuned Cassandra node I can
get about 15,000 inserts/sec using the exact same input data and when that
thing runs I can see the disks getting pounded and the CPU spiking.
Cassandra lacks a map reduce interface though so it isn't as appealing. I
may stick with a multiple datastore approach on this particular project.
View this message in context: http://riak-users.197444.n3.nabble.com/Bulk-loading-data-and-Could-not-contact-Riak-Server-error-tp3217091p3223728.html
Sent from the Riak Users mailing list archive at Nabble.com.
More information about the riak-users