Store() Performance

David Leimbach leimy2k at gmail.com
Thu Apr 7 21:52:02 EDT 2011


Tried the protocol buffers interface?  What method are you using to insert records?  I know you said REST but if it's a big script with curl, that may not be the best way.

Sent from my iPhone

On Apr 7, 2011, at 5:04 PM, Rexxe <rexxe98 at gmail.com> wrote:

> What are your w and dw values set to?  What backend are you using?
> 
> On Thu, Apr 7, 2011 at 3:01 PM, Gui Pinto <gpinto at chitika.com> wrote:
> Hey guys,
> I'm attempting to importing 300M+ objects into a Riak cluster, but have quickly reached the REST API's speed-limit at 200-store()'s per second.. 
> At the rate of 200/s, I'm looking at 20-days to import this data set! That can't be the fastest method to do this..
> 
> Any recommendations?
> 
> Thanks!
> Gui Pinto
> 
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> 
> 
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20110407/98d0314a/attachment.html>


More information about the riak-users mailing list