couchdb performace 10x: using NIF for file io

Sean Cribbs sean at basho.com
Mon Oct 25 08:46:00 EDT 2010


For what it's worth, Bitcask has a decent portion of its code as NIFs, and there are various other parts of the Riak codebase that use NIFs.

Sean Cribbs <sean at basho.com>
Developer Advocate
Basho Technologies, Inc.
http://basho.com/

On Oct 25, 2010, at 2:30 AM, Richard Heycock wrote:

> Excerpts from Kirill A. Korinskiy's message of 2010-10-25 08:28:37 +1100:
>> Hi!
>> 
>> Cool story but you messages take a broken links :(
> 
> The links are valid from here:
> 
>  http://groups.google.com/group/erlang-programming/browse_thread/thread/f667a9a87ada3e7d
> 
> rgh
> 
> 
>> On Mon, Oct 25, 2010 at 01:05, NevB <neville.burnell at gmail.com> wrote:
>> 
>>> Hi,
>>> 
>>> I came across this thread in the Erlang group and thought the Riak
>>> team might find it interesting.
>>> 
>>> Please forgive me if its not relevant to Riak
>>> 
>>> Kind Regards
>>> 
>>> Neville
>>> 
>>> 
>>> ---------- Forwarded message ----------
>>> From: Joel Reymont <joe... at gmail.com>
>>> Date: Oct 25, 12:56 am
>>> Subject: couchdb performace 10x: using NIF for file io
>>> To: Erlang Programming
>>> 
>>> 
>>> Simply switching to NIFs for file IO seems to have improved CouchDB
>>> write performance more than ten-fold.
>>> 
>>> Compare the old graph
>>> 
>>> http://graphs.mikeal.couchone.com/#/graph/62b286fbb7aa55a4b0c4cc913c0...
>>> 
>>> to the new graph
>>> 
>>> http://graphs.mikeal.couchone.com/#/graph/62b286fbb7aa55a4b0c4cc913c0...
>>> 
>>> I was under the impression that the Erlang IO subsystem was highly
>>> optimized but there seems to be no limit to perfection.
>>> 
>>> NIFs are a giant black hole that will subsume Erlang code as
>>> performance has to be improved. Start at the lowest level and keep
>>> moving up. All that will be left of Erlang in the end is 99.99999%
>>> uptime, fault tolerance and supervision... of optimized C code. It's
>>> swell and I'm all for it!
>>> 
>>> Patch is here:
>>> 
>>> http://github.com/wagerlabs/couchdb/commit/23527eb8165f81e63d47b230f3...
>>> 
>>> ---http://twitter.com/wagerlabs
>>> 
>>> ________________________________________________________________
>>> erlang-questions (at) erlang.org mailing list.
>>> Seehttp://www.erlang.org/faq.html
>>> To unsubscribe; mailto:erlang-questions-unsubscr... at erlang.org
>>> 
>>> _______________________________________________
>>> riak-users mailing list
>>> riak-users at lists.basho.com
>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>> 
>> 
> -- 
> Richard Heycock
> 
> http://topikality.com
> 
> +61 (0) 410 646 369
> [e]:  rgh at topikality.com
> [im]: rgh at topikality.com
> 
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com





More information about the riak-users mailing list