LevelDB memory problem crashes Erlang

Philipp Borgers borgers at mi.fu-berlin.de
Fri Aug 10 21:45:12 EDT 2012


Seems like you don't have enough RAM. If you do a lot of inserts this
seems to be normal. I had this issue while benchmarking riak with
basho_bench. You should add limit for the requests per second in your
script. Take a look at the memory profile of the erlang process (htop,
dstat) while importing data.

Regards

Philipp

On Fri, 2012-08-10 at 13:36 -0700, leonickel wrote:
> Hi all,
> 
> I'm facing a weird problem using eleveldb store option data. The amount of
> memory starts to increase while i'm running a script to put data inside
> riak, nearly 10 million of keys in a single bucket and suddenly riak process
> crashes. My object is in json format and is about 1.5 kb each. At the
> momment of running script, the proccess memory (beam.smp) increases to about
> 450mb and then the Erlang crashes. I've got this message on logs:
> 
> terminate called after throwing an instance of 'std::bad_alloc'
>   what():  std::bad_alloc
> Erlang has closed
> /usr/lib/riak/lib/os_mon-2.2.9/priv/bin/memsup: Erlang has closed. 
> 
> In my script i'm using java client and sending requests over http protocol.
> 
> Here are some more information about my environment and riak configs:
> 
> - erlang version: R14B03;
> - os: Ubuntu 11.04;
> 
> - single node;
> - n_val = 1 (i've tried default value 3 and got the same behavior);
> - ring_creation_size = 64
> - allow_mult = false;
> - last_write_wins = true;
> - r = 1;
> - w = 1;
> 
> I've done the same test using bitcask configuration and works fine, i could
> put all my 10 million keys.
> 
> Can anyone help me with this?
> 
> Thanks in advance,
> 
> Leo
> 
> 
> 
> 
> --
> View this message in context: http://riak-users.197444.n3.nabble.com/LevelDB-memory-problem-crashes-Erlang-tp4024974.html
> Sent from the Riak Users mailing list archive at Nabble.com.
> 
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 836 bytes
Desc: This is a digitally signed message part
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20120811/f6d25952/attachment.asc>


More information about the riak-users mailing list