Riak stalls, leveldb backend

Andy Pellett andy at embed.ly
Thu Feb 19 15:19:33 EST 2015


Hi Luke,

Your prediction was spot on.

Today, about 2 weeks after setting the parameters from my earlier email, we
saw riak nodes start to run out of memory and fail.

I have to say, it was a great 2 weeks though.

I've adjusted the parameters again, this time paying attention the linked
spreadsheet.

Thanks for your advice,
Andy

On Wed, Feb 11, 2015 at 6:36 PM, Luke Bakken <lbakken at basho.com> wrote:

> Hi Andy,
>
> I'd like to strongly recommend using the spreadsheet linked to by this
> document:
>
> http://docs.basho.com/riak/1.4.12/ops/advanced/backends/leveldb/
>
> Spreadsheet:
> https://docs.google.com/spreadsheet/ccc?key=0AnW_U8Qe8NdYdGk2V3Qza0VRNkxyRFNGUVVCV0c3V3c&usp=sharing#gid=0
>
> The reason I bring it up is that the parameters you list will most
> certainly exhaust RAM at some point.
>
> --
> Luke Bakken
> Engineer
> lbakken at basho.com
>
> On Wed, Feb 11, 2015 at 11:47 AM, Andy Pellett <andy at embed.ly> wrote:
> > Hi All,
> >
> > I ran across this page:
> >
> > http://docs.basho.com/riak/1.0.0/tutorials/choosing-a-backend/LevelDB/
> >
> > and ended up tuning the following parameters:
> >
> > max_open_files 16384
> > write_buffer_size_min 1gb
> > write_buffer_size_max 2gb
> > cache_size 15gb
> > block_size 262144
> >
> > Since making these changes about a week ago, I've seen considerably fewer
> > compactions, and no stalls. Hoping this holds up.
> >
> > Andy
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20150219/457b5e11/attachment-0002.html>


More information about the riak-users mailing list