Riak 0.11.0 hanging on OSX 10.6

Dan Reverri dan at basho.com
Tue Jul 20 14:11:50 EDT 2010


Yes, this shows the maximum allowed open files:
open files                      (-n) 1024


Daniel Reverri
Developer Advocate
Basho Technologies, Inc.
dan at basho.com


On Tue, Jul 20, 2010 at 11:10 AM, Chris Dawson <xrdawson at gmail.com> wrote:

> This returns:
>
> Chris-Dawsons-MacBook-Pro:riak-0.11.0-osx-x86_64 xrdawson$ ulimit -a
> core file size          (blocks, -c) 0
> data seg size           (kbytes, -d) unlimited
> file size               (blocks, -f) unlimited
> max locked memory       (kbytes, -l) unlimited
> max memory size         (kbytes, -m) unlimited
> open files                      (-n) 1024
> pipe size            (512 bytes, -p) 1
> stack size              (kbytes, -s) 8192
> cpu time               (seconds, -t) unlimited
> max user processes              (-u) 266
> virtual memory          (kbytes, -v) unlimited
>
> I'm assuming this is OK, because what we wanted was open file handles,
> right?
>
> Chris
>
>
> On Tue, Jul 20, 2010 at 11:00 AM, Dan Reverri <dan at basho.com> wrote:
>
>> Hi Chris,
>>
>> Can you try "ulimit -a"?
>>
>> Thanks,
>> Dan
>>
>> Daniel Reverri
>> Developer Advocate
>> Basho Technologies, Inc.
>> dan at basho.com
>>
>>
>>
>> On Tue, Jul 20, 2010 at 10:53 AM, Chris Dawson <xrdawson at gmail.com>wrote:
>>
>>> I believe I have been having the same problem, so I appreciate this
>>> information.
>>>
>>> When I run ulimit on my machine I get "unlimited."  Is this acceptable?
>>> I ran ulimit -n 1024, and even after that it still returns unlimited.
>>>
>>> Chris
>>>
>>>
>>> On Mon, Jul 19, 2010 at 6:40 AM, Shane Holloway <shane.holloway at ieee.org
>>> > wrote:
>>>
>>>> Thanks -- ulimit -n 1024 fixed my problem.  It's wonderfully stable now
>>>> -- even under high load.
>>>>
>>>>
>>>> On Jul 19, 2010, at 2:30 AM, Daniel Reverri wrote:
>>>>
>>>> Hi Shane,
>>>>
>>>> Can you try increasing the number of allowed open file handles on your
>>>> system?
>>>> ulimit -n 1024
>>>>
>>>> You can check this setting from a riak console by typing:
>>>> os:cmd("ulimit -a").
>>>>
>>>> Thanks,
>>>> Dan
>>>>
>>>> Sent from my iPhone
>>>>
>>>> On Jul 18, 2010, at 10:32 PM, Shane Holloway <shane.holloway at ieee.org>
>>>> wrote:
>>>>
>>>> I'm having a bit of a problem with Riak.  When I keep my new documents
>>>> to about 10 per second, Riak works fine.  But as I increase my speed to
>>>> about 100 docs per second, Riak gets dramatically slow.  After a while, the
>>>> beam process takes 100% of my CPU and no longer responds to ping/stop or any
>>>> other command from the bin folder.  I end up sending kill TERM to stop the
>>>> process.
>>>>
>>>> If I restart Riak, the bitcask backend seems to be limited to about 1-2
>>>> document stores per second, but read seems fairly responsive still.  I'd
>>>> appreciate any thoughts or troubleshooting tips you may have.  It's an
>>>> in-development database with demo data, so I can run any experiments you'd
>>>> like to see.
>>>>
>>>> Thanks,
>>>> -Shane
>>>>
>>>>
>>>>
>>>> Riak/riakOne% ./bin/riak-admin status
>>>> 1-minute stats for 'riak at 172.20.0.49'
>>>> -------------------------------------------
>>>> vnode gets : 104
>>>> vnode_puts : 103
>>>> vnode_gets_total : 136
>>>> vnode_puts_total : 127
>>>> node_gets : 36
>>>> node_gets_total : 47
>>>> node_get_fsm_time_mean : 2635.1111111111113
>>>> node_get_fsm_time_median : 667
>>>> node_get_fsm_time_95 : 9156
>>>> node_get_fsm_time_99 : 40652
>>>> node_get_fsm_time_100 : 40652
>>>> node_puts : 36
>>>> node_puts_total : 44
>>>> *node_put_fsm_time_mean : 1670575.611111111*
>>>> *node_put_fsm_time_median : 1157*
>>>> *node_put_fsm_time_95 : 23900*
>>>> *node_put_fsm_time_99 : 60000511*
>>>> *node_put_fsm_time_100 : 600005*11
>>>> cpu_nprocs : 0
>>>> cpu_avg1 : 0
>>>> cpu_avg5 : 0
>>>> cpu_avg15 : 0
>>>> mem_total : 0
>>>> mem_allocated : 0
>>>> *disk : [{"none",0,0}]*
>>>> nodename : 'riak at 172.20.0.49'
>>>> connected_nodes : ['riak_maint_61716 at 172.20.0.49']
>>>> sys_driver_version : <<"1.5">>
>>>> sys_global_heaps_size : 0
>>>> sys_heap_type : private
>>>> sys_logical_processors : 2
>>>> sys_otp_release : <<"R13B04">>
>>>> sys_process_count : 167
>>>> sys_smp_support : true
>>>> sys_system_version : <<"Erlang R13B04 (erts-5.7.5) [source] [64-bit]
>>>> [smp:2:2] [rq:2] [async-threads:5] [hipe] [kernel-poll:true]\n">>
>>>> sys_system_architecture : <<"i386-apple-darwin9.4.0">>
>>>> sys_threads_enabled : true
>>>> sys_thread_pool_size : 5
>>>> sys_wordsize : 8
>>>> ring_members : ['riak at 172.20.0.49']
>>>> ring_num_partitions : 64
>>>> ring_ownership : <<"[{'riak at 172.20.0.49',64}]">>
>>>> ring_creation_size : 64
>>>> storage_backend : riak_kv_bitcask_backend
>>>> pbc_connects_total : 0
>>>> pbc_connects : 0
>>>> pbc_active : 0
>>>>
>>>> _______________________________________________
>>>> riak-users mailing list
>>>> riak-users at lists.basho.com
>>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> riak-users mailing list
>>>> riak-users at lists.basho.com
>>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>>
>>>>
>>>
>>>
>>> --
>>> Chris Dawson
>>> 971-533-8335
>>>
>>>
>>> _______________________________________________
>>> riak-users mailing list
>>> riak-users at lists.basho.com
>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>
>>>
>>
>
>
> --
> Chris Dawson
> 971-533-8335
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20100720/313a66b3/attachment.html>


More information about the riak-users mailing list