preflist_exhausted with map-reduce and riak-js

Matthew Tovbin matthew at tovbin.com
Mon Apr 2 18:25:01 EDT 2012


Unfortunately, yes, Jon.

Here are my log files after setting 128/128 for 'map_js_vm_count' and
'reduce_js_vm_count' accordingly and restarting all the nodes (see attached
app.config).

If you need any other information provided or tests performed please let me
know.

*-Console.log:*
2012-04-02 15:16:56.848 [notice]
<0.22138.162>@riak_kv_js_manager:blocking_dispatch:247 JS call failed: All
VMs are busy.
2012-04-02 15:16:56.853 [error] <0.22121.162> gen_fsm <0.22121.162> in
state wait_pipeline_shutdown terminated with reason: {sink_died,shutdown}
2012-04-02 15:16:56.860 [error] <0.22121.162> CRASH REPORT Process
<0.22121.162> with 0 neighbours crashed with reason: {sink_died,shutdown}
2012-04-02 15:16:56.862 [error] <0.1451.0> Supervisor riak_pipe_builder_sup
had child undefined started with {riak_pipe_builder,start_link,undefined}
at <0.22121.162> exit with reason {sink_died,shutdown} in context
child_terminated

*-Error.log:*
** State machine <0.22121.162> terminating
** Last message in was
{'DOWN',#Ref<0.0.33.48784>,process,<0.22119.162>,shutdown}
** When State == wait_pipeline_shutdown
**      Data  ==
{state,[{sink,{fitting,<0.22119.162>,#Ref<0.0.33.48768>,{riak_kv_pipe_get,bkey_chash},{riak_kv_pipe_get,bkey_nval}}},{trace,{set,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[error],[],[],[],[],[],[],[],[],[],[],[],[],[]}}}},{log,{sink,{fitting,<0.21554.162>,#Ref<0.0.33.48768>,sink,undefined}}}],{pipe,<0.22121.162>,[{listkeys,{fitting,<0.22122.162>,#Ref<0.0.33.48768>,{chash,key_of},1}}],{fitting,<0.22119.162>,#Ref<0.0.33.48768>,{riak_kv_pipe_get,bkey_chash},{riak_kv_pipe_get,bkey_nval}}},[{{fitting,<0.22122.162>,#Ref<0.0.33.48768>,{chash,key_of},1},#Ref<0.0.33.48787>}],#Ref<0.0.33.48784>}
** Reason for termination =
** {sink_died,shutdown}
2012-04-02 15:16:56 =CRASH REPORT====
  crasher:
    initial call: riak_pipe_builder:init/1
    pid: <0.22121.162>
    registered_name: []
    exception exit: {sink_died,shutdown}
      in function  gen_fsm:terminate/7
       in call from proc_lib:init_p_do_apply/3
    ancestors: [riak_pipe_builder_sup,riak_pipe_sup,<0.1448.0>]
    messages: [{'DOWN',#Ref<0.0.33.48787>,process,<0.22122.162>,shutdown}]
    links: [<0.1451.0>]
    dictionary:
[{eunit,[{module,riak_pipe_builder},{ref,#Ref<0.0.33.48768>},{spec,[{fitting_spec,listkeys,riak_kv_pipe_listkeys,undefined,{chash,key_of},1,64}]},{options,[{sink,{fitting,<0.22119.162>,#Ref<0.0.33.48768>,{riak_kv_pipe_get,bkey_chash},{riak_kv_pipe_get,bkey_nval}}},{trace,{set,1,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[error],[],[],[],[],[],[],[],[],[],[],[],[],[]}}}},{log,{sink,{fitting,<0.21554.162>,#Ref<0.0.33.48768>,sink,undefined}}}]},{fittings,[{{fitting,<0.22122.162>,#Ref<0.0.33.48768>,{chash,key_of},1},#Ref<0.0.33.48787>}]}]}]
     trap_exit: false
    status: running
    heap_size: 987
    stack_size: 24
    reductions: 251
  neighbours:
2012-04-02 15:16:56 =SUPERVISOR REPORT====
     Supervisor: {local,riak_pipe_builder_sup}
     Context:    child_terminated
     Reason:     {sink_died,shutdown}
     Offender:
[{pid,<0.22121.162>},{name,undefined},{mfargs,{riak_pipe_builder,start_link,undefined}},{restart_type,temporary},{shutdown,brutal_kill},{child_type,worker}]


-Matthew



On Mon, Apr 2, 2012 at 12:27, Jon Meredith <jmeredith at basho.com> wrote:

> Very strange.
>
> Are you seeing the
>
> 16:40:50.037 [notice] JS call failed: All VMs are busy.
>
> message in your console.log files on any of the nodes in your cluster?
>
> Jon
>
>
> On Mon, Apr 2, 2012 at 11:48 AM, Matthew Tovbin <matthew at tovbin.com>wrote:
>
>> Jon,
>>
>> Thanks for the reply. I tried increasing the 'map_js_vm_count' and
>> 'reduce_js_vm_count' on the cluster to the values you suggested 24/18
>> and even larger ones 32/24 and 128/128, but with no success - I still get
>> the same error in the console log of the node.
>>
>> What are we missing?!
>>
>> -Matthew
>>
>>
>>
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20120402/0156f54f/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: app.config
Type: application/octet-stream
Size: 11917 bytes
Desc: not available
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20120402/0156f54f/attachment.config>


More information about the riak-users mailing list