MR Timeout

Yousuf Fauzan yousuffauzan at gmail.com
Fri Aug 3 10:50:53 EDT 2012


Hello,

My Riak setup is like following:
1. Riak 1.1.4
2. Ubuntu 12.04
3. 3 nodes (EC2 large instance)

I am using secondary index for input. The size of input is around 15k
records

The query fails with the following error
<<"{\"phase\":1,\"error\":\"{{{badmatch,[]},[{riak_kv_js_manager,needs_reload,2},{riak_kv_js_manager,handle_call,3},{gen_server,handle_msg,5},{proc_lib,init_p_do_apply,3}]},{gen_server,call,[riak_kv_js_map,{reserve_vm,<0.9908.0>},infinity]}}\",\"input\":\"{ok,{r_object,<<\\\"username\\\">>,<<\\\"4SH57586280\\\">>,[{r_content,{dict,4,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[[<<\\\"Links\\\">>,{{<<\\\"contacts|20120723\\\">>,<<\\\"user5|user1|Contacted|20120724001854\\\">>},<<\\\"contacts|20120723\\\">>},{{<<\\\"contacts|20120723\\\">>,<<\\\"user8|user2|Contacted|20120724003218\\\">>},<<\\\"contacts|20120723\\\">>},{{<<\\\"contacts|20120729\\\">>,<<\\\"user10|user3|Declined|20120729093511\\\">>},<<\\\"contacts|20120729\\\">>},{{<<\\\"contact...\\\">>,...},...},...]],...}}},...}],...},...}\",\"type\":\"exit\",\"stack\":\"[{gen_server,call,3},{riak_kv_js_manager,blocking_dispatch,4},{riak_kv_mrc_map,map_js,3},{riak_kv_mrc_map,process,3},{riak_pipe_vnode_worker,process_input,3},{riak_pipe_vnode_worker,wait_for_input,2},{gen_fsm,handle_msg,7},{proc_lib,init_p_do_apply,3}]\"}">>

However, if I re-run the query a couple of times, it eventually succeeds.

Some of the parameters of app.config that I changed:
    {map_js_vm_count, 128 },
    {reduce_js_vm_count, 32 },

    {js_max_vm_mem, 16},

Also, MR is quite slow. Is there a way to speed things up?

Please help.

--
Yousuf Fauzan
http://fauzism.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20120803/42286673/attachment.html>


More information about the riak-users mailing list