1. Riak Crashing on Data Load from CSV and 2. How to get Ripple to load js functions

Dave Smith dizzyd at basho.com
Tue May 22 09:35:05 EDT 2012


Hi Gustav, 

Can you share the logs or any other information from the server that crashes _first_? It might be good to also include app.config, just so we can double-check that no other settings have changed.

Thanks,

D. 

--
Dave Smith
VP, Engineering
Basho Technologies, Inc.
dizzyd at basho.com



On Friday, May 18, 2012 at 10:03 AM, Gustav Gennrich wrote:

> Hi,
> 
> Below is our setup to better diagnose:
> 
> Ring creation size: 128
> Backend: LevelDB
> 
> All other settings in app.config are using the default values
> 
> We have 3 servers (nodes) each of which have 8GB of ram.
> 
> Question 1: We are attempting to load data into Riak using CSVs that we generated from data previously stored is our MySQL database. We are using Ripple to create the documents and associations (links). The problem we are having is Riak continue to grow in memory consumption until it finally crashed while loading this data. We are only able to add around a couple hundred thousand rows from the CSV's before this happens. Riak then responds with 500 errors and eventually all of the nodes crash and the nodes need to be restarted. 
> 
> Question 2 (unrelated): I am attempting to use some of the already defined js functions in ripple.js in a mapreduce, however, I keep getting the following error:
> 
> Riak::MapReduceError: {"phase":0,"error":"[{<<\"lineno\">>,1},{<<\"message\">>,<<\"ReferenceError: Ripple is not defined\">>},{<<\"source\">>,<<\"unknown\">>}]" 
> 
> In ripple.yml I have the following (***** represent hidden values):
> 
> # Configure Riak connections for the Ripple library. 
> development:
> # http_port: 8091
> # pb_port: 8087
> # host: 127.0.0.1
> basic_auth: *****
> http_port: 80
> pb_port: 8087
> host: *****
> http_backend: Excon
> solr: "/solr"
> js_source_dir: <%= Rails.root + "app/mapreduce" %>
> 
> # The test environment has additional keys for configuring the
> # Riak::TestServer for your test/spec suite:
> #
> # * bin_dir specifies the path to the "riak" script that you use to
> # start Riak (just the directory)
> # * js_source_dir specifies where your custom Javascript functions for
> # MapReduce should be loaded from. Usually app/mapreduce.
> test:
> http_port: 9000
> pb_port: 9002
> host: localhost
> 
> source: /usr/local/bin # Default for Homebrew.
> js_source_dir: <%= Rails.root + "/app/mapreduce" %>
> 
> production:
> nodes:
> - host: *****
> http_port: 8098
> pb_port: 8087
> - host: *****
> http_port: 8098
> pb_port: 8087
> - host: *****
> http_port: 8098
> pb_port: 8087
> http_backend: Excon
> solr: "/solr"
> js_source_dir: <%= Rails.root + "app/mapreduce" %>
> 
> 
> I don't see why I am getting this error when I have defined where the js_source_dir is.
> 
> Any help would be greatly appreciated!
> 
> Thanks,
> 
> Gustav 
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com (mailto:riak-users at lists.basho.com)
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com







More information about the riak-users mailing list