riak ubuntu 11 building problems

Jared Morrow jared at basho.com
Tue Nov 8 18:09:29 EST 2011


In an effort to reproduce the problem, I started with a fresh ubuntu 11.10
image to build riak.   First off you'll need these dependencies for ubuntu
11: make, binutils (really ubuntu, no gnu make by default?),
libncurses5-dev, libssl-dev (or libssl-dev-0.9.8 if you are using riak deb
package), libstdc++, g++.
Here are the steps I did:

Download erlang R14B03 from erlang.org and download riak-1.0.1 source
tar.gz file from downloads.basho.com.

jared at dev-ubuntu-01:~$ ls
otp_src_R14B03  otp_src_R14B03.tar.gz  riak-1.0.1  riak-1.0.1.tar.gz
jared at dev-ubuntu-01:~$ uname -a
Linux dev-ubuntu-01 3.0.0-12-server #20-Ubuntu SMP Fri Oct 7 16:36:30 UTC
2011 x86_64 x86_64 x86_64 GNU/Linux
<snip>
build erlang from source (configure / make / make install)
<snip>
jared at dev-ubuntu-01:~/riak-1.0.1$ make rel
make: git: Command not found
./rebar get-deps
make: git: Command not found
make: git: Command not found
make: git: Command not found
==> cluster_info (get-deps)
==> skerl (get-deps)
==> lager (get-deps)
==> poolboy (get-deps)
==> protobuffs (get-deps)
==> basho_stats (get-deps)
==> riak_sysmon (get-deps)
==> mochiweb (get-deps)
==> webmachine (get-deps)
==> riak_core (get-deps)
==> riakc (get-deps)
==> luke (get-deps)
==> erlang_js (get-deps)
==> bitcask (get-deps)
==> merge_index (get-deps)
==> ebloom (get-deps)
==> eper (get-deps)
==> eleveldb (get-deps)
==> edown (get-deps)
==> sext (get-deps)
==> riak_pipe (get-deps)
==> basho_metrics (get-deps)
==> riak_kv (get-deps)
==> luwak (get-deps)
==> lucene_parser (get-deps)
==> riak_search (get-deps)
==> rel (get-deps)
==> riak-1.0.1 (get-deps)
./rebar compile generate
make: git: Command not found
make: git: Command not found
make: git: Command not found
==> cluster_info (compile)
Compiled src/cluster_info_ex.erl
Compiled src/cluster_info.erl
Compiled src/cluster_info_basic.erl
==> skerl (compile)
Compiled src/hex.erl
Compiled src/skerl.erl
Compiling c_src/skein.c
Compiling c_src/skein_api.c
Compiling c_src/skein_block.c
Compiling c_src/skein_debug.c
Compiling c_src/skerl_nifs.c
==> lager (compile)
Compiled src/lager_util.erl
Compiled src/lager_transform.erl
Compiled src/lager_handler_watcher.erl
Compiled src/lager_trunc_io.erl
Compiled src/lager_file_backend.erl
Compiled src/lager_sup.erl
Compiled src/lager_crash_log.erl
Compiled src/lager_console_backend.erl
Compiled src/lager_app.erl
Compiled src/error_logger_lager_h.erl
Compiled src/lager.erl
Compiled src/lager_stdlib.erl
Compiled src/lager_handler_watcher_sup.erl
Compiled src/lager_mochiglobal.erl
==> poolboy (compile)
Compiled src/poolboy_sup.erl
Compiled src/poolboy.erl
==> protobuffs (compile)
Compiled src/protobuffs_scanner.xrl
Compiled src/protobuffs_parser.yrl
Compiled src/pokemon_pb.erl
Compiled src/protobuffs.erl
Compiled src/protobuffs_compile.erl
Compiled src/protobuffs_scanner.erl
Compiled src/protobuffs_parser.erl
==> basho_stats (compile)
Compiled src/basho_stats_rv.erl
Compiled src/basho_stats_utils.erl
Compiled src/basho_stats_sample.erl
Compiled src/basho_stats_histogram.erl
==> riak_sysmon (compile)
Compiled src/riak_sysmon_sup.erl
Compiled src/riak_sysmon_testhandler.erl
Compiled src/riak_sysmon_app.erl
Compiled src/riak_sysmon_example_handler.erl
Compiled src/riak_sysmon_filter.erl
==> mochiweb (compile)
Compiled src/mochifmt_std.erl
Compiled src/mochilists.erl
Compiled src/mochiweb_charref.erl
Compiled src/mochiweb_acceptor.erl
Compiled src/mochihex.erl
Compiled src/mochiweb_headers.erl
Compiled src/mochifmt_records.erl
Compiled src/mochifmt.erl
Compiled src/mochijson2.erl
Compiled src/mochiweb_sup.erl
Compiled src/mochiweb_echo.erl
Compiled src/mochiweb_skel.erl
Compiled src/mochiweb_app.erl
Compiled src/mochiweb.erl
Compiled src/mochilogfile2.erl
Compiled src/mochiutf8.erl
Compiled src/mochiweb_io.erl
Compiled src/mochiweb_cookies.erl
Compiled src/mochiweb_util.erl
Compiled src/mochiweb_cover.erl
Compiled src/mochiweb_mime.erl
Compiled src/mochinum.erl
Compiled src/mochitemp.erl
Compiled src/mochiweb_request.erl
Compiled src/mochiweb_multipart.erl
Compiled src/mochiweb_request_tests.erl
Compiled src/mochiweb_response.erl
Compiled src/mochiweb_socket.erl
Compiled src/mochiweb_http.erl
Compiled src/mochiglobal.erl
Compiled src/reloader.erl
Compiled src/mochiweb_socket_server.erl
Compiled src/mochijson.erl
Compiled src/mochiweb_html.erl
==> webmachine (compile)
Compiled src/webmachine_error_handler.erl
Compiled src/webmachine_sup.erl
Compiled src/webmachine_logger.erl
Compiled src/webmachine_perf_logger.erl
Compiled src/wmtrace_resource.erl
Compiled src/webmachine.erl
Compiled src/webmachine_deps.erl
Compiled src/webmachine_multipart.erl
Compiled src/webmachine_resource.erl
Compiled src/webmachine_mochiweb.erl
Compiled src/webmachine_router.erl
Compiled src/webmachine_app.erl
Compiled src/webmachine_util.erl
Compiled src/wrq.erl
Compiled src/webmachine_decision_core.erl
Compiled src/webmachine_dispatcher.erl
Compiled src/webmachine_request.erl
==> riak_core (compile)
Compiling src/riak_core.proto
=INFO REPORT==== 8-Nov-2011::15:56:33 ===
Writing header file to "riak_core_pb.hrl"
=INFO REPORT==== 8-Nov-2011::15:56:33 ===
Writing beam file to "riak_core_pb.beam"
Compiled src/gen_nb_server.erl
Compiled src/gen_server2.erl
Compiled src/riak_core_vnode_worker.erl
Compiled src/riak_core_coverage_fsm.erl
Compiled src/supervisor_pre_r14b04.erl
Compiled src/riak_core_vnode.erl
Compiled src/riak_core_vnode_sup.erl
Compiled src/riak_core_handoff_receiver.erl
Compiled src/riak_core_claim.erl
Compiled src/riak_core_stat.erl
Compiled src/riak_core_ring_events.erl
Compiled src/process_proxy.erl
Compiled src/riak_core_test_util.erl
Compiled src/riak_core_vnode_worker_pool.erl
Compiled src/riak_core_handoff_sender.erl
Compiled src/riak_core_coverage_plan.erl
Compiled src/spiraltime.erl
Compiled src/riak_core_sup.erl
Compiled src/riak_core_node_watcher.erl
Compiled src/riak_core_cinfo_core.erl
Compiled src/app_helper.erl
Compiled src/riak_core_handoff_manager.erl
Compiled src/bloom.erl
Compiled src/riak_core_new_claim.erl
Compiled src/vclock.erl
Compiled src/riak_core_eventhandler_sup.erl
Compiled src/riak_core_vnode_master.erl
Compiled src/riak_core_console.erl
Compiled src/riak_core_sysmon_minder.erl
Compiled src/priority_queue.erl
Compiled src/riak_core_tracer.erl
Compiled src/riak_core_gossip.erl
Compiled src/riak_core_util.erl
Compiled src/riak_core.erl
Compiled src/riak_core_bucket.erl
Compiled src/riak_core_sysmon_handler.erl
Compiled src/riak_core_status.erl
Compiled src/riak_core_ring_util.erl
Compiled src/riak_core_ring.erl
Compiled src/riak_core_handoff_listener.erl
Compiled src/riak_core_web.erl
Compiled src/riak_core_ring_handler.erl
Compiled src/chash.erl
Compiled src/riak_core_node_watcher_events.erl
Compiled src/json_pp.erl
Compiled src/riak_core_ring_manager.erl
Compiled src/riak_core_apl.erl
Compiled src/riak_core_config.erl
Compiled src/riak_core_nodeid.erl
Compiled src/riak_core_gossip_legacy.erl
Compiled src/riak_core_eventhandler_guard.erl
Compiled src/riak_core_wm_urlmap.erl
Compiled src/riak_core_vnode_manager.erl
Compiled src/riak_core_app.erl
Compiled src/slide.erl
Compiled src/merkerl.erl
==> riakc (compile)
Compiling src/riakclient.proto

=INFO REPORT==== 8-Nov-2011::15:56:36 ===
Writing header file to "riakclient_pb.hrl"

=INFO REPORT==== 8-Nov-2011::15:56:36 ===
Writing beam file to "riakclient_pb.beam"
Compiled src/riakc_obj.erl
Compiled src/riakc_pb.erl
Compiled src/riakc_pb_socket.erl
==> luke (compile)
Compiled src/luke_phase.erl
Compiled src/luke_phase_sup.erl
Compiled src/luke_flow_cache.erl
Compiled src/luke.erl
Compiled src/luke_sup.erl
Compiled src/luke_phases.erl
Compiled src/luke_flow_sup.erl
Compiled src/luke_flow.erl
==> erlang_js (compile)

<snip>

Compiled src/riak_kv_put_core.erl
Compiled src/riak_kv_reduce_phase.erl
Compiled src/riak_kv_worker.erl
Compiled src/riak_kv_w_reduce.erl
Compiled src/riak_kv_wm_index.erl
Compiled src/riak_kv_keys_fsm.erl
Compiled src/riak_kv_mapred_json.erl
Compiled src/riak_kv_buckets_fsm.erl
Compiled src/riak_kv_mapred_query.erl
Compiled src/riak_kv_legacy_vnode.erl
Compiled src/riak_kv_backup.erl
Compiled src/lk.erl
Compiled src/riak_kv_wm_mapred.erl
Compiled src/riak_kv_keys_fsm_legacy.erl
Compiled src/riak_kv_keys_fsm_sup.erl
Compiled src/riak_kv_mapred_cache.erl
Compiled src/riak_kv_delete.erl
Compiled src/riak_kv_put_fsm_sup.erl
Compiled src/riak_kv_buckets_fsm_sup.erl
Compiled src/riak_kv_pb_socket.erl
Compiled src/riak_kv_stat.erl
Compiled src/riak_kv_eleveldb_backend.erl
==> luwak (compile)
Compiled src/luwak_app.erl
Compiled src/luwak_block.erl
Compiled src/luwak_file.erl
Compiled src/luwak_io.erl
Compiled src/luwak_tree.erl
Compiled src/luwak_tree_utils.erl
Compiled src/luwak_get_stream.erl
Compiled src/luwak_checksum.erl
Compiled src/luwak_wm_file.erl
Compiled src/luwak_put_stream.erl
==> lucene_parser (compile)
Compiled src/lucene_scan.xrl
Compiled src/lucene_parse.yrl
Compiled src/lucene_parser.erl
Compiled src/lucene_scan_test.erl
Compiled src/lucene_parse_test.erl
Compiled src/lucene_parse.erl
Compiled src/lucene_scan.erl
==> riak_search (compile)
Compiled src/riak_search_backend.erl
Compiled src/riak_search_operators_qc.erl
Compiled src/riak_search_kv_json_extractor.erl
Compiled src/riak_search_vnode.erl
Compiled src/riak_search_basic_qc.erl
Compiled src/riak_search_test.erl
Compiled src/riak_search_schema.erl
Compiled src/riak_search_op_intersection.erl
Compiled src/riak_search_utils.erl
Compiled src/riak_search_dir_indexer.erl
Compiled src/riak_solr_qc.erl
Compiled src/riak_search_ring_utils.erl
Compiled src/riak_search_op_range_worker.erl
Compiled src/riak_indexed_doc.erl
Compiled src/riak_search_kv_extractor.erl
Compiled src/riak_search_kv_xml_extractor.erl
Compiled src/riak_search_app.erl
Compiled src/riak_search_op_range_sized.erl
Compiled src/riak_search_kv_erlang_extractor.erl
Compiled src/riak_search_op_group.erl
Compiled src/riak_solr_sup.erl
Compiled src/riak_search_op.erl
Compiled src/riak_solr_indexer_wm.erl
Compiled src/riak_search_client.erl
Compiled src/riak_solr_xml.erl
Compiled src/riak_search_op_utils.erl
Compiled src/riak_search_cinfo.erl
Compiled src/riak_search_kv_hook.erl
Compiled src/riak_solr_search_client.erl
Compiled src/riak_search_op_mockterm.erl
Compiled src/riak_solr_xml_xform.erl
Compiled src/riak_search_op_term.erl
Compiled src/riak_search_inlines.erl
Compiled src/riak_search_ets_backend.erl
Compiled src/riak_search_config.erl
Compiled src/riak_search_schema_parser.erl
Compiled src/riak_search_op_range.erl
Compiled src/riak_solr_searcher_wm.erl
Compiled src/riak_solr_output.erl
Compiled src/riak_search_vnode_sup.erl
Compiled src/riak_search.erl
Compiled src/riak_search_op_string.erl
Compiled src/riak_search_op_proximity.erl
Compiled src/merge_index_backend.erl
Compiled src/riak_search_op_scope.erl
Compiled src/riak_search_kv_raw_extractor.erl
Compiled src/riak_search_kv_erlang_binary_extractor.erl
Compiled src/riak_search_op_node.erl
Compiled src/solr_search.erl
Compiled src/riak_search_sup.erl
Compiled src/riak_search_op_union.erl
Compiled src/riak_search_cmd.erl
Compiled src/riak_search_op_negation.erl
Compiled src/basho_bench_driver_riaksearch.erl
Compiled src/riak_solr_sort.erl
Compiled src/text_analyzers.erl
Compiled src/search.erl
==> rel (compile)
==> riak-1.0.1 (compile)
==> rel (generate)
jared at dev-ubuntu-01:~/riak-1.0.1$



As you can see, riak does compile fine on ubuntu 11.   Your issue really
looks like stale dependencies, so it might be as easy as "rm -rf deps" to
clean out the deps directory and try to do another 'make rel'

Hope this helps,
-Jared

On Tue, Nov 8, 2011 at 12:37 PM, Ivan Trajkovic <ivan.ebiz at gmail.com> wrote:

> any idea on why this might be happening?
> for now Im using Ubuntu 10.04 for my riak development, but would really
> love to have it running on my Ubuntu 11.04 machines...
>
>
> ps. by accident I see I sent the last email reply to Jared personally
> instead of to the riak list...
>
> On Wed, Nov 2, 2011 at 4:05 PM, Ivan Trajkovic <ivan.ebiz at gmail.com>wrote:
>
>> hello Jared
>> thank you for getting back to me
>>
>> Im compiling against erlang R14B03
>> here is the output of running "make rel" in the riak source base dir.
>>
>> $ make rel
>> ./rebar get-deps
>> ==> cluster_info (get-deps)
>> ==> rel (get-deps)
>> ==> riak (get-deps)
>> ERROR: Dependency dir /media/data/installs/riak/deps/luwak failed
>> application validation with reason:
>> {version_mismatch,{"/media/data/installs/riak/deps/luwak/ebin/luwak.app",
>>                    {expected,"1.1.1"},
>>                    {has,"1.1.0"}}}.
>> make: *** [deps] Error 1
>>
>>
>>
>>
>>
>>
>> I think I got passed these errors a few days ago by manually
>> 1. "git fetch"
>> 2. "git reset --hard origin/master"
>> in each of the dependency sub-folders(repos)...
>>
>>
>>
>>
>>
>>
>>
>>
>> On Mon, Oct 31, 2011 at 2:30 PM, Jared Morrow <jared at basho.com> wrote:
>>
>>> Ivan,
>>>
>>> We build the Riak 1.0 packages with Erlang R14B03 currently.   We build
>>> on both Ubuntu 10 and Ubuntu 11 based machines with erlang compiled from
>>> source from erlang.org.   I can take a look at your issues, can you put
>>> the following output in a gist or pastebin for me?
>>>
>>> $ which erl
>>> $ erl -version
>>> $ git clone git at github.com:basho/riak
>>> $ cd riak
>>> $ make rel
>>>
>>> Thanks,
>>> Jared
>>>
>>>  On Mon, Oct 31, 2011 at 12:06 PM, Ivan Trajkovic <ivan.ebiz at gmail.com>wrote:
>>>
>>>>  so yes the build on ubuntu 11.04 is definitely broken. I tried
>>>> multiple machines.
>>>> ubuntu 10.04 builds without a glitch.
>>>>
>>>> online I see no tutorials on building on 11.04
>>>> is this something thats not a common case?
>>>>
>>>>
>>>> On Sat, Oct 29, 2011 at 2:08 AM, Ivan Trajkovic <ivan.ebiz at gmail.com>wrote:
>>>>
>>>>> hello all
>>>>> Im having some problems with building riak from the github sources, on
>>>>> ubuntu 11
>>>>> Ive reproduced this issue on one of my home computers and a linode
>>>>> virtual server, both running ubuntu 11
>>>>>
>>>>>
>>>>> first of all riak 1.0.1 checkout requires me to have erlang R14B3,
>>>>> which is confusing to me since the riak_1.0.1_i386.deb seems to be working
>>>>> off of erlang R15A.
>>>>> the requirement is manifested in a message being spit out half way
>>>>> through the riak "make rel", about erlang not being of the correct version.
>>>>> so I compiled a older R14B3 version of erlang and restarted the riak
>>>>> build process...
>>>>> it does finish "make rel" then but goes on to require "nodetools"
>>>>> which are not present in the erts-5.9 which is whats being checked, and is
>>>>> instead hiding in erts-5.8.4 folder (which is not whats used by riak). so I
>>>>> went ahead and copied nodetools from 5.8.4 and put it in 5.9... it doesnt
>>>>> complain about that anymore after that... however then the new memsup
>>>>> issues pop up, with the Erlang VM dying each time I run "riak start"
>>>>> without any messages except mentioning memsup as the final issue...
>>>>>
>>>>> for the memsup issue I did check that ulimit is allowing 1024 file
>>>>> handles, and have increased that limit further as well, but no luck.
>>>>>
>>>>>
>>>>>
>>>>> please let me know if you need some more info about my setup, or
>>>>> thoughts/ideas about what I might be dealing with.
>>>>>
>>>>>
>>>>>
>>>>> help is appreciated
>>>>> thanks
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> riak-users mailing list
>>>> riak-users at lists.basho.com
>>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>>
>>>>
>>>
>>
>
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20111108/4103ca17/attachment.html>


More information about the riak-users mailing list