Riak crashed with MANIFEST not found

Nam Nguyen nam at tinyco.com
Fri May 25 21:36:49 EDT 2012


Hi Justin,

I had essentially done the same thing you suggested. I moved the affected directory out of leveldb and restarted riak. Though I did not run repair, it seemed to go well. The nodes are leaving the cluster now.

However, it has been three hours and riak-admin transfers still shows many partitions to handoff. I'm not sure if I should wait for more before doing a force-remove.

Thanks,
Nam


On May 25, 2012, at 5:38 PM, jshoffstall wrote:

> Hi, Nam, 
> 
> On the node that is reporting the LevelDB Manifest error, I would do the
> following: 
> 
> 1. Stop the node if it isn't down already. 
> 
> 2. Backup
> /var/lib/riak/leveldb/502391187832497878132516661246222288006726811648 to
> another folder outside of /var/lib/riak/leveldb. 
> 
> 3. Run the erl binary included with Riak (typically underneath
> /usr/lib/riak/erts-*/bin or /usr/lib64/riak/erts-*/bin in Linux) to startup
> an Erlang shell. 
> 
> 4. Issue the following to open the node's LevelDB database: 
>    [application:set_env(eleveldb, Var, Val) || {Var, Val} <- 
>    [{max_open_files, 2000}, 
>    {block_size, 1048576}, 
>    {cache_size, 20*1024*1024*1024}, 
>    {sync, false}, 
>    {data_root, "/var/lib/riak/leveldb"}]]. 
> 
> 5. Run 
>    eleveldb:repair("502391187832497878132516661246222288006726811648", []). 
> 
> 6. After the repair has completed, run 
>    q(). 
>   or hit ^c twice to exit the shell. 
> 
> 7. Restart Riak. 
> 
> Let us know how this goes. If you run into any more trouble, ping the list
> and we'll give you a hand! 
> 
> Regards, 
> 
> Justin Shoffstall 
> Developer Advocate | Basho Technologies, Inc. 
> 
> 
> --
> View this message in context: http://riak-users.197444.n3.nabble.com/Riak-crashed-with-MANIFEST-not-found-tp4015987p4016113.html
> Sent from the Riak Users mailing list archive at Nabble.com.
> 
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com





More information about the riak-users mailing list