Riak One partition handoff stall

Bryan Hunt bryan.hunt at erlang-solutions.com
Mon May 28 07:27:32 EDT 2018


Are you constantly executing a particular riak command, in your system monitoring scripts, for example: `riak-admin vnode-status` ? 

What size is your data per server ? 

How many objects are you storing ? 

---
Erlang Solutions cares about your data and privacy; please find all details about the basis for communicating with you and the way we process your data in our Privacy Policy.You can update your email preferences or opt-out from receiving Marketing emails here.

> On 28 May 2018, at 08:29, Gaurav Sood <gaurav.sood at mediologysoftware.com> wrote:
> 
> Hi All - Good Day!
> 
> I have a 7 Node Raik_KV cluster. Recently I have upgraded this cluster from 1.4.2  to 1.4.12 on Ubuntu 16.04. After upgrading the cluster whenever I leave a node from cluster one partition hand off stalled every time & Active transfers shows 'waiting to handoff 1 partitions", to complete this process I need to reboot the riak service on all nodes one by one. 
> 
> I am not sure if it's configuration problem. Here is the current state of cluster.
> 
> #output of riak-admin member-status
> ================================= Membership ==================================
> Status     Ring    Pending    Node
> -------------------------------------------------------------------------------
> leaving     0.0%      --      'riak at 192.168.2.10 <mailto:riak at 192.168.2.10>'
> valid      14.1%      --      'riak at 192.168.2.11 <mailto:riak at 192.168.2.11>'
> valid      14.1%      --      'riak at 192.168.2.12 <mailto:riak at 192.168.2.12>'
> valid      15.6%      --      'riak at 192.168.2.13 <mailto:riak at 192.168.2.13>'
> valid      14.1%      --      'riak at 192.168.2.14 <mailto:riak at 192.168.2.14>'
> valid      14.1%      --      'riak at 192.168.2.15 <mailto:riak at 192.168.2.15>'
> valid      14.1%      --      'riak at 192.168.2.16 <mailto:riak at 192.168.2.16>'
> valid      14.1%      --      'riak at 192.168.2.17 <mailto:riak at 192.168.2.17>'
> -------------------------------------------------------------------------------
> Valid:7 / Leaving:1 / Exiting:0 / Joining:0 / Down:0
> 
> #output of riak-admin transfers
> 
> 'riak at 192.168.2.10 <mailto:riak at 192.168.2.10>' waiting to handoff 1 partitions
> 
> Active Transfers:
> 
> (nothing here)
> 
> 
> #Output of riak-admin ring_status
> ================================== Claimant ===================================
> Claimant:  'riak at 192.168.2.10 <mailto:riak at 192.168.2.10>'
> Status:     up
> Ring Ready: true
> 
> ============================== Ownership Handoff ==============================
> No pending changes.
> 
> ============================== Unreachable Nodes ==============================
> All nodes are up and reachable
> 
> current Transfer Limit is 2.
> 
> Thanks
> Gaurav
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20180528/448ae8ee/attachment.html>


More information about the riak-users mailing list