Upgraded riak 1.4.9 is pegging the CPU
shane at mcewan.id.au
Thu Jun 5 11:42:36 EDT 2014
On 05/06/14 16:20, Alain Rodriguez wrote:
> Hi all,
> I upgraded 1 of 9 riak nodes in a cluster last night from 1.4.0 to
> 1.4.9. The rest are running 1.4.0.
> Ever since I am seeing the upgraded node, riak01 consuming a
> significantly larger percent of CPU and the PUT times on it have gotten
> worse. htop indicicates one particular process pegging the CPU, and many
> many more processes running than I was used to seeing before.
Did you turn off and remove the Active Anti Entropy files before upgrading?
>From the 1.4.8 release notes:
IMPORTANT We recommend removing current AAE trees before upgrading. That
is, all files under the anti_entropy sub-directory. This will avoid
potentially large amounts of repair activity once correct hashes start
being added. The data in the current trees can only be fixed by a full
rebuild, so this repair activity is wasteful. Trees will start to build
once AAE is re-enabled. To minimize the impact of this, we recommend
upgrading during a period of low activity.
More information about the riak-users