Tweaking app.config and vm.args for best performance

Guido Medina guido.medina at temetra.com
Tue Jul 23 10:12:42 EDT 2013


Take a look at http://docs.basho.com/riak/latest/ops/tuning/linux/
On the left menu, there are more tuning links, check them out too.

HTH,

Guido.

On 23/07/13 14:50, rsb wrote:
> Environment
>
> - 5x Riak 1.4 nodes
> - Bitcask as a backend
> - Dedicated HDDs for each node storage, no RAID
> - Virtualized environment (I know... I know... )
>
> VM Host Specs
>
> - 8 CPUs x 2.8 GHz (Xenon X5560)
> - 65Gb of RAM
> - Fiber optic network
>
> Per Nodes Specs (Allocated Resources)
>
> - Ubuntu server 12.04
> - 11 Gb of RAM dedicated
> - Dynamic CPU shares, should MHz be be reserved for each node?
> - 7200 RPM, 320GB spindles
>
> The Data
>
> Custom benchmarking application (Riak Java API using Protocol Buffers) where
> each record is about 800 bytes in size. The application is currently
> configured to simulate a client running 600 Threads, 10 batches per thread,
> where each batch has 70 records. Therefore the total load is about 420k
> records. We are looking to push in the future about 500 million items during
> our benchmarks.
>
> /Please feel free to suggest better ways to distribute the load; whether
> that is more threads, smaller batches, etc.../
>
> vm.args
>
> Everything is pretty much on defaults, however I was wondering if I should
> be tweaking any of the following;
> - Kernel poll and async threads
> - ERL_MAX_PORTS
> - ERL_MAX_ETS_TABLES
> - Erlang process limit
>
> app.config
>
> Same thing for the config file. Mostly default values. Any suggestions about
> tweaking;
> - disable_pb_nagle
> - pb_backlog
> - ring_creation_size
> - map_js_vm_count
> - reduce_js_vm_count
> - hook_js_vm_count
> - js_max_vm_mem
> - js_thread_stack
> - fsm_limit
> - buffer_rollover_size
> - gc_ms_limit
> - heap_word_limit
> - Any other missing setting that might not be present by default ?
>
> OS Tuning
>
> Apart from 'ulimit' which other settings should I be warry of that might
> need setting?
>
> Bonus Question :)
>
> We might be trying LevelDB as well, any I should be aware or model within my
> application/settings to deal with this other backend?
>
> Thank you a whole lot in advance!
>
>
>
> --
> View this message in context: http://riak-users.197444.n3.nabble.com/Tweaking-app-config-and-vm-args-for-best-performance-tp4028510.html
> Sent from the Riak Users mailing list archive at Nabble.com.
>
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com





More information about the riak-users mailing list