Riak 1.3 YCSB Read Time Out

Jan Pieper jan.pieper at adcloud.com
Sat Jul 13 21:30:12 EDT 2013


Wine. Lanhe ujnd umwiesodooook ;ymm ;}


--
Jan Pieper · Software Engineer

Adcloud GmbH · Venloer Str. 25 · D-50672 Köln
Ein Unternehmen von Deutsche Post DHL
T +49 221 292 095 35 · F +49 221 292 095 99
jan.pieper at adcloud.com · www.adcloud.com
Skype: pieper.jan

Handelsregister: Amtsgericht Köln, HRB 65770 · Sitz der Gesellschaft: Köln
Geschäftsführer: Christoph Mempel, Bente Hepper-Hammelehle
  *From: *Dave Parfitt
*Sent: *Sunday, July 14, 2013 02:01
*To: *Nika Abramova
*Reply To: *Dave Parfitt
*Cc: *riak-users at lists.basho.com
*Subject: *Re: Riak 1.3 YCSB Read Time Out

Hello Veronika,

We suggest a minimum of 5 nodes in a cluster. Riak isn't really designed to
run on a single node.

Cheers,
Dave

On Jul 13, 2013, at 12:15 PM, Nika Abramova <ni4ca at hotmail.com> wrote:

 I am sorry, I thought that was it.
But now I tried to execute workload. And what I am getting is:
com.basho.riak.pbc.RiakError: {insufficient_vnodes,0,need,2} ...
How can I solve that? As far as I checked on Google, it has to do with
cluster nodes and I am running just 1 instance (1 node as server and
client). How can I avoid that error? Maybe disable/change some specific
config parameters?

Regards, Veronika


------------------------------
From: ni4ca at hotmail.com
To: riak-users at lists.basho.com
Subject: RE: Riak 1.3 YCSB Read Time Out
Date: Sat, 13 Jul 2013 17:06:24 +0100

 Greetings,
Thank you for help. I changed what you said but it was not enough. However,
I noticed a Warning about "ulimit -n" is being low, 4096 is recommended. So
I increased mine to max value I can and was able to load 100.000 records.
Now I have to load 200.000 and 600.000 records but if something goes wrong
I know the reason.
Once again, thanks for help.

Have a nice day.
Regards, Veronika

------------------------------
Date: Fri, 12 Jul 2013 21:10:11 -0400
Subject: Re: Riak 1.3 YCSB Read Time Out
From: dparfitt at basho.com
To: ni4ca at hotmail.com
CC: riak-users at lists.basho.com

Hello Veronika -

It looks like you are out of memory. You could try turning active
anti-entropy off via:

 {anti_entropy, {off, []}},

in app.config [0].

Some other docs that you may find useful are the operations guide [1],
choosing a backend [2], Linux performance tuning [3], and file system
tuning [4].

Cheers -
Dave

[0] http://docs.basho.com/riak/latest/references/Configuration-Files/
[1] http://docs.basho.com/riak/latest/operators.html
[2] http://docs.basho.com/riak/latest/tutorials/choosing-a-backend/
[3] http://docs.basho.com/riak/latest/cookbooks/Linux-Performance-Tuning/
[4] http://docs.basho.com/riak/latest/cookbooks/File-System-Tuning/




On Fri, Jul 12, 2013 at 4:39 PM, Nika Abramova <ni4ca at hotmail.com> wrote:

Hello,
I have got logs and error.
So what I got from log was (part of it since it goes all same):
2013-07-12 06:33:35.674 [error] <0.1048.0> gen_server <0.1048.0> terminated
with reason: no match of right hand value {error,{db_write,"IO error:
./data/anti_entropy/639406966332270026714112114313373821099470487552/000003.log:
Cannot allocate memory"}} in hashtree:flush_buffer/1 line 302
2013-07-12 06:33:35.683 [error] <0.1048.0> CRASH REPORT Process <0.1048.0>
with 0 neighbours exited with reason: no match of right hand value
{error,{db_write,"IO error:
./data/anti_entropy/639406966332270026714112114313373821099470487552/000003.log:
Cannot allocate memory"}} in hashtree:flush_buffer/1 line 302 in
gen_server:terminate/6 line 747
2013-07-12 06:33:35.688 [error] <0.28642.0> CRASH REPORT Process
<0.28642.0> with 0 neighbours exited with reason: no match of right hand
value {error,{db_open,"IO error: lock
./data/anti_entropy/639406966332270026714112114313373821099470487552/LOCK:
Resource temporarily unavailable"}} in hashtree:new_segment_store/2 line
499 in gen_server:init_it/6 line 328
2013-07-12 06:33:36.150 [error] <0.968.0> gen_server <0.968.0> terminated
with reason: no match of right hand value {error,{db_write,"IO error:
./data/anti_entropy/525227150915793236229449236757414210188850757632/000003.log:
Cannot allocate memory"}} in hashtree:flush_buffer/1 line 302
2013-07-12 06:33:36.158 [error] <0.968.0> CRASH REPORT Process <0.968.0>
with 0 neighbours exited with reason: no match of right hand value
{error,{db_write,"IO error:
./data/anti_entropy/525227150915793236229449236757414210188850757632/000003.log:
Cannot allocate memory"}} in hashtree:flush_buffer/1 line 302 in
gen_server:terminate/6 line 747
2013-07-12 06:33:36.164 [error] <0.29013.0> CRASH REPORT Process
<0.29013.0> with 0 neighbours exited with reason: no match of right hand
value {error,{db_open,"IO error: lock
./data/anti_entropy/525227150915793236229449236757414210188850757632/LOCK:
Resource temporarily unavailable"}} in hashtree:new_segment_store/2 line
499 in gen_server:init_it/6 line 328
2013-07-12 06:33:36.261 [error] <0.1436.0> gen_server <0.1436.0> terminated
with reason: no match of right hand value {error,{db_write,"IO error:
./data/anti_entropy/1187470080331358621040493926581979953470445191168/000003.log:
Cannot allocate memory"}} in hashtree:flush_buffer/1 line 302
2013-07-12 06:33:36.268 [error] <0.1436.0> CRASH REPORT Process <0.1436.0>
with 0 neighbours exited with reason: no match of right hand value
{error,{db_write,"IO error:
./data/anti_entropy/1187470080331358621040493926581979953470445191168/000003.log:
Cannot allocate memory"}} in hashtree:flush_buffer/1 line 302 in
gen_server:terminate/6 line 747
2013-07-12 06:33:36.317 [error] <0.29134.0> CRASH REPORT Process
<0.29134.0> with 0 neighbours exited with reason: no match of right hand
value {error,{db_open,"IO error: lock
./data/anti_entropy/1187470080331358621040493926581979953470445191168/LOCK:
Resource temporarily unavailable"}} in hashtree:new_segment_store/2 line
499 in gen_server:init_it/6 line 328
2013-07-12 06:33:36.878 [error] <0.29259.0> CRASH REPORT Process
<0.29259.0> with 0 neighbours exited with reason: no match of right hand
value {error,{db_open,"IO error:
./data/anti_entropy/890602560248518965780370444936484965102833893376/000004.dbtmp:
Cannot allocate memory"}} in hashtree:new_segment_store/2 line 499 in
gen_server:init_it/6 line 328
2013-07-12 06:33:37.024 [error] <0.29263.0> CRASH REPORT Process
<0.29263.0> with 0 neighbours exited with reason: no match of right hand
value {error,{db_open,"IO error:
./data/anti_entropy/159851741583067506678528028578343455274867621888/000004.dbtmp:
Cannot allocate memory"}} in hashtree:new_segment_store/2 line 499 in
gen_server:init_it/6 line 328
2013-07-12 06:33:37.041 [error] <0.29260.0> CRASH REPORT Process
<0.29260.0> with 0 neighbours exited with reason: no match of right hand
value {error,{db_open,"IO error:
./data/anti_entropy/867766597165223607683437869425293042920709947392/000004.dbtmp:
Cannot allocate memory"}} in hashtree:new_segment_store/2 line 499 in
gen_server:init_it/6 line 328
2013-07-12 06:33:37.095 [error] <0.29265.0> CRASH REPORT Process
<0.29265.0> with 0 neighbours exited with reason: no match of right hand
value {error,{db_open,"IO error:
./data/anti_entropy/639406966332270026714112114313373821099470487552/000004.dbtmp:
Cannot allocate memory"}} in hashtree:new_segment_store/2 line 499 in
gen_server:init_it/6 line 328

Exception I get is that:
Loading workload...
Starting test.
java.net.SocketTimeoutException: Read timed out
 at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:150)
 at java.net.SocketInputStream.read(SocketInputStream.java:121)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
 at java.io.BufferedInputStream.read(BufferedInputStream.java:254)
at java.io.DataInputStream.readInt(DataInputStream.java:387)
 at com.basho.riak.pbc.RiakConnection.receive(RiakConnection.java:110)
at com.basho.riak.pbc.RiakClient.store(RiakClient.java:581)
 at
com.basho.riak.client.raw.pbc.PBClientAdapter.store(PBClientAdapter.java:177)
at
com.basho.riak.client.raw.pbc.PBClientAdapter.store(PBClientAdapter.java:197)
 at com.basho.riak.client.raw.ClusterClient.store(ClusterClient.java:139)
at com.yahoo.ycsb.db.RiakClient13.insert(RiakClient13.java:184)
 at com.yahoo.ycsb.DBWrapper.insert(DBWrapper.java:148)
at com.yahoo.ycsb.workloads.CoreWorkload.doInsert(CoreWorkload.java:461)
 at com.yahoo.ycsb.ClientThread.run(Client.java:269)
Any ideas?

Regards, Veronika
------------------------------
Date: Fri, 12 Jul 2013 11:31:36 -0400

Subject: Re: Riak 1.3 YCSB Read Time Out
From: dparfitt at basho.com
To: ni4ca at hotmail.com
CC: riak-users at lists.basho.com


Hello Veronika -

  We're actively working on the YCSB project located at [0]. It should work
fine with Riak 1.4. Since the existing implementation of YCSB is a
work-in-progress, you can't trust any results it gives you until we get it
merged upstream with the official YCSB repo. I'm not sure what's causing
the "Read timed Out" exception, can you provide any logs?

Cheers -
Dave

[0] https://github.com/basho-labs/YCSB




On Fri, Jul 12, 2013 at 11:23 AM, Nika Abramova <ni4ca at hotmail.com> wrote:

Thank you for reply.
Of course I can try new version but will I be able to run YCSB for 1.3 over
1.4? This is my concern.
What is the minimal RAM required for Riak to work correctly? I mean, what I
am doing is inserting 100.000 records at once.

Regards, Veronika

------------------------------
Date: Fri, 12 Jul 2013 16:07:23 +0100
From: guido.medina at temetra.com
To: riak-users at lists.basho.com
Subject: Re: Riak 1.3 YCSB Read Time Out


Hi Veronika,

Riak 1.4.0 was released yesterday, with the new streaming features nodes
will stream keys to you instead of working with the whole result in memory,
which will probably avoid the timeout.

Though your RAM and specially using a VM could be a limiting factor, still
worthy a try.
Once your node is up type riak-admin diag and see if some parameters need
to be adjusted.

For more information on tuning:
http://docs.basho.com/riak/latest/cookbooks/Linux-Performance-Tuning/

HTH,

Guido.

On 12/07/13 14:58, Nika Abramova wrote:

Greetings,
I am currently testing different NoSQL databases and now I was starting
Riak. I downloaded and installed Riak 1.3 and was executing YCSB over it.
But after some time (40 sec) of loading data, I got "Read timed Out"
exception.
How can I solve it? I am working locally, on same machine so my connection
is to localhost. Is that lack of RAM that causing that? Since I am using VM
and I only have 2GB RAM for it. Or it is something else I can configure?

 Regards, Veronika


_______________________________________________
riak-users mailing
listriak-users at lists.basho.comhttp://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com



_______________________________________________ riak-users mailing list
riak-users at lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

_______________________________________________
riak-users mailing list
riak-users at lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com



_______________________________________________
riak-users mailing list
riak-users at lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com



_______________________________________________ riak-users mailing list
riak-users at lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

_______________________________________________
riak-users mailing list
riak-users at lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20130714/f6cd3427/attachment.html>


More information about the riak-users mailing list