preflist_exhausted error

Sati, Mohit Mohit.Sati at ask.com
Fri Apr 27 14:53:16 EDT 2012


Hello All,

After creating the index for all keys:

Index creation:
============

curl -X PUT -H "Content-Type: application/json" \
        -H "x-riak-index-day_int: 20110723" \
        http://localhost:8098/riak/tagg_dsquery/<key> -d "<data>"

Index Verfication:
===========
curl http://localhost:8098/buckets/tagg_dsquery/index/day_int/20110723


I was able to issue range queries. For dates 07/23 - 07/30 the query runs fine. Previously, this was not working. I could not go beyond 1 day. But as the data grows in the later months, i cannot issue a week range. I'm getting the same "preflist_exhausted" error. The number of records have grown in Oct, Nov, Jan, Feb etc. How do you deal with the data growth?

Thanks
Mohit



________________________________
From: Sean Cribbs [sean at basho.com]
Sent: Tuesday, April 24, 2012 11:58 AM
To: Sati, Mohit
Cc: riak-users at lists.basho.com
Subject: Re: preflist_exhausted error

Mohit,

Be aware that key filters are just a thin layer on top of full-bucket key listings. You'd be better off storing the field you want to filter in a secondary index, which more efficiently supports range queries (note that only the LevelDB storage engine currently supports secondary indexes). Barring that, you could use the special "$key" index for a range query on the key.

On Tue, Apr 24, 2012 at 1:07 PM, Sati, Mohit <Mohit.Sati at ask.com<mailto:Mohit.Sati at ask.com>> wrote:
Hello All,

I'm getting the below error in my queries. I'm using riak 1.1.1

Riak Version:
============
$rpm -qa | grep riak
riak-1.1.1-1.el6.x86_64

Riak Error:
========
HTTP/1.1 100 Continue
HTTP/1.1 500 Internal Server Error
Server: MochiWeb/1.1 WebMachine/1.9.0 (someone had painted it blue)
Date: Tue, 24 Apr 2012 16:58:53 GMT
Content-Type: application/json
Content-Length: 625
{"phase":0,"error":"[preflist_exhausted]"

Query:
==========
My query is doing a range scan. I can only get data for 1 day. For 2 or more days it is throwing the error posted above.

{"inputs":{ "bucket":"tagg_dsquery",
            "key_filters":[["and",
                  [["starts_with", "dsquery-us_prm"]],
                  [["and",
                    [["tokenize", "-", 5], ["greater_than_eq", "20120312"]],
                    [["tokenize", "-", 5], ["less_than_eq", "20120314"]]
                  ]]
                ]]},
...
...


app.config changes:
=============
map_js_vm_count - increased to 32,64,128 and 256 but not helping
js_max_vm_mem - increased to 32,64,128,256,512 and 1024.
js_thread_stack - increased to 64,128,256,512,1024 and 2048 (cannot go beyond) - riak would not start

Can anyone help me to debug this issue. My queries cannot go beyond 1 day

Thanks
Mohit

_______________________________________________
riak-users mailing list
riak-users at lists.basho.com<mailto:riak-users at lists.basho.com>
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com




--
Sean Cribbs <sean at basho.com<mailto:sean at basho.com>>
Software Engineer
Basho Technologies, Inc.
http://basho.com/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20120427/9403823c/attachment.html>


More information about the riak-users mailing list