too_many_results error

Rusty Klophaus rusty at basho.com
Sun Jan 16 09:06:09 EST 2011


That's one way of looking at it. The other viewpoint is that given the
choice between returning a partial (a.k.a. incorrect) result set vs. failing
loudly, the safest option is to fail loudly.

Ideally there would be a way to return a partial result set with an
indication in Solr that the result set is partial, but:

1) The Solr spec doesn't indicate a way to include such a message (at least
none that I could find)
2) This is the first iteration of this feature, so we decided to keep it
simple until we have more detailed information on what people need.

So with that in mind, how would you prefer this be handled? I'm open to
rethinking the behavior.

Best,
Rusty


On Sun, Jan 16, 2011 at 8:53 AM, Eric Moritz <eric at themoritzfamily.com>wrote:

> That sounds like a bug rather that a feature to me. For instance if I wrote
> 100,001 blog entries, the search engine breaks hard for a query trying to
> find my latest tweets.
>
> Is that what would happen?
> ---------- Forwarded message ----------
> From: "Rusty Klophaus" <rusty at basho.com>
> Date: Jan 16, 2011 8:42 AM
> Subject: Re: Re: too_many_results error
> To: "Eric Moritz" <eric at themoritzfamily.com>
> Cc: "riak-users at lists.basho.com" <riak-users at lists.basho.com>
>
> Hi Eric,
>
> This is a failsafe that is applied prior to the 'rows' parameter.
>
> It is applied separately to provide a hard system limit, intended to allow
> the cluster administrator to guard against a malicious user, a client
> application that accidentally requests too much data, etc.
>
> Best,
> Rusty
>
>
> On Sun, Jan 16, 2011 at 8:38 AM, Eric Moritz <eric at themoritzfamily.com>wrote:
>
>> Would using the rows URL parameter fix this or is the error occurring
>> prior to the result being limited?
>>  ---------- Forwarded message ----------
>> From: "Rusty Klophaus" <rusty at basho.com>
>> Date: Jan 16, 2011 8:34 AM
>> Subject: Re: too_many_results error
>> To: "Malka Feldman" <malkaf at 3basegroup.com>
>> Cc: <riak-users at lists.basho.com>
>>
>> Hi Malka,
>>
>> The error you see is caused by a protective configuration setting that is
>> new in the 0.14 release. By default, the system will stop the query after
>> 100,000 results and return an error to the system. It is intended to prevent
>> Riak Search from grabbing all available memory when faced with a large
>> result set.
>>
>> You can override this by setting the 'max_search_results' setting in the
>> etc/app.config file.
>>
>> Best,
>> Rusty
>>
>> On Sun, Jan 16, 2011 at 7:11 AM, Malka Feldman <malkaf at 3basegroup.com>wrote:
>>
>>>  Hi
>>> I try to get results from query through solr , but I get the error of too
>>> many results
>>> the query is :
>>> http://79.125.59.136:8098/solr/user_profile/select?q=country:USA
>>> I know I can have hundreds of thousands of answers, can it hold them?
>>>
>>> the error :
>>>
>>> {error,
>>>     {throw,
>>>         {too_many_results,
>>>             {scope,#Ref<0.0.78.140604>,"user_profile","value",
>>>                 {scope,#Ref<0.0.78.140603>,undefined,"country",
>>>                     {term,#Ref<0.0.78.140609>,<<"USA">>,
>>>                         [{'riak at 10.230.7.111',28438},
>>>                          {'riak at 10.230.21.243',28438},
>>>                          {'riak at 10.230.45.195',28438}],
>>>                         28438.0,1.0,
>>>                         #Fun}}}},
>>>         [{riak_search_client,'-search/5-fun-0-',4},
>>>          {riak_search_client,fold_results,5},
>>>          {riak_search_client,search,6},
>>>          {riak_search_client,search_doc,6},
>>>          {riak_solr_searcher_wm,run_query,1},
>>>          {riak_solr_searcher_wm,to_xml,2},
>>>          {webmachine_resource,resource_call,3},
>>>          {webmachine_resource,do,3}]}}
>>>
>>>
>>> thanks,
>>> --
>>>
>>> *Malka Feldman*
>>> Tribase LTD.
>>>
>>> 41 Shimon Hatzadik St.
>>>
>>> Elad, Israel
>>>
>>> Tel. 074-7122736  Fax. 03-9075211 Cell. 972-54-8370828
>>>
>>> m <miri.meltzer at tribasesoft.com>alkaf at 3basegroup.com
>>>
>>> www.3basegroup.com <http://www.tribasesoft.com>
>>>
>>> [image: cid:image001.jpg at 01CB2DDB.3AC492C0]
>>>
>>>
>>>
>>> _______________________________________________
>>> riak-users mailing list
>>> riak-users at lists.basho.com
>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>
>>>
>>
>> _______________________________________________
>> riak-users mailing list
>> riak-users at lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>
>>
>> _______________________________________________
>> riak-users mailing list
>> riak-users at lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>
>>
>
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20110116/baa1be9d/attachment-0001.html>


More information about the riak-users mailing list