"..including key filters ... is an expensive operation that should not be used in production"

Jonathan Langevin jlangevin at loomlearning.com
Tue Aug 23 10:25:06 EDT 2011


What are the recommended alternatives to:
1. Bucket-level m/r
2. List keys

Thinking of a standard usage case where an application would typically allow
pagination of all objects in a bucket, in which case there is often sorting
and filtering included as well (which necessitates m/r).

I use list keys directly if I have to "drop" or "truncate" a bucket, as I
know no alternative to that as well.

While each situation I describe above may be enough to justify my usage of
Riak, I'm building tools around Riak and would rather avoid pushing or
implementing functionality that can directly affect performance in such a
way (if it can be helped).
*

<http://www.loomlearning.com/>
Jonathan Langevin
Systems Administrator
Loom Inc.
Wilmington, NC: (910) 241-0433 - jlangevin at loomlearning.com -
www.loomlearning.com - Skype: intel352
*


On Mon, Aug 22, 2011 at 11:23 PM, Sean Cribbs <sean at basho.com> wrote:

> Craig,
>
> The warning is there to discourage users from using list-keys, but it
> doesn't prevent the operation from performing. Generally, list-keys can spam
> a lot of your cluster, potentially blocking other operations (until some
> upcoming changes land, and always on 0.14.x). You should still plan for the
> day when list-keys will be too inconvenient even for the occasional query.
>
> Nevertheless, you can disable that warning message using:
>
> Riak.disable_list_keys_warnings = true
>
>
> On Mon, Aug 22, 2011 at 11:10 PM, Craig Muth <craig at homerun.com> wrote:
>
>> Seeing this in the log:
>>
>> "Full-bucket MapReduce, including key filters, invokes list-keys which is
>> an expensive operation that should not be used in production"
>>
>> Assuming one is ok with having a query take a few seconds it's acceptable
>> to use a key filter in production, correct?
>>
>> --Craig
>>
>>
>> _______________________________________________
>> riak-users mailing list
>> riak-users at lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>
>>
>
>
> --
> Sean Cribbs <sean at basho.com>
> Developer Advocate
> Basho Technologies, Inc.
> http://www.basho.com/
>
>
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20110823/594aeaab/attachment.html>


More information about the riak-users mailing list