Most efficient way to determine if 1000 specific keys exist?

Shuhao Wu admin at thekks.net
Wed May 9 15:50:42 EDT 2012


Agreed. If you need something like that, it's time to combine technologies
or hack something together for now until you need the efficiency later,
then switch to something like redis.

Shuhao


On Wed, May 9, 2012 at 1:35 PM, Alexander Sicular <siculars at gmail.com>wrote:

> Or just do an exists set operation in redis.
>
> Or use a bloom filter. (that you kept in Riak)
>
> Or use your own binary encoding n keys long and flip bits. (that you kept
> in Riak)
>
> Scanning a list of keys in Riak might be one of the most inefficient ways
> to do it. Also I don't like to keep values in Riak that mutate in some
> unbounded way due to compaction issues.
>
> -alexander
>
> @siculars
> http://siculars.posterous.com
>
> Sent from my rotary phone.
> On May 9, 2012 1:13 PM, "Shuhao Wu" <admin at thekks.net> wrote:
>
>> Without reading all the emails.. why can't you just cache the keys in an
>> object and maintain that list? The you could check against that list. This
>> way you don't have to go through every object in riak.
>>
>> Shuhao
>> On May 2, 2012 2:47 PM, "Tim Haines" <tmhaines at gmail.com> wrote:
>>
>>> Hey guys,
>>>
>>> Still a relative newbie here.
>>>
>>> I was hoping to be able to setup a MapReduce job that I could feed 1000
>>> keys to, and have it tell me of the 1000, which keys exist in the bucket.
>>>  I was hoping this could use the key index (such a thing exists right?)
>>> without having to read the objects.
>>>
>>> The methods I've tried for doing this fail when the first non-existing
>>> key is found though.
>>>
>>> Is there a way to do this?
>>>
>>> Or alternatively, is there a way to check for the presence of one key at
>>> a time without riak having to read the object?
>>>
>>> Cheers,
>>>
>>> Tim.
>>>
>>> _______________________________________________
>>> riak-users mailing list
>>> riak-users at lists.basho.com
>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>
>>>
>> _______________________________________________
>> riak-users mailing list
>> riak-users at lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20120509/e5887858/attachment.html>


More information about the riak-users mailing list