Language Detection Riak Search

Colin Walker colin at musefind.com
Sun Feb 21 13:43:40 EST 2016


Update: Please ignore the last part of my question. It is not taking more
than a minute to index a single record, that's just bad logging on my part
:) Everything is actually operating smoothly and a large document with
language indexing enabled only adds about 0.5 milliseconds.

On Sun, Feb 21, 2016 at 10:23 AM, Colin Walker <colin at musefind.com> wrote:

> Hello again everyone,
>
> Since I am using Java, I ended up going with a solution where I just used
> the langdetect library right in my Java code and simply appended the
> language code to the strings I want to be able to search. I've found it's
> actually much easier than configuring the update request handlers since I
> can test and see what's going on with my code much more easily. I'm not
> sure what the appetite is for others but I won't be needing the extracting
> request handlers feature.
>
> After enabling this, however, I began to get bad performance, in the range
> of over 1 minute for insertions. I am assuming this is a Solr issue since
> the performance issues only occur on documents that are indexed and which
> are being matched to dynamic language fields. Has anyone seen similar
> performance issues when mapping language specific fields?
>
> Cheers,
>
> Colin Walker
>
>
> On Tue, Feb 16, 2016 at 3:56 PM, Colin Walker <colin at musefind.com> wrote:
>
>> Hey everyone,
>>
>> I am trying to enable language detection in Solr for my Riak nodes. As
>> far as I know this involves adding an extracting request handler in the
>> solrconfig.xml for each Yokozuna index I would like to have the handler
>> applied to on each node.
>>
>> Is there an easy way to configure this in Yokozuna for all nodes? Has
>> anyone worked through adding request handlers before?
>>
>> Thanks,
>>
>> Colin Walker
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20160221/d68313ff/attachment-0002.html>


More information about the riak-users mailing list