Riak Search - Fast Bulk Insert

Mark Richard Thomas mark.thomas at equifax.com
Thu Aug 14 05:26:56 EDT 2014


Hello

What's the fastest way (best practice) to insert 20 million documents into a Riak Search index?

search-cmd solr my_bucket /insert.xml

For a proof-of-concept I've create a file (index.html) containing 100,000 documents:

<add>
<doc></doc>
<doc></doc>
:
</add>

Thanks

Mark Thomas | Software Engineer | Equifax UK

p:   +44 (0)208 941 0573
m:  +44 (0)7908 798 270
e:   mark.thomas at equifax.com<mailto:mark.thomas at equifax.com>

Equifax Ltd, Capital House, 25 Chapel Street, London, NW1 5DS

Equifax Limited is registered in England with Registered No. 2425920. Registered Office: Capital House, 25 Chapel Street, London NW1 5DS. Equifax Limited is authorised and regulated by the Financial Conduct Authority.
Equifax Touchstone Limited is registered in Scotland with Registered No. SC113401. Registered Office: 54 Deerdykes View, Westfield Park, Cumbernauld G68 9HN.
Equifax Commercial Services Limited is registered in the Republic of Ireland with Registered No. 215393. Registered Office: IDA Business & Technology Park, Rosslare Road, Drinagh, Wexford.

This message contains information from Equifax which may be confidential and privileged. If you are not an intended recipient, please refrain from any disclosure, copying, distribution or use of this information and note that such actions are prohibited. If you have received this transmission in error, please notify by e-mail postmaster at equifax.com<mailto:postmaster at equifax.com>.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20140814/9c892d3f/attachment.html>


More information about the riak-users mailing list