Write_lock error has occurred after inserting 12M data

David Smith dizzyd at basho.com
Fri Jul 30 17:10:04 EDT 2010


Given the amount of data Ken has inserted, I'd say there's a 90% chance this
problem is related to a bug I fixed earlier this week:

http://bitbucket.org/basho/bitcask/changeset/6a74d3aac4fb

But without more information, it's hard to say. I presume, Ken, you are also
seeing a vnode crash error before this happens and I'm betting it's emfile
related.

D.

On Fri, Jul 30, 2010 at 3:06 PM, Alexander Sicular <siculars at gmail.com>wrote:

> This may be another max file handler type of error. Or maybe even an oom
> thing if the key length is large.
>
>
> On Jul 30, 2010, at 4:59 PM, Grant Schofield wrote:
>
> > I am not sure if you hit an already fixed bug in Bitcask or not. What
> version of Riak are you running on currently?
> >
> > Grant Schofield
> > Developer Advocate
> > Basho Technologies
> >
> > On Jul 30, 2010, at 1:28 PM, Ken Matsumoto wrote:
> >
> >> Hi all,
> >>
> >> I just tried to insert 1Billion data records.
> >> But I got the "write_lock" error after 12Million data.
> >> What is the reason and how should I avoid this?
> >> I use bitcask (default) backend and no parameters changed in config
> file.
> >> 1 record is just 70B text data.
> >>
> >> Regards,
> >>
> >> Ken.
> >>
> >> --
> >> Ken Matsumoto
> >> VP / Research & Development
> >> Nomura Research Institute America, Inc.
> >> NRI Pacific
> >> 1400 Fashion Island Blvd., Suite 1010
> >> San Mateo, CA 94404, U.S.A.
> >>
> >> PLEASE READ:This e-mail is confidential and intended for the named
> recipient only. If you are not an intended recipient, please notify the
> sender and delete this e-mail.
> >>
> >>
> >> _______________________________________________
> >> riak-users mailing list
> >> riak-users at lists.basho.com
> >> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> >
> >
> > _______________________________________________
> > riak-users mailing list
> > riak-users at lists.basho.com
> > http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
>
> _______________________________________________
> riak-users mailing list
> riak-users at lists.basho.com
> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20100730/26ab5a26/attachment.html>


More information about the riak-users mailing list