leveldb issues.

Matthew Von-Maszewski matthewv at basho.com
Thu Jun 19 14:18:02 EDT 2014


Yes.

On Jun 19, 2014, at 1:47 PM, Theo Schlossnagle <jesus at omniti.com> wrote:

> To be clear, you're considering a13160da8adeca96d80388cc77cb88ad5301aeaa the latest?
> 
> 
> On Thu, Jun 19, 2014 at 12:36 PM, Matthew Von-Maszewski <matthewv at basho.com> wrote:
> Running repair now may have detected damage done to your data long ago.  Repair reads every file and tests the CRC on every block in the file.
> 
> Two known issues might have caused the original corruption:
> 
> https://github.com/basho/leveldb/wiki/mv-verify-compactions 
> 
> or 
> 
> https://github.com/basho/leveldb/wiki/mv-async-close
> 
> 
> Also, there is a bug in the 532bb commit that can cause level-0 files to be wrongly deleted.  I suggest pulling the latest to get rid of that bug.
> 
> Matthew
> 
> 
> On Jun 19, 2014, at 12:24 PM, Theo Schlossnagle <jesus at omniti.com> wrote:
> 
>> I'm using basho/leveldb as of commit: 532bb6351e7835e862c8508520780bfc9d0c2b78 (no snappy)
>> 
>> I have an issue with some small sized database... they claim corruption, but when running a repair I have a nonsensical amount of sst's moved into "lost"
>> 
>> Worse, the files moved to "lost" have very very old creation times (in months).  The system has been restarted successfully many times in the interim, leading to more confusion.
>> 
>> I'm looking for pointers to get to the bottom of this.  It isn't critical thatI recover this data, but it is critical that I don't see this manifest when it does matter.
>> 
>> Before repair:
>> 
>> 40960   108441.log
>> 1       CURRENT
>> 0       LOCK
>> 3       LOG
>> 3       LOG.old
>> 92      MANIFEST-108439
>> 469     sst_0
>> 1       sst_1
>> 188185  sst_2
>> 4189331 sst_3
>> 6343660 sst_4
>> 1       sst_5
>> 1       sst_6
>> 
>> After repair:
>> 
>> 40960   108452.log
>> 1       CURRENT
>> 0       LOCK
>> 3       LOG
>> 3       LOG.old
>> 28      MANIFEST-108450
>> 8221971 lost
>> 2362    sst_0
>> 1       sst_1
>> 188185  sst_2
>> 2352071 sst_3
>> 1       sst_4
>> 1       sst_5
>> 1       sst_6
>> 
>> 
>> 
>> -- 
>> Theo Schlossnagle
>> 
>> http://omniti.com/is/theo-schlossnagle
>> 
>> _______________________________________________
>> riak-users mailing list
>> riak-users at lists.basho.com
>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
> 
> 
> 
> 
> -- 
> Theo Schlossnagle
> 
> http://omniti.com/is/theo-schlossnagle
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.basho.com/pipermail/riak-users_lists.basho.com/attachments/20140619/4b8842d5/attachment.html>


More information about the riak-users mailing list