How many TB to be store in riak

Mark Phillips mark at basho.com
Thu Mar 1 12:48:20 EST 2012


2012/2/26 郎咸武 <langxianzhe at 163.com>:
> Hi Mark,firsrt thanks
> If  i usring file.erl r/w that big file, to store disk with zfs (Dynamic
> File System).
> How about this.

Hmm. To be honest, I'm not sure if that would work, though I'm
inclined to say no.

Mark


> thank you
>
> jason
>
>
>
> 在2012-02-24,"Mark Phillips" <mark at basho.com> 写道:
>
> -----原始邮件-----
> 发件人:"Mark Phillips" <mark at basho.com>
> 发送时间:2012年2月24日 星期五
>
> 收件人:"郎咸武" <langxianzhe at 163.com>
> 抄送:"riak-users at lists.basho.com" <riak-users at lists.basho.com>
> 主题:Re: How many TB to be store in riak
>
> Hi Jason,
>
> Random reads in LevelDB won't be an issue. It's also worth noting that the
> bitcask backend will do at most one disk seek per read but this comes in
> exchange for keeping you key directory in RAM. I still think Level is the
> way to go for you.
>
> The 50MB file size will probably be an issue. We don't usually recommend
> anything over 20MB at this point, and even that might be problematic.
>
> Mark
>
>
>
> 2012/2/21 郎咸武<langxianzhe at 163.com>
>>
>> Hi mark,
>>  hmm you are right, I only have  about 30TBs at present.
>>  may be individual is 50MB.
>>  There is a new requirement:
>>        Random read any file. Is it work well?
>>  Thanks again.
>>  Jason
>>
>>
>> 在2012-02-22,"Mark Phillips" <mark at basho.com> 写道:
>>
>> -----原始邮件-----
>> 发件人:"Mark Phillips" <mark at basho.com>
>> 发送时间:2012年2月22日 星期三
>> 收件人:"郎咸武" <langxianzhe at 163.com>
>> 抄送:"riak-users at lists.basho.com" <riak-users at lists.basho.com>
>> 主题:Re: How many TB to be store in riak
>>
>>
>> On second thought, let's assume you have 100TBs worth of photos. (I'm sure
>> there are a few individual photos somewhere on the internet that come it at
>> 100TBs but I'm betting you don't have them).
>>
>> Riak should work well for this.
>>
>> * I'm assuming you'll have a lot of keys, so the LevelDB backend is
>> probably going to be best for local storage. We are also shipping LevelDB
>> with Snappy compression enabled as of 1.1, so this will help with the disk
>> storage requirements.
>> * Try to keep your file size under 20MB if possible.
>> * Keep in mind that 100TB with a default of 3 for a replication will yield
>> 300TB of raw data.
>>
>> Feel free to fire more questions as they come to mind.
>>
>> Hope that helps.
>>
>> Mark
>>
>>
>>
>> On Tue, Feb 21, 2012 at 3:59 PM, Mark Phillips<mark at basho.com>wrote:
>>>
>>> Hi Jason,
>>>
>>> I just want to make sure I understand your question correctly:
>>>
>>> Do you have 100TBs of photos you are thinking of storing in Riak? Or one
>>> photo that's 100TB?
>>>
>>> Mark
>>>
>>> 2012/2/21 郎咸武<langxianzhe at 163.com>
>>>>
>>>>
>>>> Hi all,
>>>> How many TB to be store in riak?
>>>> Now i have  about100TB picture. I want to store with riak. But i am not
>>>> sure that is ok.
>>>>  Answer me, please.
>>>> Thanks.
>>>> jason
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> riak-users mailing list
>>>> riak-users at lists.basho.com
>>>> http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
>>>>
>>>
>>
>>
>>
>
>
>




More information about the riak-users mailing list