radhakrishnan.mohan at gmail.com
Sat Jul 12 00:12:07 EDT 2014
I thought the general idea floating in my ignorant mind can help. We have
other storage systems apart from S3 like FTPS, HTTPS etc. I thought the
task of crawling remote storage systems and processing files naturally lent
itself to distributed MR jobs and a DFS.
That is when I came across Riak CS.
On Sat, Jul 12, 2014 at 9:32 AM, Mohan Radhakrishnan <
radhakrishnan.mohan at gmail.com> wrote:
> I came across the storage system discussion thread. We have a
> requirement to download thousands of files from S3 for processing. Ours is
> not a cloud storage system but a cloud access system.
> Are there qualities of Riak CS that can help us ? We want to download
> part of a huge file and checkpoint if the connection breaks. File downloads
> should be fault-tolerant when nodes go down.
> Please bear with me if my question is basic. I don't work with distributed
> cloud storage systems.
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the riak-users