CODEWITHSUNDEEP
filesystemsdistributed
hiro
hiro

Reputation: 271

Network file systems to store static images/files

I think the problem is quite common: you have a website where people can upload images/files onto it, which could be thousands everyday. So what is the best network file system (distributed file system) that could handle the problem, especially the scalability. Specially,

  1. It must be well distributed over different nodes. Nodes aren't needed much of fault-recovery.
  2. Mostly read and write, no update.
  3. There're some simple Client libraries for write/read.

I've studied the Hadoop file system and it seems that it's not the good way as it's about managing big files for Map-Reduce, not for millions of small files.

Thank you!

Upvotes: 3

Views: 209

Answers (2)

Gyürüs Máté
Gyürüs Máté

Reputation: 44

I think MogileFs would be the good choice for you. But it has redundancy if you set it.

https://github.com/mogilefs/

Upvotes: 0

Mairbek Khadikov
Mairbek Khadikov

Reputation: 8099

Look at your requirements:

  • One image should be stored on a one node. Otherwise, if it is partitioned, image response latency could drop down dramatically
  • Fault tolerance is not the case

Why would you go with a distributed file system in this situation?

Upvotes: 1

Related Questions