What are the pros and cons for using HDFS vs. Gluster (especially for Hadoop)?
-
We're planning a medium-size farm for Hadoop tools.
-
Answer:
HDFS is (of course) the filesystem that's co-developed with the rest of the Hadoop ecosystem, so it's the one that other Hadoop developers are familiar with and tune for. It's also optimized for workloads that are typical in Hadoop. GlusterFS is a general-purpose distributed filesystem. If you want to be able to access data both within and outside of Hadoop, without having to manually migrate data in or out of the Hadoop universe, then that's an advantage. GlusterFS is also fully/properly distributed, so it doesn't have a single point of failure like the HDFS NameNode. The biggest disadvantage to using GlusterFS with Hadoop currently is that Hadoop works best when it can locate jobs near data. This functionality is fully implemented and regularly used with HDFS. The same functionality (allowing map/reduce to query storage about locations for specific data) has been implemented for GlusterFS as well, but won't appear until 3.3 and requires some very minor configuration before map/reduce can use it.
Jeff Darcy at Quora Visit the source
Other answers
The other problem is the integration between HBase and HDFS .... , but GlusterFS is a very interesting preperly distributed Filesystem, with NFS capabilities. On the other hand, what do you think of the MapR Hadoop integration, with NFS capabilities, and the newest EMC² announcement with Isilon Hadoop connector ? Is it use fuse DFS ? http://chucksblog.emc.com/chucks_blog/2012/01/hdfs-coming-to-an-array-near-you.html
François Dessables
Related Q & A:
- What are the pros and cons of donating blood?Best solution by Quora
- What are the pros and cons of xenotransplantation?Best solution by Yahoo! Answers
- What are the pros and cons of pre-paid debit cards?Best solution by Yahoo! Answers
- What are the Pros and Cons of being against Mercury Pollution?Best solution by Yahoo! Answers
- What are the pros and cons of buying a house using an FHA loan?Best solution by Personal Finance and Money
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.