Why do Hadoop have different communication mechanisms for inter-datanode and datanode-namenode communication?
-
The datanode-namenode communication uses the org.apache.hadoop.ipc package; while the inter-datanode communication is based on simple socket communication. What is the motivation behind such design?
-
Answer:
I suspect the answer is relatively simplistic: the only purpose of the inter-datanode communication is (ultimately) to push blocks around for replication purposes, whereas the namenode/datanode protocol requires a lot more nuanced information to go through that pipe.
Allen Wittenauer at Quora Visit the source
Other answers
Timeout limit for a single RPC is the reason that any data communicating with datanode is not done with RPC.
Milind Bhandarkar
Related Q & A:
- What are the different parts of Hadoop?Best solution by sas.com
- Why do I keep getting communication error in chat?Best solution by Yahoo! Answers
- Why do different people like different flavors?Best solution by Yahoo! Answers
- Why do I sound different on video camera or phone?Best solution by Yahoo! Answers
- Why do we have different colored eyes?Best solution by ChaCha
Just Added Q & A:
- How many active mobile subscribers are there in China?Best solution by Quora
- How to find the right vacation?Best solution by bookit.com
- How To Make Your Own Primer?Best solution by thekrazycouponlady.com
- How do you get the domain & range?Best solution by ChaCha
- How do you open pop up blockers?Best solution by Yahoo! Answers
For every problem there is a solution! Proved by Solucija.
-
Got an issue and looking for advice?
-
Ask Solucija to search every corner of the Web for help.
-
Get workable solutions and helpful tips in a moment.
Just ask Solucija about an issue you face and immediately get a list of ready solutions, answers and tips from other Internet users. We always provide the most suitable and complete answer to your question at the top, along with a few good alternatives below.