Namenodes不使用具有HDFS Federation的完全分布式hadoop集群中的所有datanode(Namenodes don't use all datanodes in a fully distributed hadoop cluster with HDFS Federation)

 实际上，作为最终项目分配工作的大数据项目，我一直在寻找在完全分布式集群上运行HDFS联合的意思。 
 
 我的群集的规格是： 
 
 
 
 Hadoop 2.7.2 
 
 
 JDK 1.8.74 
 
 
 OS系统是CentOS 6.7 
 
 
 2个名称节点（Namenode1和Namenode2） 
 
 
 2个数据节点（Datanode1和Datanode2） 
 
 
 1个客户端（为ViewFS安装表配置） 
 
 
 使用一个namenode，集群（1个namenode + 2个datanode）工作正常，所有配置看起来都是正确的。 
 
 我找不到那么多教程解释如何完全配置HDFS联合（用于运行两个共享所有数据节点的名称节点），甚至在Apache Hadoop的官方文档中也没有。 我使用的是以下完全分布式Hadoop联合群集 
 
 
 我有效运行HDFS联合的尝试失败了，即使dfs守护程序已成功启动，所有名称节点都不使用数据节点。 
 
 实际情况 ： 
 
 当我启动dfs服务（使用start-dfs.sh ）时，Namednode1使用所有数据节点，Namenode2使用none。 或者每个namenode只使用一个唯一的datanode（ Namenode1使用Datanode1，Namenode2使用Datanode2 ）。 
 
 数据节点的使用似乎是随机的，但它们永远不会同时被两个名字节点使用（我的目标） 
 
 如果有人知道如何使用多个名称节点运行HDFS联合，欢迎您帮助= P谢谢。 

Actually working on a Big Data project as a final project assignement, I'v been looking for a mean to run HDFS Federation on a fully distributed cluster.
 
The specifications of my cluster are :
 
 
 
Hadoop 2.7.2
 
 
JDK 1.8.74
 
 
The OS system is CentOS 6.7
 
 
2 namenodes (Namenode1 and Namenode2)
 
 
2 datanodes (Datanode1 and Datanode2)
 
 
1 Client (configured for ViewFS mount table)
 
 
With one namenode, the cluster (1 namenode + 2 datanodes) works fine, all the configurations seem correct.
 
I couldn't find that many tutorials explaning how to fully configure the HDFS Federation (for running two namenodes that share all the datanodes) not even in the official documentation of Apache Hadoop. The one I used is the following Fully Distributed Hadoop Federation Cluster
 
 
My attempts to run effectively the HDFS Federation have failed, even if the dfs daemons have successfully launched, the datanodes are not used by all the namenodes. 
 
Actual situation :
 
When I start the dfs services (with start-dfs.sh), the Namednode1 use all the datanodes and the Namenode2 use none. Or each namenode use only one unique datanode (Namenode1 uses Datanode1 and Namenode2 uses Datanode2).
 
The datanodes usage seems random but they are never all used by the two namenodes at the same time (my objective)
 
If anyone knows how to run the HDFS Federation with several namenodes, you're welcome to help =P Thank you.

原文：https://stackoverflow.com/questions/36158232