Hadoop DataNode不会使用远程IPC服务器地址(Hadoop DataNode won't use remote IPC Server adress)

 对于“快速”概念验证，我想通过连接两个虚拟机来建立一个迷你Hadoop 0.18集群，我发现这些虚拟机是在Yahoo的伪分布式模式下配置的。 
 
 在我的hadoop-vm-1上，我在该机器上启动了一个带有主节点和从属DataNode和TaskTracker的完整集群。 然后我将第二个VM作为hadoop-vm-2，并希望它托管第二个DataNode和TaskTracker，它将连接到hadoop-vm-1并添加到该集群。 
 
 不幸的是，我无法启动第二个DataNode，因为它想要连接到本地IPC服务器。 这是我希望它连接到hadoop-vm-1的地方 。 日志写如下： 
 
 
 
 2013-02-07 19：55：29,954 INFO org.apache.hadoop.ipc.Client：重试连接到服务器：/192.168.17.135:9000。 已经尝试了9次。 
 2013-02-07 19：55：29,958 ERROR org.apache.hadoop.dfs.DataNode：java.io.IOException：本地异常调用失败 
 .. 
 引起：java.net.ConnectException：连接被拒绝 
 
 
 而不是IP 192.168.17.135（ hadoop-vm-2 ），应该使用hadoop-vm-1的 192.168.17.134。 
 
 我想我正确配置了slave的hadoop-site.xxml： 
 
<configuration>
<property>
  <name>fs.default.name</name>
  <value>hdfs://hadoop-vm-1/</value>
  <description>The name of the default file system.  A URI whose
  scheme and authority determine the FileSystem implementation.  The
  uri's scheme determines the config property (fs.SCHEME.impl) naming
  the FileSystem implementation class.  The uri's authority is used to
  determine the host, port, etc. for a filesystem.</description>
</property>

<property>
  <name>mapred.job.tracker</name>
  <value>hadoop-vm-1:9001</value>
  <description>The host and port that the MapReduce job tracker runs
  at.  If "local", then jobs are run in-process as a single map
  and reduce task.
  </description>
</property>

</configuration>
 
 当然我配置了hosts文件： 
 
127.0.0.1   localhost
127.0.1.1   hadoop-vm-2.localdomain hadoop-vm-2
192.168.17.134 hadoop-vm-1
 
 有任何想法吗？ 提前致谢 ：-） 

For a "fast" Proof-of-concept I wanted to set up a mini Hadoop 0.18 cluster, by connecting two virtual machines, which I found configured in pseudo-distributed mode at Yahoo.
 
On my hadoop-vm-1 I start a full cluster with master nodes and slave DataNode and TaskTracker on that machine. Then I took the second VM as hadoop-vm-2 and wanted it to host a 2nd DataNode and TaskTracker which would connect to hadoop-vm-1 and add to this cluster.
 
Unfortunately, I can't start the 2nd DataNode, because it want's to connect to a local IPC server. This is the place where I would expect it to connect to hadoop-vm-1. The log writes as follows:
 
 
 
2013-02-07 19:55:29,954 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: /192.168.17.135:9000. Already tried 9 time(s).
 2013-02-07 19:55:29,958 ERROR org.apache.hadoop.dfs.DataNode: java.io.IOException: Call failed on local exception
 ..
 Caused by: java.net.ConnectException: Connection refused
 
 
Instead of the IP 192.168.17.135 (which is hadoop-vm-2), 192.168.17.134 from hadoop-vm-1 should have been used.
 
I think I configured the slave's hadoop-site.xxml correctly:
 
<configuration>
<property>
  <name>fs.default.name</name>
  <value>hdfs://hadoop-vm-1/</value>
  <description>The name of the default file system.  A URI whose
  scheme and authority determine the FileSystem implementation.  The
  uri's scheme determines the config property (fs.SCHEME.impl) naming
  the FileSystem implementation class.  The uri's authority is used to
  determine the host, port, etc. for a filesystem.</description>
</property>

<property>
  <name>mapred.job.tracker</name>
  <value>hadoop-vm-1:9001</value>
  <description>The host and port that the MapReduce job tracker runs
  at.  If "local", then jobs are run in-process as a single map
  and reduce task.
  </description>
</property>

</configuration>
 
And of course I configured the hosts file:
 
127.0.0.1   localhost
127.0.1.1   hadoop-vm-2.localdomain hadoop-vm-2
192.168.17.134 hadoop-vm-1
 
Any Ideas? thanks in advance :-)

原文：https://stackoverflow.com/questions/14771256