yarn-size.xml如下：
<configuration>
<!-- Site specific YARN configuration properties -->
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.resourcemanager.hostname</name>
<value>slaver1</value>
</property>
<!-- 分配給NodeManager的可用物理記憶體空間 -->
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>1024</value>
</property>
<!-- 分配給NodeManager的cpu核數 -->
<property>
<name>yarn.nodemanager.resource.cpu-vcores</name>
<value>1</value>
</property>
<!-- 日志的聚集是否啟用 -->
<property>
<name>yarn.log-aggregation-enable</name>
<value>true</value>
</property>
<!-- 日志保存時限-->
<property>
<name>yarn.log-aggregation.retain-seconds</name>
<value>640800</value>
</property>
</configuration>
-----------------------------------------------------------------------------
core-size.xml如下
<configuration>
<!-- 配置hadoop是使用什么檔案系統 -->
<property>
<name>fs.defaultFS</name>
<value>hdfs://master:8020</value>
</property>
<!-- 配置hadoop運使的目錄 -->
<property>
<name>hadoop.tmp.dir</name>
<value>/opt/app/hadoop-2.5.0/tmp</value>
</property>
<!-- 配置hdfs洗掉檔案后最長保留時間(單位:分鐘) -->
<property>
<name>fs.trash.interval</name>
<value>10080</value>
</property>
</configuration>
-----------------------------------------------------------------------------
組態檔slaves如下：
slaver1
--------------------------------------
master機子hosts如下 ：
192.168.254.131 master
192.168.254.132 slaver1
slaver1機子hosts如下：
192.168.254.131 master
192.168.254.132 slaver1
例外：
2017-09-01 12:49:29,801 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioned to standby state
2017-09-01 12:49:29,801 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [slaver1:8031] java.net.BindException: Cannot assign requested address; For more details see
: http://wiki.apache.org/hadoop/BindException
at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:139)
at org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getServer(HadoopYarnProtoRPC.java:65)
at org.apache.hadoop.yarn.ipc.YarnRPC.getServer(YarnRPC.java:54)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceTrackerService.serviceStart(ResourceTrackerService.java:159)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceStart(ResourceManager.java:503)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.startActiveServices(ResourceManager.java:898)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:938)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$1.run(ResourceManager.java:935)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.transitionToActive(ResourceManager.java:935)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceStart(ResourceManager.java:979)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1104)
Caused by: java.net.BindException: Problem binding to [slaver1:8031] java.net.BindException: Cannot assign requested address; For more details see: http://wiki.apache.org/hadoop/BindExceptio
n
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:719)
at org.apache.hadoop.ipc.Server.bind(Server.java:419)
at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:561)
at org.apache.hadoop.ipc.Server.<init>(Server.java:2166)
at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:897)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:505)
at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:480)
at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:742)
at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.createServer(RpcServerFactoryPBImpl.java:169)
at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:132)
... 17 more
現狀：
hadoop版本：2.5.0
已經配置好了master->slaver1和slaver1->master的免密碼登陸
從master上啟sbin/start-all.sh
namenode能正常啟動
slaver1上的datanode能正常啟動
slaver1上的nodeManager能正常啟動
問題：
resourcemanager啟動到了master上（我配置的resourcemanager應該在slaver1上才對）
請那位仁兄能幫我看下，是不是我哪里配置出了問題，萬謝
uj5u.com熱心網友回復：
slaver1的iptables如下：# Firewall configuration written by system-config-firewall
# Manual customization of this file is not recommended.
*filter
:INPUT ACCEPT [0:0]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [0:0]
-A INPUT -m state --state ESTABLISHED,RELATED -j ACCEPT
-A INPUT -p icmp -j ACCEPT
-A INPUT -i lo -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 22 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 50070 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 8088 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 8031 -j ACCEPT
-A INPUT -j REJECT --reject-with icmp-host-prohibited
-A FORWARD -j REJECT --reject-with icmp-host-prohibited
COMMIT
~
~
uj5u.com熱心網友回復：
有沒有人啊，能不能幫忙看下，非常感謝uj5u.com熱心網友回復：
自已頂一下
uj5u.com熱心網友回復：
resourcemanager在那一臺機器上，你就在那臺機器上啟動start-yarn.shuj5u.com熱心網友回復：
這是個坑呀，我也踩到了，最后發現只能在配置resourcemanager機器上運行start-yarn.sh才能正常運行，難怪原來的start-all.sh被拆成了start-dfs.sh和start-yarn.sh
uj5u.com熱心網友回復：
我都忘了我在什么情況下遇見這個帖子，才回復這個帖子
uj5u.com熱心網友回復：
怎么看resourcemanager在哪一臺呢，如果偽分布一臺上又怎么看呢轉載請註明出處，本文鏈接：https://www.uj5u.com/qita/73542.html
標籤：分布式計算/Hadoop