spark用yarn提交任務會報
ERROR cluster.YarnClientSchedulerBackend: YARN application has exited unexpectedly with state UNDEFINED! Check the YARN application logs for more details.
ERROR cluster.YarnClientSchedulerBackend: Diagnostics message: Shutdown hook called before final status was reported.
只需要將hadoop集群的yarn-site.xml配置中加入如下兩行即可解決：
<property>
<name>yarn.nodemanager.pmem-check-enabled</name>
<value>false</value>
</property>
<property>
<name>yarn.nodemanager.vmem-check-enabled</name>
<value>false</value>
</property>
如果你用的java8，則多會報此錯誤，
轉載請註明出處，本文鏈接：https://www.uj5u.com/shujuku/44446.html
標籤：大數據