Hadoop,hive執行sql 報如下錯誤:
Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask (state=08S01,code=2)
然后看yarn的日志發現是:找不到或無法加載主類 org.apache.hadoop.mapreduce.v2.app.MRAppMaster
解決方法:
在yarn-site.xml和mapred-site.xml中添加如下依賴
<property>
<name>yarn.application.classpath</name>
<value>/usr/etc/hadoop-3.2.2/etc/hadoop:/usr/etc/hadoop-3.2.2/share/hadoop/common/lib/*:/usr/etc/hadoop-3.2.2/share/hadoop/common/*:/usr/etc/hadoop-3.2.2/share/hadoop/hdfs:/usr/etc/hadoop-3.2.2/share/hadoop/hdfs/lib/*:/usr/etc/hadoop-3.2.2/share/hadoop/hdfs/*:/usr/etc/hadoop-3.2.2/share/hadoop/mapreduce/lib/*:/usr/etc/hadoop-3.2.2/share/hadoop/mapreduce/*:/usr/etc/hadoop-3.2.2/share/hadoop/yarn:/usr/etc/hadoop-3.2.2/share/hadoop/yarn/lib/*:/usr/etc/hadoop-3.2.2/share/hadoop/yarn/*</value>
</property>
路徑在shell命令列執行 hadoop classpath
[root@linux01 hadoop]# hadoop classpath
/usr/etc/hadoop-3.2.2/etc/hadoop:/usr/etc/hadoop-3.2.2/share/hadoop/common/lib/*:/usr/etc/hadoop-3.2.2/share/hadoop/common/*:/usr/etc/hadoop-3.2.2/share/hadoop/hdfs:/usr/etc/hadoop-3.2.2/share/hadoop/hdfs/lib/*:/usr/etc/hadoop-3.2.2/share/hadoop/hdfs/*:/usr/etc/hadoop-3.2.2/share/hadoop/mapreduce/lib/*:/usr/etc/hadoop-3.2.2/share/hadoop/mapreduce/*:/usr/etc/hadoop-3.2.2/share/hadoop/yarn:/usr/etc/hadoop-3.2.2/share/hadoop/yarn/lib/*:/usr/etc/hadoop-3.2.2/share/hadoop/yarn/*
[root@linux01 hadoop]#
組態檔記得分發到不同的機器上,然后就可以了,樓主親測
轉載請註明出處,本文鏈接:https://www.uj5u.com/qita/264459.html
標籤:其他
上一篇:kafka學習梳理
下一篇:產品分析————拼多多
