問題:安裝了SPARK1.5.1,但就是啟動報錯,請大家幫忙指導下。
報錯資訊:
[root@Master sbin]# ./start-all.sh
starting org.apache.spark.deploy.master.Master, logging to /usr/local/spark/spark-1.5.1-bin-hadoop2.6/sbin/../logs/spark-root-org.apache.spark.deploy.master.Master-1-Master.Hadoop.out
failed to launch org.apache.spark.deploy.master.Master:
/usr/local/spark/spark-1.5.1-bin-hadoop2.6/sbin/../bin/spark-class: line 78: cygpath: command not found
錯誤: 找不到或無法加載主類 org.apache.spark.deploy.master.Master
full log in /usr/local/spark/spark-1.5.1-bin-hadoop2.6/sbin/../logs/spark-root-org.apache.spark.deploy.master.Master-1-Master.Hadoop.out
Slave2.Hadoop: starting org.apache.spark.deploy.worker.Worker, logging to /usr/local/spark/spark-1.5.1-bin-hadoop2.6/sbin/../logs/spark-root-org.apache.spark.deploy.worker.Worker-1-Slave2.Hadoop.out
Master.Hadoop: starting org.apache.spark.deploy.worker.Worker, logging to /usr/local/spark/spark-1.5.1-bin-hadoop2.6/sbin/../logs/spark-root-org.apache.spark.deploy.worker.Worker-1-Master.Hadoop.out
Slave1.Hadoop: starting org.apache.spark.deploy.worker.Worker, logging to /usr/local/spark/spark-1.5.1-bin-hadoop2.6/sbin/../logs/spark-root-org.apache.spark.deploy.worker.Worker-1-Slave1.Hadoop.out
Slave2.Hadoop: failed to launch org.apache.spark.deploy.worker.Worker:
Slave2.Hadoop: 錯誤: 找不到或無法加載主類 org.apache.spark.launcher.Main
Slave2.Hadoop: full log in /usr/local/spark/spark-1.5.1-bin-hadoop2.6/sbin/../logs/spark-root-org.apache.spark.deploy.worker.Worker-1-Slave2.Hadoop.out
Master.Hadoop: failed to launch org.apache.spark.deploy.worker.Worker:
Master.Hadoop: /usr/local/spark/spark-1.5.1-bin-hadoop2.6/sbin/../bin/spark-class: line 78: cygpath: command not found
Master.Hadoop: 錯誤: 找不到或無法加載主類 org.apache.spark.deploy.worker.Worker
Master.Hadoop: full log in /usr/local/spark/spark-1.5.1-bin-hadoop2.6/sbin/../logs/spark-root-org.apache.spark.deploy.worker.Worker-1-Master.Hadoop.out
Slave1.Hadoop: failed to launch org.apache.spark.deploy.worker.Worker:
Slave1.Hadoop: 錯誤: 找不到或無法加載主類 org.apache.spark.launcher.Main
Slave1.Hadoop: full log in /usr/local/spark/spark-1.5.1-bin-hadoop2.6/sbin/../logs/spark-root-org.apache.spark.deploy.worker.Worker-1-Slave1.Hadoop.out
環境:
export JAVA_HOME=/usr/jdk1.7.0_05
export JRE_HOME=$JAVA_HOME/jre
export CLASSPATH=$JAVA_HOME/lib:$JRE_HOME/lib:$CLASSPATH
export JAVA_OPTS="-Xms512M -Xmx1024M"
export CATALINA_OPTS="-Djava.awt.headless=true"
HADOOP_HOME=/opt/spark/hadoop-2.7.1
SCALA_HOME=/usr/local/scala/scala-2.11.7
SPARK_HOME=/usr/local/spark/spark-1.5.1-bin-hadoop2.6
export PATH=$JAVA_HOME/bin:$JRE_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$SCALA_HOME/bin:$SPARK_HOME/bin:$PATH
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"
uj5u.com熱心網友回復:
請問解決了沒?我一出現這個問題,求指導uj5u.com熱心網友回復:
failed to launch org.apache.spark.deploy.master.Master:你這是master就沒起來,所以后面的都有問題了uj5u.com熱心網友回復:
CLASS_PATH 里面,增加下spark的jar包路徑 試試uj5u.com熱心網友回復:
/想問一下樓主,這個問題解決來么?怎么解決的?麻煩來uj5u.com熱心網友回復:
SPARK_HOME/sbin加入PATH路徑轉載請註明出處,本文鏈接:https://www.uj5u.com/qita/80946.html
標籤:Spark
下一篇:spark 呼叫hbase出現Cannot create a record reader because of a previous error
