17/02/17 09:04:50 ERROR ShutdownHookManager: Exception while deleting Spark temp dir: C:\U
sers\tend\AppData\Local\Temp\spark-70484fc4-167d-48fa-a8f6-54db9752402e\userFiles-27a65cc7
-817f-4476-a2a2-58967d7b6cc1
java.io.IOException: Failed to delete: C:\Users\tend\AppData\Local\Temp\spark-70484fc4-167
d-48fa-a8f6-54db9752402e\userFiles-27a65cc7-817f-4476-a2a2-58967d7b6cc1
at org.apache.spark.util.Utils$.deleteRecursively(Utils.scala:1010)
at org.apache.spark.util.ShutdownHookManager$$anonfun$1$$anonfun$apply$mcV$sp$3.ap
ply(ShutdownHookManager.scala:65)
at org.apache.spark.util.ShutdownHookManager$$anonfun$1$$anonfun$apply$mcV$sp$3.ap
ply(ShutdownHookManager.scala:62)
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33
)
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)
at org.apache.spark.util.ShutdownHookManager$$anonfun$1.apply$mcV$sp(ShutdownHookM
anager.scala:62)
at org.apache.spark.util.SparkShutdownHook.run(ShutdownHookManager.scala:216)
at org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply
$mcV$sp$1.apply$mcV$sp(ShutdownHookManager.scala:188)
at org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply
$mcV$sp$1.apply(ShutdownHookManager.scala:188)
at org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply
$mcV$sp$1.apply(ShutdownHookManager.scala:188)
at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1951)
at org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply$mcV$sp(S
hutdownHookManager.scala:188)
at org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply(Shutdown
HookManager.scala:188)
at org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply(Shutdown
HookManager.scala:188)
at scala.util.Try$.apply(Try.scala:192)
at org.apache.spark.util.SparkShutdownHookManager.runAll(ShutdownHookManager.scala
:188)
at org.apache.spark.util.SparkShutdownHookManager$$anon$2.run(ShutdownHookManager.
scala:178)
at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
uj5u.com熱心網友回復：
目前spark在windows系統下存在這個問題。不想看的話，就把log4j.properties中log的level設定為FATAL吧。uj5u.com熱心網友回復：
樓主是否解決了這個問題？uj5u.com熱心網友回復：
這個是無法避免的。uj5u.com熱心網友回復：
根據地址看了下，的確沒有洗掉，需要人工手動洗掉。。。uj5u.com熱心網友回復：
你可以嘗試一下把獲取到的資料線cache().uj5u.com熱心網友回復：
必須支持了啊轉載請註明出處，本文鏈接：https://www.uj5u.com/qita/47557.html
標籤：Spark
下一篇：vmwareHA和EVC的問題