各位大牛，最近遇到這樣一個問題，我用sbt-assembly打包程式之后，提交spark-submit，顯示沒有找到我的組態檔。
錯誤資訊是這樣的：
Exception in thread "main" java.lang.ExceptionInInitializerError
at TopN.finnished1$.main(finnished1.scala:19)
at TopN.finnished1.main(finnished1.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.io.FileNotFoundException: paramater.properties (沒有那個檔案或目錄)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at java.io.FileInputStream.<init>(FileInputStream.java:93)
at Client.RedisClient$.<init>(RedisClient.scala:11)
at Client.RedisClient$.<clinit>(RedisClient.scala)
... 11 more
然后我的檔案的結構是
src
|-main
|-sources
|-paramater.properties
|-scala
|-client
|-TopN
然后在client的包中我有一個redis的客戶端，其中的代碼是：
object RedisClient {
val props = new Properties()
val in:InputStream = new BufferedInputStream(new FileInputStream("paramater.properties"))
props.load(in)
val redisHost = props.getProperty("redis.host")
val redisPort = props.getProperty("redis.port").toInt
val redisTimeout = props.getProperty("redis.timeOut").toInt
lazy val pool = new JedisPool(new JedisPoolConfig(), redisHost, redisPort, redisTimeout)
lazy val hook = new Thread {
override def run = {
println("Execute hook thread: " + this)
pool.destroy()
}
}
sys.addShutdownHook(hook.run)
}
請問，是我的代碼問題，還是打包的問題啊，怎么解決啊？？？
轉載請註明出處，本文鏈接：https://www.uj5u.com/qita/69057.html
標籤：Spark
上一篇：kubernetes相關的應用