對于這個專案,我需要添加ignite-spark的依賴,但是添加了下面這一行,而同步卻給出了錯誤資訊,模塊在ProjectRef中被解決了沖突的跨版本后綴,
。libraryDependencies = "org.apache.ignite" % "ignite-spark_2.10" % "2.3.0"
也試過
libraryDependencies = "org.apache.ignite" % "ignite-spark" % "2.3.0"
Scala版本:2.11.12 Spark:2.3.0 Ignite:2.10
build.sbt
name := "ScalaProjectDemo2.11.12"
版本 := "0.1"。
scalaVersion :="2.11.12"
libraryDependencies = "org.apache.spark" % "spark-sql" % "2.3.0" % " provided"
libraryDependencies = "org.apache.ignite"/span> % "ignite-spring"/span> % "2.10.0"/span>
libraryDependencies = "org.apache.ignite"/span> % "ignite-indexing"/span> % "2.10.0"/span>
libraryDependencies = "org.apache.ignite"/span> % "ignite-core"/span> % "2.10.0"/span>
libraryDependencies = "org.apache.spark"/span> % "spark-core"/span> % "2.3.0"/span>
libraryDependencies = "org.apache.ignite"/span> % "ignite-spark_2.10"/span> % "2.3.0"/span>
D:/Java/jdk1. 8.0_301/bin/java.exe -Djline.terminal=jline。 UnsupportedTerminal -Dsbt.log.noformat=true -Dfile。 encoding=UTF8 -Didea. managed=true -Dfile. encoding=UTF8 -jar C: /Users/admin/AppData/Roaming。 type">Roaming/JetBrains/IdeaIC2020. 1/plugins/Scala/launcher/sbt-launch.jar
[info] Loading global plugins from C:Usersadmin.sbt1.0plugins
[info] Loading專案定義來自C。 UsersadminIdeaProjectsScalaProjectDemo2。 11.12project
[資訊] Loading settings for project scalaprojectdemo21112 from build.sbt ...
[info] Set current project to ScalaProjectDemo2.11. 12 (in build file:/C:/Users/admin/IdeaProjects/ScalaProjectDemo2。 11.12/)
[info] sbt服務器在local:sbt-server-800963285a52579c1956啟動。
sbt:ScalaProjectDemo2.11.12>
[資訊] 定義 Global / sbtStructureOptions, Global / sbtStructureOutputFile 和 1 其他。
[資訊] The new值將被cleanKeepGlobs使用。
[info] Run `last` for details.
[資訊] 重新應用設定...。
[info] Set current project to ScalaProjectDemo2.11。 12 (in build file:/C:/Users/admin/IdeaProjects/ScalaProjectDemo2。 11.12/)
[info] Applying State transformations org.jetbrains.sbt. CreateTasks來自C。 /Users/admin/AppData/Roaming。 type">Roaming/JetBrains/IdeaIC2020. 1/plugins/Scala/repo/org.jetbrains/sbt-structure-extractor/scala_2.12sbt_1. 0/2018.2.1 4-88400d3f/jars/sbt-structure-extractor.jar
[info] Reapplying settings...
[info] Set current project to ScalaProjectDemo2.11. 12 (in build file:/C:/Users/admin/IdeaProjects/ScalaProjectDemo2。 11.12/)
[警告] There may be incompatibilities among your library dependencies; run 'evicted' to see detailed eviction warnings.
[錯誤] Modules在ProjectRef(uri("file:/C:/Users/admin/IdeaProjects/ScalaProjectDemo2. 11.12/"),"scalaprojectdemo2-11-12")。)
[錯誤] org.apache.spark:spark-launcher _2.10, _2.11。
[錯誤] org.apache.spark:spark-sketch _2.10, _2.11。
[錯誤] org.json4s:json4s-ast _2.10, _2.11。
[錯誤] org.apache.spark:spark-catalyst _2.10, _2.11。
[錯誤] org.apache.spark:spark-network-shuffle _2.10, _2.11。
[錯誤] com.twitter:chill _2.10, _2.11。
[錯誤] org.apache.spark:spark-sql _2.11, _2.10。
[錯誤] org.json4s:json4s-jackson _2.11, _2.10。
[錯誤] com.fasterxml.jackson.module:jackson-module-scala _2.10, _2.11。
[錯誤] org.json4s:json4s-core _2.10, _2.11。
[錯誤] org.apache.spark:spark-unsafe _2.11, _2.10
[錯誤] org.apache.spark:spark-tags _2.11, _2.10
[錯誤] org.apache.spark:spark-core _2.10, _2.11。
[錯誤] org.apache.spark:spark-network-common _2.10, _2.11。
[error] 堆疊跟蹤被抑制;運行'last update' for the full output
[error] 堆疊跟蹤被抑制;運行'last ssExtractDependencies' for 完整輸出
[error] (update) Conflicting cross-version suffixes in: org.apache.spark:spark-launcher, org.apache.spark:spark-sketch, org.json4s:json4s-ast, org.apache.spark:spark-catalyst, org.apache.spark:spark-network-shuffle, com.twitter:chill, org. apache.spark:spark-sql, org.json4s:json4s-jackson, com.fasterxml.jackson.module:jackson-module-scala, org.json4s:json4s-core, org.apache.spark:spark-unsafe, org.apache.spark:spark-tags, org.apache.spark:spark-core, org.apache.spark:spark-network-common
[error] (ssExtractDependencies) Conflicting cross-version suffixes in: org.apache.spark:spark-launcher, org.apache.spark:spark-sketch, org.json4s:json4s-ast, org.apache.spark:spark-catalyst, org.apache.spark:spark-network-shuffle, com. twitter:chill, org.apache.spark:spark-sql, org.json4s:json4s-jackson, com.fasterxml.jackson.module:jackson-module-scala, org.json4s:json4s-core, org.apache.spark:spark-unafe, org.apache.spark:spark-tags, org.apache.spark:spark-core, org.apache.spark:spark-network-common
[錯誤] Total time: 9s, completed Sep 18, 2021 6: 11: 55 AM
[info] 關閉sbt服務器
請提供您的建議。
預先感謝。
uj5u.com熱心網友回復:
我們可以看到,ignite-spark的2.3.0只支持Scala2.10(因此也依賴于舊版本的Spark)。
你可能想至少升級到2.7.6,它(僅)支持Scala 2.11,并且基于Spark 2.3;這與你之前使用的版本相同。
轉載請註明出處,本文鏈接:https://www.uj5u.com/qukuanlian/320489.html
標籤:
