新手剛剛自學spark，遇到一個棘手的問題，在linux系統上用命令提交沒什么問題，但是在springboot框架里面提交spark任務總是報錯，調了好久都沒解決， spark 1.6.2 scala 2.10.5，請大神指教
2018-07-12 18:09:11.031 WARN 12076 --- [nio-8080-exec-1] o.a.s.deploy.rest.RestSubmissionClient : Unable to connect to server spark://192.168.1.229:7077.
2018-07-12 18:09:11.223 WARN 12076 --- [nio-8080-exec-1] org.apache.hadoop.util.NativeCodeLoader : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2018-07-12 18:09:11.267 INFO 12076 --- [nio-8080-exec-1] org.apache.spark.SecurityManager : Changing view acls to: cp110
2018-07-12 18:09:11.268 INFO 12076 --- [nio-8080-exec-1] org.apache.spark.SecurityManager : Changing modify acls to: cp110
2018-07-12 18:09:11.268 INFO 12076 --- [nio-8080-exec-1] org.apache.spark.SecurityManager : SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(cp110); users with modify permissions: Set(cp110)
2018-07-12 18:09:11.931 INFO 12076 --- [nio-8080-exec-1] org.apache.spark.util.Utils : Successfully started service 'driverClient' on port 62815.
2018-07-12 18:09:12.015 ERROR 12076 --- [huffle-client-0] o.a.s.network.client.TransportClient : Failed to send RPC 7209509134568250263 to /192.168.1.229:7077: java.lang.AbstractMethodError: org.apache.spark.network.protocol.MessageWithHeader.touch(Ljava/lang/Object;)Lio/netty/util/ReferenceCounted;
java.lang.AbstractMethodError: org.apache.spark.network.protocol.MessageWithHeader.touch(Ljava/lang/Object;)Lio/netty/util/ReferenceCounted;
at io.netty.util.ReferenceCountUtil.touch(ReferenceCountUtil.java:77) ~[netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.channel.DefaultChannelPipeline.touch(DefaultChannelPipeline.java:116) ~[netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:810) [netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:723) [netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.handler.codec.MessageToMessageEncoder.write(MessageToMessageEncoder.java:111) ~[netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeWrite0(AbstractChannelHandlerContext.java:738) [netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeWrite(AbstractChannelHandlerContext.java:730) [netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:816) [netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:723) [netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.handler.timeout.IdleStateHandler.write(IdleStateHandler.java:302) [netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeWrite0(AbstractChannelHandlerContext.java:738) [netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeWrite(AbstractChannelHandlerContext.java:730) [netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.channel.AbstractChannelHandlerContext.access$1900(AbstractChannelHandlerContext.java:38) [netty-all-4.1.25.Final.jar:4.1.25.Final]
at io.netty.channel.AbstractChannelHandlerContext$AbstractWriteTask.write(AbstractChannelHandlerContext.java:1081) [netty-all-4.1.25.Final.jar:4.1.25.Final]
轉載請註明出處，本文鏈接：https://www.uj5u.com/qita/50625.html
標籤：Spark