Exception in thread “main“ java.lang.AbstractMethodError

迈不过友情╰ 2023-01-11 03:47 311阅读 0赞
  1. Exception in thread "main" java.lang.AbstractMethodError
  2. at org.apache.spark.internal.Logging$class.initializeLogIfNecessary(Logging.scala:99)
  3. at org.apache.spark.streaming.kafka010.KafkaUtils$.initializeLogIfNecessary(KafkaUtils.scala:40)
  4. at org.apache.spark.internal.Logging$class.log(Logging.scala:46)
  5. at org.apache.spark.streaming.kafka010.KafkaUtils$.log(KafkaUtils.scala:40)
  6. at org.apache.spark.internal.Logging$class.logWarning(Logging.scala:66)
  7. at org.apache.spark.streaming.kafka010.KafkaUtils$.logWarning(KafkaUtils.scala:40)
  8. at org.apache.spark.streaming.kafka010.KafkaUtils$.fixKafkaParams(KafkaUtils.scala:208)
  9. at org.apache.spark.streaming.kafka010.DirectKafkaInputDStream.<init>(DirectKafkaInputDStream.scala:66)
  10. at org.apache.spark.streaming.kafka010.KafkaUtils$.createDirectStream(KafkaUtils.scala:150)
  11. at org.apache.spark.streaming.kafka010.KafkaUtils$.createDirectStream(KafkaUtils.scala:127)
  12. at com.donglin.qzpoint.streaming.QzPointStreaming$.main(QzPointStreaming.scala:70)
  13. at com.donglin.qzpoint.streaming.QzPointStreaming.main(QzPointStreaming.scala)
  14. at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  15. at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  16. at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  17. at java.lang.reflect.Method.invoke(Method.java:498)
  18. at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
  19. at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
  20. at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
  21. at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
  22. at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
  23. at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
  24. at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
  25. at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

打包到集群上报错,发现是jar冲突问题,我在集群上spark是2.4.5
在这里插入图片描述
解决方案
改对应的版本,重新打包

  1. <dependency>
  2. <groupId>org.apache.spark</groupId>
  3. <artifactId>spark-streaming-kafka-0-10_2.11</artifactId>
  4. <version>2.4.5</version>
  5. </dependency>

发表评论

表情:
评论列表 (有 0 条评论,311人围观)

还没有评论,来说两句吧...

相关阅读