Spark - spark error Mark 待解决

红太狼 2022-03-02 09:44 359阅读 0赞

spark运行时，在 driver 处抛出异常，不知道什么原因

不能确定是不是网络问题

  1. 2019/03/19 18:04:54.114 INFO  Driver commanded a shutdown
  2. 2019/03/19 18:04:54.126 ERROR Still have 1 requests outstanding when connection from r-hdsl01/192.168.1.3:45910 is closed
  3. 2019/03/19 18:04:54.127 ERROR Failed while starting block fetches
  4. java.io.IOException: Connection from r-XXXXXX/192.168.1.3:45910 closed
  5.     at org.apache.spark.network.client.TransportResponseHandler.channelInactive(TransportResponseHandler.java:146) [spark-network-common_2.11-2.4.0.jar:2.4.0]
  6.     at org.apache.spark.network.server.TransportChannelHandler.channelInactive(TransportChannelHandler.java:108) [spark-network-common_2.11-2.4.0.jar:2.4.0]
  7.     at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  8.     at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  9.     at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  10.     at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  11.     at io.netty.handler.timeout.IdleStateHandler.channelInactive(IdleStateHandler.java:277) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  12.     at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  13.     at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  14.     at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  15.     at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  16.     at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  17.     at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  18.     at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  19.     at io.netty.channel.ChannelInboundHandlerAdapter.channelInactive(ChannelInboundHandlerAdapter.java:75) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  20.     at org.apache.spark.network.util.TransportFrameDecoder.channelInactive(TransportFrameDecoder.java:182) [spark-network-common_2.11-2.4.0.jar:2.4.0]
  21.     at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  22.     at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  23.     at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:224) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  24.     at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1354) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  25.     at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:245) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  26.     at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:231) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  27.     at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:917) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  28.     at io.netty.channel.AbstractChannel$AbstractUnsafe$8.run(AbstractChannel.java:822) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  29.     at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  30.     at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:403) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  31.     at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:463) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  32.     at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  33.     at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138) [netty-all-4.1.17.Final.jar:4.1.17.Final]
  34.     at java.lang.Thread.run(Thread.java:745) [?:1.8.0_102]

发表评论

表情：
评论列表 （有 0 条评论，359人围观）

还没有评论，来说两句吧...

相关阅读