flink getExecutionPlan 执行计划可视化

以你之姓@ 2022-02-04 00:57 222阅读 0赞

Flink 内置了一个执行计划的可是化工具。[http://flink.apache.org/visualizer/index.html][http_flink.apache.org_visualizer_index.html]

代码示例

object MyApp extends App {
    
    
      private val env = StreamExecutionEnvironment.getExecutionEnvironment
    
      env.setParallelism(1)
    
      private val streamPageEvent: DataStream[String] = env.socketTextStream("localhost", 9001)
      private val streamMobileEvent: DataStream[String] = env.socketTextStream("localhost", 9002)
      private val streamServerEvent: DataStream[String] = env.socketTextStream("localhost", 9003)
    
      private val stream: DataStream[String] = streamPageEvent.union(streamMobileEvent,streamServerEvent)
    
    
      stream.print()
    
      println(env.getExecutionPlan)
    }

输出json

{ 
        "nodes": [
            { 
                "id": 1,
                "type": "Source: Socket Stream",
                "pact": "Data Source",
                "contents": "Source: Socket Stream",
                "parallelism": 1
            },
            { 
                "id": 2,
                "type": "Source: Socket Stream",
                "pact": "Data Source",
                "contents": "Source: Socket Stream",
                "parallelism": 1
            },
            { 
                "id": 3,
                "type": "Source: Socket Stream",
                "pact": "Data Source",
                "contents": "Source: Socket Stream",
                "parallelism": 1
            },
            { 
                "id": 5,
                "type": "Sink: Print to Std. Out",
                "pact": "Data Sink",
                "contents": "Sink: Print to Std. Out",
                "parallelism": 1,
                "predecessors": [
                    { 
                        "id": 1,
                        "ship_strategy": "FORWARD",
                        "side": "second"
                    },
                    { 
                        "id": 2,
                        "ship_strategy": "FORWARD",
                        "side": "second"
                    },
                    { 
                        "id": 3,
                        "ship_strategy": "FORWARD",
                        "side": "second"
                    }
                ]
            }
        ]
    }

![企业微信截图\_a1f598ec-b763-427d-82a6-d886977d][a1f598ec-b763-427d-82a6-d886977d]

[http_flink.apache.org_visualizer_index.html]: http://flink.apache.org/visualizer/index.html
[a1f598ec-b763-427d-82a6-d886977d]: /images/20220204/729cb666139e4e1cab5127fd9a58c00a.png