flink-faker用法示例(还没弄完，到时候再说)

梦里梦外; 2023-01-02 11:29 175阅读 0赞

本文针对的是flink-faker这个连接器

[https://github.com/knaufk/flink-faker][https_github.com_knaufk_flink-faker]

下面的使用案例来自ververica的flink-sql-cookbook

<table> 
 <tbody> 
  <tr> 
   <td style="width:229px;"><strong>数据类型(不要忘记最后添加逗号)</strong></td> 
   <td style="width:518px;"><strong>生成该数据的设置方式(不要忘记最后添加逗号)</strong></td> 
   <td style="width:174px;"><strong>生成的数据举例</strong></td> 
  </tr> 
  <tr> 
   <td style="width:229px;">连接器</td> 
   <td style="width:518px;">'connector' = 'faker',</td> 
   <td style="width:174px;">-</td> 
  </tr> 
  <tr> 
   <td style="width:229px;">client_ip STRING</td> 
   <td style="width:518px;">'fields.client_ip.expression' = '#{Internet.publicIpV4Address}'</td> 
   <td style="width:174px;">&nbsp;</td> 
  </tr> 
  <tr> 
   <td style="width:229px;">'fields.client_ip.expression'</td> 
   <td style="width:518px;">&nbsp;'#{Internet.publicIpV4Address}'</td> 
   <td style="width:174px;">&nbsp;</td> 
  </tr> 
  <tr> 
   <td style="width:229px;">product_id BIGINT</td> 
   <td style="width:518px;">&nbsp;</td> 
   <td style="width:174px;">&nbsp;</td> 
  </tr> 
  <tr> 
   <td style="width:229px;">price DECIMAL(32, 2)</td> 
   <td style="width:518px;">&nbsp;</td> 
   <td style="width:174px;">&nbsp;</td> 
  </tr> 
  <tr> 
   <td style="width:229px;">doctor STRING</td> 
   <td style="width:518px;">'fields.doctor.expression' = '#{dr_who.the_doctors}'</td> 
   <td style="width:174px;">Seventh Doctor</td> 
  </tr> 
  <tr> 
   <td style="width:229px;">sighting_time TIMESTAMP(3)</td> 
   <td style="width:518px;">'fields.sighting_time.expression' = '#{date.past ''15'',''SECONDS''}'</td> 
   <td style="width:174px;"> <p>2021-01-05T11:54:41</p> </td> 
  </tr> 
 </tbody> 
</table>

>     client\_ip STRING,  
>     client\_identity STRING,   
>     userid STRING,   
>     user\_agent STRING,  
>     log\_time TIMESTAMP(3),  
>     request\_line STRING,   
>     status\_code STRING,   
>     size INT  
> ) WITH (  
>   'connector' = 'faker',   
>   'fields.client\_ip.expression' = '\#\{Internet.publicIpV4Address\}',  
>   'fields.client\_identity.expression' =  '-',  
>   'fields.userid.expression' =  '-',  
>   'fields.user\_agent.expression' = '\#\{Internet.userAgentAny\}',  
>   'fields.log\_time.expression' =  '\#\{date.past ''15'',''5'',''SECONDS''\}',  
>   'fields.request\_line.expression' = '\#\{regexify ''(GET|POST|PUT|PATCH)\{1\}''\} \#\{regexify ''(/search\\.html|/login\\.html|/prod\\.html|cart\\.html|/order\\.html)\{1\}''\} \#\{regexify ''(HTTP/1\\.1|HTTP/2|/HTTP/1\\.0)\{1\}''\}',  
>   'fields.status\_code.expression' = '\#\{regexify ''(200|201|204|400|401|403|301)\{1\}''\}',  
>   'fields.size.expression' = '\#\{number.numberBetween ''100'',''10000000''\}'  
> );

**Reference:**

\[1\][DataGen SQL Connector][]

[https_github.com_knaufk_flink-faker]: https://github.com/knaufk/flink-faker
[DataGen SQL Connector]: https://ci.apache.org/projects/flink/flink-docs-master/zh/dev/table/connectors/datagen.html