Kettle7中使用Java脚本进行数据清洗

逃离我推掉我的手 2022-02-26 11:14 765阅读 0赞

1.首先，Kettle7.1下载li链接：[https://sourceforge.net/projects/pentaho/files/Data%20Integration/7.1/pdi-ce-7.1.0.0-12.zip/download][https_sourceforge.net_projects_pentaho_files_Data_20Integration_7.1_pdi-ce-7.1.0.0-12.zip_download]

2.打开这个文件：Spoon.bat

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBU3RyaXZlcg_size_16_color_FFFFFF_t_70][]

3.假设就这三个步骤：

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBU3RyaXZlcg_size_16_color_FFFFFF_t_70 1][]

4.其中组件“Java代码”的内容如下：

import java.text.SimpleDateFormat;
    public boolean processRow(StepMetaInterface smi,StepDataInterface sdi) throws Exception{
    	   Object[] r=getRow();
     
      	   if(r==null)
           {
                setOutputDone();
                return false;
           }
           r=createOutputRow(r,data.outputRowMeta.size());
    	   String HANDSET_NUM_ = get(Fields.In, "HANDSET_NUM_").getString(r);
    		String TO_ACCOUNT_ = get(Fields.In, "TO_ACCOUNT_").getString(r);
    		String FROM_ACCOUNT_ = get(Fields.In, "FROM_ACCOUNT_").getString(r);
          
    	   logBasic("---> HANDSET_NUM_: "+HANDSET_NUM_);
    		logBasic("TO_ACCOUNT_: "+TO_ACCOUNT_);
    		logBasic("FROM_ACCOUNT_: "+FROM_ACCOUNT_);
    
    	   if(HANDSET_NUM_!=null)
           {
                String format = HANDSET_NUM_.replace("+86", "").replace("+85", "").replaceAll("-", "").replaceAll("\\+", "");
    			get(Fields.In, "HANDSET_NUM_").setValue(r, format.trim());
                logBasic("format1: "+format);
                //putRow(data.outputRowMeta,r);
           }
           if(TO_ACCOUNT_!=null)
           {
                String format = TO_ACCOUNT_.replace("+86", "").replace("+85", "").replaceAll("-", "").replaceAll("\\+", "");
    		
           	    get(Fields.In, "TO_ACCOUNT_").setValue(r, format.trim());
                logBasic("format2: "+format);
                //putRow(data.outputRowMeta,r);
           }
           
    		if(FROM_ACCOUNT_!=null)
           {
                String format = FROM_ACCOUNT_.replace("+86", "").replace("+85", "").replaceAll("-", "").replaceAll("\\+", "");
           	    get(Fields.In, "FROM_ACCOUNT_").setValue(r, format.trim());
                logBasic("format3: "+format);
               // putRow(data.outputRowMeta,r);
           }
    
    	   putRow(data.outputRowMeta,r);
           return true;
    }

5.转换demo下载链接：[https://download.csdn.net/download/bastriver/11072483][https_download.csdn.net_download_bastriver_11072483]

直接用Kettle打开就可以了。

注：

1. kettle7.1的[资源库配置变为灰色][Link 1]，且没有了Connect按钮，应该是repository.xml文件出现了乱码问题。

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBU3RyaXZlcg_size_16_color_FFFFFF_t_70 2][]

[https_sourceforge.net_projects_pentaho_files_Data_20Integration_7.1_pdi-ce-7.1.0.0-12.zip_download]: https://sourceforge.net/projects/pentaho/files/Data%20Integration/7.1/pdi-ce-7.1.0.0-12.zip/download
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBU3RyaXZlcg_size_16_color_FFFFFF_t_70]: /images/20220226/8cd973b07d5449a8b49431d546b8e12f.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBU3RyaXZlcg_size_16_color_FFFFFF_t_70 1]: /images/20220226/86ad2f73786e456caa319cf60e8a91df.png
[https_download.csdn.net_download_bastriver_11072483]: https://download.csdn.net/download/bastriver/11072483
[Link 1]: https://blog.csdn.net/liuwenbiao1203/article/details/77579436
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0JBU3RyaXZlcg_size_16_color_FFFFFF_t_70 2]: /images/20220226/4d670f4bd91b4f05a55f48e1dcd83bf9.png