Spring + Hbase整合

水深无声 2022-04-06 13:18 206阅读 0赞

1、版本说明

（1）spring版本：4.3.9.RELEASE

（2）Hbase版本：1.1.2

（3）Hadoop版本：2.7.1

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2NzbW5qaw_size_16_color_FFFFFF_t_70][]

Hbase和hadoop的版本一定要与集群上的版本一致，不然程序会报方法不存在的各种异常！

2、Hbase和Hadoop的pom

<dependency>
      <groupId>org.apache.hbase</groupId>
      <artifactId>hbase-client</artifactId>
      <version>1.1.2</version>
    </dependency>
    <dependency>
      <groupId>org.apache.hbase</groupId>
      <artifactId>hbase-server</artifactId>
      <version>1.1.2</version>
    </dependency>
    <dependency>
      <groupId>org.apache.hbase</groupId>
      <artifactId>hbase-common</artifactId>
      <version>1.1.2</version>
    </dependency>
    
    
     <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-hdfs</artifactId>
      <version>2.7.1</version>
    </dependency>
    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-client</artifactId>
      <version>2.7.1</version>
    </dependency>
    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-common</artifactId>
      <version>2.7.1</version>
    </dependency>
    <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-auth</artifactId>
      <version>2.7.1</version>
    </dependency>

3、Hbase的使用（原生操作方式）

（1）HbaseClient：简单的连接管理

Hbase-site.xml从Hbase的安装目录下复制出来直接用。

public class HbaseClient {
        //自动配置hbase-site.xml
        //HBaseConfiguration会自动加载resources下的hbase-site.xml进行初始化
        public static Configuration config = HBaseConfiguration.create();
    
        /**
         * 获取连接(长连接，已实现连接池管理)
         * @return
         * @throws IOException
         */
        public static Connection getConnection() throws IOException {
            //手动配置hbase-site.xml
            //config.addResource("hbase-site.xml");
            Connection conn = ConnectionFactory.createConnection(config);
            return conn;
        }
    
        /**
         * 关闭连接
         * @param conn
         * @throws IOException
         */
        public static void close(Connection conn) throws IOException {
            if(conn!=null && !conn.isClosed()) {
                conn.close();
            }
        }
    }

（2）Hbase命令操作

建表：create 'app\_rec' ,'cf';

存值：put 'app\_rec','1','cf:recdata','123';

取值：get 'app\_rec','1';

字段说明：

表名：app\_rec

key：1

族：cf

列名：recdata

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2NzbW5qaw_size_16_color_FFFFFF_t_70 1][]

（3）Hbase原生API操作

1）controller下的get方法：

import com.utils.HbaseClient;
    import org.apache.hadoop.hbase.Cell;
    import org.apache.hadoop.hbase.CellUtil;
    import org.apache.hadoop.hbase.TableName;
    import org.apache.hadoop.hbase.client.Connection;
    import org.apache.hadoop.hbase.client.Get;
    import org.apache.hadoop.hbase.client.Result;
    import org.apache.hadoop.hbase.client.Table;
    import org.apache.hadoop.hbase.util.Bytes;
    import org.springframework.stereotype.Controller;
    import org.springframework.web.bind.annotation.RequestMapping;
    import org.springframework.web.bind.annotation.ResponseBody;
    ------------------------------------------------------------
    
    @RequestMapping( GET )
        public void get(HttpServletRequest request, HttpServletResponse response) throws IOException {
            Connection connection = HbaseClient.getConnection();
            System.out.println("connection: "+ connection);
            TableName tableName = TableName.valueOf("app_rec");
            try {
                Table table = connection.getTable(tableName);
                Get get = new Get(Bytes.toBytes("1"));
                get.addColumn(Bytes.toBytes("cf"),Bytes.toBytes("recdata"));
                Result results = table.get(get);
                showCell(results);
            } catch(Exception e) {
    
            } finally {
                HbaseClient.close(connection);
            }
        }
    
        public static void showCell(Result result) {
            Cell[] cells = result.rawCells();
            for (Cell cell : cells) {
                System.out.println("row Name:" + new String(CellUtil.cloneQualifier(cell)) + " ");
                System.out.println("value:" + new String(CellUtil.cloneValue(cell)) + " ");
            }
        }

2）部署后请求的结果如下，至此整合成功！

![20181209120555507.png][]

本文只是做spring+hbase的搭建，搭建成功了后面就可以自由发挥了。

更多原生操作参见：

[https://www.cnblogs.com/junrong624/p/7323483.html][https_www.cnblogs.com_junrong624_p_7323483.html]

[https://blog.csdn.net/sinat\_39409672/article/details/78403015][https_blog.csdn.net_sinat_39409672_article_details_78403015]

（4）扩展：Hbasetemplated操作Hbase

链接参见：[https://blog.csdn.net/ludonqin/article/details/51509261][https_blog.csdn.net_ludonqin_article_details_51509261]

Hadoop与Hbase的版本对应：[http://hbase.apache.org/book.html\#basic.prerequisites][http_hbase.apache.org_book.html_basic.prerequisites]

spring-data-hadoop：[https://docs.spring.io/spring-hadoop/docs/2.3.0.RELEASE/reference/html/requirements.html][https_docs.spring.io_spring-hadoop_docs_2.3.0.RELEASE_reference_html_requirements.html]

GitHub：[https://github.com/spring-projects/spring-hadoop-samples/][https_github.com_spring-projects_spring-hadoop-samples]

提示：使用spring-data-hadoop会出现包冲突的问题，所以要自己控制版本！切记！

[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2NzbW5qaw_size_16_color_FFFFFF_t_70]: /images/20220406/4e63937ce0d14e9885456cd644d886f2.png
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2NzbW5qaw_size_16_color_FFFFFF_t_70 1]: /images/20220406/0fe43d5f8a9b4bf7bfd077f925024ece.png
[20181209120555507.png]: /images/20220406/17390f937d614826bb450583dbecc004.png
[https_www.cnblogs.com_junrong624_p_7323483.html]: https://www.cnblogs.com/junrong624/p/7323483.html
[https_blog.csdn.net_sinat_39409672_article_details_78403015]: https://blog.csdn.net/sinat_39409672/article/details/78403015
[https_blog.csdn.net_ludonqin_article_details_51509261]: https://blog.csdn.net/ludonqin/article/details/51509261
[http_hbase.apache.org_book.html_basic.prerequisites]: http://hbase.apache.org/book.html#basic.prerequisites
[https_docs.spring.io_spring-hadoop_docs_2.3.0.RELEASE_reference_html_requirements.html]: https://docs.spring.io/spring-hadoop/docs/2.3.0.RELEASE/reference/html/requirements.html
[https_github.com_spring-projects_spring-hadoop-samples]: https://github.com/spring-projects/spring-hadoop-samples/