hive1.2.1多用户模式部署

向右看齐 2023-06-27 05:32 13阅读 0赞

### 环境：linux centos6.8 ###

hadoop集群

192.168.164.31

192.168.164.32

192.168.164.33

192.168.164.34

hive

metastore服务端   192.168.164.32

client客户端   192.168.164.33

mysql数据库    192.168.164.31

<table style="width:500px;"> 
 <tbody> 
  <tr> 
   <td>&nbsp;</td> 
   <td>NameNode</td> 
   <td>DataNode</td> 
   <td>JournalNode</td> 
   <td>Zookeeper</td> 
   <td>ResourceManager</td> 
   <td>NodeManager</td> 
   <td><span style="color:#3399ea;">Mysql</span></td> 
   <td><span style="color:#3399ea;">Client客户端</span></td> 
   <td><span style="color:#3399ea;">MetaStore服务端</span></td> 
  </tr> 
  <tr> 
   <td>node1</td> 
   <td>1</td> 
   <td>&nbsp;</td> 
   <td>1</td> 
   <td>&nbsp;</td> 
   <td>&nbsp;</td> 
   <td>&nbsp;</td> 
   <td><span style="color:#3399ea;">1</span></td> 
   <td>&nbsp;</td> 
   <td>&nbsp;</td> 
  </tr> 
  <tr> 
   <td>node2</td> 
   <td>1</td> 
   <td>1</td> 
   <td>1</td> 
   <td>1</td> 
   <td>&nbsp;</td> 
   <td>1</td> 
   <td>&nbsp;</td> 
   <td><span style="color:#3399ea;">1</span></td> 
   <td>&nbsp;</td> 
  </tr> 
  <tr> 
   <td>node3</td> 
   <td>&nbsp;</td> 
   <td>1</td> 
   <td>1</td> 
   <td>1</td> 
   <td>1</td> 
   <td>1</td> 
   <td>&nbsp;</td> 
   <td>&nbsp;</td> 
   <td><span style="color:#3399ea;">1</span></td> 
  </tr> 
  <tr> 
   <td>node4</td> 
   <td>&nbsp;</td> 
   <td>1</td> 
   <td>&nbsp;</td> 
   <td>1</td> 
   <td>1</td> 
   <td>1</td> 
   <td>&nbsp;</td> 
   <td>&nbsp;</td> 
   <td>&nbsp;</td> 
  </tr> 
 </tbody> 
</table>

1、修改mysql权限

> **在设置密码是建议的规则是：大写+小写+特殊字符+数字组成的8位以上密码**
> 
> 修改mysql权限：
> 
> GRANT ALL PRIVILEGES ON \*.\* TO 'root'@'%' IDENTIFIED BY 'WD123456' WITH GRANT OPTION;
> 
> 刷新权限：
> 
> flush privileges;
> 
> 删除多余会对权限造成影响的数据
> 
> delete from user where user!= 'root';

### 1、 解压 ###

> 解压hive到/opt下  
>        \[root@node2 lib\]\# **tar -xvf apache-hive-1.2.1-bin.tar.gz -C /opt**

### 2、jar包 ###

> 将mysql驱动包cp到hive下的lib目录中  
>         \[root@node2 lib\]\# **cp mysql-connector-java-5.1.32-bin.jar /opt/hive-1.2.1/lib/**
> 
> **Hadoop jline版本和hive的jline不一致**  
>        将hive中的jline-2.12.jar覆盖调hadoop中hadoop-2.6.5/share/hadoop/yarn/lib下的jline-0.9.94.jar，只修改hive服务端和客户端所在节点的hadoop的jline包即可  
>        \[root@node2 lib\]\# **cp /opt/hive-1.2.1/lib/jline-2.12.jar /opt/hadoop-2.6.5/share/hadoop/yarn/lib/**  
>        \[root@node2 lib\]\# **rm -rf /opt/hadoop-2.6.5/share/hadoop/yarn/lib/jline-0.9.94.jar **

### 3、修改配置文件 ###

**        服务端配置文件   hive-site.xml**

<property>  
         <name>hive.metastore.warehouse.dir</name>  
         <value>/user/hive/warehouse</value>  
    </property>  
    <property>  
         <name>javax.jdo.option.ConnectionURL</name>  
         <value>jdbc:mysql://node1:3306/hive?createDatabaseIfNotExist=true</value>  
    </property>  
    <property>  
         <name>javax.jdo.option.ConnectionDriverName</name>  
         <value>com.mysql.jdbc.Driver</value>  
    </property>     
    <property>  
         <name>javax.jdo.option.ConnectionUserName</name>  
         <value>root</value>  
    </property>  
    <property>  
         <name>javax.jdo.option.ConnectionPassword</name>  
         <value>WD123456</value>  
    </property>

**客户端配置文件   hive-site.xml**

<property>  
         <name>hive.metastore.warehouse.dir</name>  
         <value>/user/hive/warehouse</value>  
    </property>  
       
    <property>  
         <name>hive.metastore.local</name>  
         <value>false</value>  
    </property>  
      
    <property>  
         <name>hive.metastore.uris</name>  
         <value>thrift://node2:9083</value>  
    </property>

### 4、启用 ###

>   1、启动hive服务端程序
> 
>         hive --service metastore
> 
>   2、客户端直接使用hive命令即可
> 
>         hive
> 
>   3、测试
> 
>         
> 
>     hive> show tables;
>     OK
>     Time taken: 0.886 seconds
>     hive> create table test_t;
>     OK
>     Time taken: 10.826 seconds