hive環境搭建
阿新 • • 發佈：2017-09-09
客戶 環境 logs java-5 var apache 9.1 ddp body
機器規劃：
| 主機 | ip | 進程 |
| master1 | 10.112.29.9 | hive server |
| master2 | 10.112.29.10 | hive client |
mysql安裝：略
添加hive用戶名，及數據庫。mysql -uhive -h10.112.28.179 -phive123456
hive使用2.3.0版本：
wget http://mirror.bit.edu.cn/apache/hive/hive-2.3.0/apache-hive-2.3.0-bin.tar.gz
添加環境變量：
export HIVE_HOME=/letv/soft/apache-hive-2.3.0-bin export HIVE_CONF_DIR=$HIVE_HOME/conf export PATH=\$PATH:\$HIVE_HOME/bin
同步至master2，並 source /etc/profile
解壓：
tar zxvf apache-hive-2.3.0-bin.tar.gz
生成keytab:
addprinc -randkey hive/[email protected] addprinc -randkey hive/[email protected] xst -k /var/kerberos/krb5kdc/keytab/hive.keytab hive/[email protected] xst -k /var/kerberos/krb5kdc/keytab/hive.keytab hive/[email protected]
拷貝至master2
scp /var/kerberos/krb5kdc/keytab/hive.keytab master2:/var/kerberos/krb5kdc/keytab/
增加hive-site.xml:
vim conf/hive-site.xml
<configuration>
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://10.112.28.179:3306/hive?createDatabaseIfNotExist=true</value>
<description>JDBC connect string for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
<description>Driver class name for a JDBC metastore</description>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>hive<value>
<description>username to use against metastore database</description>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>hive</value>
<description>password to use against metastore database</description>
</property>
</configuration>
hadoop core-site.xml增加配置：
<!-- hive congfig -->
<property>
<name>hadoop.proxyuser.hive.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.hive.groups</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.hdfs.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.hdfs.groups</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.HTTP.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.HTTP.groups</name>
<value>*</value>
</property>
同步是其他機器。
scp etc/hadoop/core-site.xml master2:/xxx/soft/hadoop-2.7.3/etc/hadoop/ scp etc/hadoop/core-site.xml slave2:/xxx/soft/hadoop-2.7.3/etc/hadoop/
JDBC下載：
wget https://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.44.tar.gz tar zxvf mysql-connector-java-5.1.44.tar.gz
復制到hive lib目錄：
cp mysql-connector-java-5.1.44/mysql-connector-java-5.1.44-bin.jar apache-hive-2.3.0-bin/lib/
客戶端配置：
將hive拷貝至master2
scp -r apache-hive-2.3.0-bin/ master2:/xxx/soft/
在master2上：
vim conf/hive-site.xml
<configuration>
<property>
<name>hive.metastore.uris</name>
<value>thrift://master1:9083</value>
</property>
</configuration>
啟動hive：
初始化數據：
./bin/schematool -dbType mysql -initSchema
獲取票據：
kinit -k -t /var/kerberos/krb5kdc/keytab/hive.keytab hive/[email protected]
啟動server：
hive --service metastore &
hive環境搭建