基础准备

1. 虚拟机 centos7,升级（yum update、升级内核，更新grub、重启）
2. 安装mysql8
3. 安装openjdk8（jdk11 hive启动有问题。当前是为了尽快入门，故而没有深究）
4. 下载mysql8 java connector（mysql-connector-java-8.0.29.jar）
5. 下载apache-hive-2.3.9-bin.tar.gz
6. 下载hadoop-2.10.1.tar.gz

系统准备

/etc/security/limits.conf

* soft noproc 1024000
* hard noproc 1024000
* soft nofile 1024000    
* hard nofile 1024000

免密登录

ssh-keygen -t rsa
ssh-copy-id 127.0.0.1

hadoop配置

etc/hadoop/core-site.xml

<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://0.0.0.0:9000</value>
    </property>
    <property>
        <name>hadoop.proxyuser.root.hosts</name>
        <value>*</value>
    </property>
    <property>
        <name>hadoop.proxyuser.root.groups</name>
        <value>*</value>
    </property>
</configuration>

etc/hadoop/hdfs-site.xml

<configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
</configuration>

初始化

./bin/hdfs namenode -format

启动

./sbin/start-dfs.sh
./sbin/start-yarn.sh
./sbin/httpfs.sh start

校验是否启动成功

hive

conf/hive-env.sh

export HADOOP_HOME=/root/hadoop-2.10.1
export HIVE_CONF_DIR=/root/apache-hive-2.3.9-bin/conf
export JAVA_HOME=/root/jdk8u332-b09

这里有个疑惑，网上教程都是hive里面配置hadoop环境变量，这样hive、hadoop不就混合部署了嘛。
有办法分开嘛？没找到资料

hive-site.xml

不建议去copy默认配置，添加必要即可

<configuration>
    <property>
        <name>hive.server2.thrift.port</name>
        <value>10000</value>
    </property>
    <property>
        <name>hive.server2.thrift.bind.host</name>
        <value>xx.xx.xx.xx</value>
    </property>
    <property>
        <name>datanucleus.schema.autoCreateAll</name>
        <value>true</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionURL</name>
        <value>jdbc:mysql://localhost:3306/hive</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionUserName</name>
        <value>root</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionPassword</name>
        <value>123456</value>
    </property>
    <property>
        <name>javax.jdo.option.ConnectionDriverName</name>
        <value>com.mysql.cj.jdbc.Driver</value>
    </property>
</configuration>

hive-log4j2.properties

cp hive-log4j2.properties.template hive-log4j2.properties

修改配置
property.hive.log.dir=/root/apache-hive-2.3.9-bin/log

mysql connector

上传 mysql-connector-java-8.0.xxx.jar 至 /home/apache-hive-2.3.9-bin/lib 下

初始化

./bin/schematool -dbType mysql -initSchema

启动

## 启动hive服务
./bin/hiveserver2

客户端链接

./bin/beeline

Beeline version 2.3.9 by Apache Hive
beeline> !connect jdbc:hive2://100.68.1.55:10000
Enter username for jdbc:hive2://100.68.1.55:10000: root
Enter password for jdbc:hive2://100.68.1.55:10000: <输入空格>
0: jdbc:hive2://100.68.1.55:10000> show databases;