java高分面试指南：hadoop_hadoop高分博客(1)

5.5 修改 yarn-site.xml

yarn.nodemanager.aux-services

mapreduce_shuffle

5.6 修改 slave



> 
> slave1
> 
> 
> 



> 
> slave2
> 
> 
> 


6、远程分发


7、格式化



> 
> hdfs namenode -format
> 
> 
> 


8、启动hdfs和yarn



> 
> start-dfs.sh
> 
> 
> 




> 
> start-yarn.sh
> 
> 
> 


六、安装Hive


#1、安装Hive的元数据库 MySQL


1、下载mysql源安装包



> 
> sudo wget http://dev.mysql.com/get/mysql57-community-release-el7-8.noarch.rpm
> 
> 
> 


2、安装mysql源



> 
> sudo yum localinstall mysql57-community-release-el7-8.noarch.rpm
> 
> 
> 


3、安装mysql



> 
> sudo yum install mysql-community-server
> 
> 
> 


4、启动MySQL服务



> 
> sudo systemctl start mysqld
> 
> 
> 


5、查看mysql初始密码

[ec2-user@master ~]$ sudo grep “password” /var/log/mysqld.log

2021-03-19T07:56:41.030922Z 1 [Note] A temporary password is generated for root@localhost: v=OKXu0laSo;

**v=OKXu0laSo;是密码**


6、修改mysql登陆密码


把初始密码复制下来，在进入mysql需要输入密码时粘贴下来，回车，就可以进入MySQL命令行。


进入命令行



> 
> sudo mysql -uroot -p
> 
> 
> 


修改密码，设置MySQL登陆密码为1234


新密码设置的时候如果设置的过于简单会报错


修改密码规则：


在mysql命令行中输入

mysql> set global validate_password_policy=0;

Query OK, 0 rows affected (0.00 sec)

mysql> set global validate_password_length=1;

Query OK, 0 rows affected (0.00 sec)

重新设置密码

mysql> set password for ‘root’@‘localhost’=password(‘1234’);

Query OK, 0 rows affected, 1 warning (0.00 sec)

7、设置远程登陆


先退出MySQL


以新密码登陆MySQL

[ec2-user@master ~]$ mysql -uroot -p1234

mysql: [Warning] Using a password on the command line interface can be insecure.

Welcome to the MySQL monitor. Commands end with ; or \g.

Your MySQL connection id is 10

Server version: 5.7.33 MySQL Community Server (GPL)

Copyright © 2000, 2021, Oracle and/or its affiliates.

Oracle is a registered trademark of Oracle Corporation and/or its

affiliates. Other names may be trademarks of their respective

owners.

Type ‘help;’ or ‘\h’ for help. Type ‘\c’ to clear the current input statement.

mysql>

创建用户

mysql> create user ‘root’@‘172.%.%.%’ identified by ‘1234’;

Query OK, 0 rows affected (0.00 sec)

允许远程连接：

mysql> grant all privileges on . to ‘root’@‘172.%.%.%’ with grant option;

Query OK, 0 rows affected (0.00 sec)

刷新权限：

mysql> flush privileges;

Query OK, 0 rows affected (0.00 sec)

**到此mysql安装完成**


#2、安装Hive（依赖Hadoop）


1、把Hive解压到指定位置



> 
> tar -zxvf hadoop/apache-hive-1.1.0-bin.tar.gz -C /usr/local/src/
> 
> 
> 


2、重命名



> 
> mv apache-hive-1.1.0-bin/ hive
> 
> 
> 


3、配置全局环境变量



> 
> sudo vim /etc/profile
> 
> 
> 




> 
> export HIVE\_HOME=/usr/local/src/hive
> 
> 
> 




> 
> export PATH= 
>  
>  
>  
>  
>  P 
>  
>  
>  A 
>  
>  
>  T 
>  
>  
>  H 
>  
>  
>  : 
>  
>  
>  
>  PATH: 
>  
>  
>  PATH:HIVE\_HOME/bin
> 
> 
> 




> 
> export HADOOP\_CLASSPATH=$HADOOP\_CLASSPATH:/usr/local/src/hive/lib/\*
> 
> 
> 


刷新环境变量



> 
> source /etc/profile
> 
> 
> 


4、在src/hive/conf下创建hive-site.xml文件



> 
> touch hive-site.xml
> 
> 
> 


在hive-site.xml文件中添加如下内容:

    <name>hive.metastore.warehouse.dir</name>

    <value>/user/hive/warehouse</value>

    <name>javax.jdo.option.ConnectionURL</name>

    <value>jdbc:mysql://master:3306/hive?createDatabaseIfNotExist=true&amp;useSSL=false</value>

    <name>javax.jdo.option.ConnectionDriverName</name>

    <value>com.mysql.jdbc.Driver</value>

    <name>javax.jdo.option.ConnectionUserName</name>

    <value>root</value>

    <name>javax.jdo.option.ConnectionPassword</name>

    <value>1234</value>

# 最后

![腾讯T3大牛总结的500页MySQL实战笔记意外爆火，P8看了直呼内行](https://img-blog.csdnimg.cn/img_convert/64f82c2dd24f7b4ebe96fcf2b776f7e9.webp?x-oss-process=image/format,png)

![腾讯T3大牛总结的500页MySQL实战笔记意外爆火，P8看了直呼内行](https://img-blog.csdnimg.cn/img_convert/263e63f275d5198378219fd02744c56c.webp?x-oss-process=image/format,png)

ionDriverName</name>

        <value>com.mysql.jdbc.Driver</value>

</property>



<property>

        <name>javax.jdo.option.ConnectionUserName</name>

        <value>root</value>

</property>



<property>

        <name>javax.jdo.option.ConnectionPassword</name>

        <value>1234</value>

</property>

</configuration>

最后

[外链图片转存中…(img-oYWlKXuf-1714403630560)]

[外链图片转存中…(img-5OWA2lNh-1714403630561)]

本文已被CODING开源项目：【一线大厂Java面试题解析+核心总结学习笔记+最新讲解视频+实战项目源码】收录