大数据之oozie的安装

修改hadoop相关配置

---

配置hadoop的配置core-site.xml

  <property>
    <name>hadoop.proxyuser.root.hosts</name>
    <value>*</value>
  </property>
  <property>
    <name>hadoop.proxyuser.root.groups</name>
    <value>*</value>
  </property>

---

配置JobHistoryServer服务,修改mapred-site.xml

---

<property>
      <name>mapreduce.framework.name</name>
      <value>yarn</value>
</property>
<property>
      <name>mapreduce.jobhistory.address</name>
      <value>machine01:10020</value>
</property>
<property>
      <name>mapreduce.jobhistory.webapp.address</name>
      <value>machine01:19888</value>
</property>
<property>
      <name>mapreduce.jobhistory.done-dir</name>
      <value>/history/done</value>
</property>
<property>
      <name>mapreudce.jobhistory.intermediate.done-dir</name>
      <value>/history/done/done_intermediate</value>
</property>

---

将上面两个配置文件，同步到其它两个节点上 

scp -r mapred-site.xml  root@machine03:/usr/local/hadoop-2.7.6/etc/hadoop/
scp -r core-site.xml  root@machine03:/usr/local/hadoop-2.7.6/etc/hadoop/

 

---

重启hadoop集群 start-dfs.sh   start-yarn.sh

---

紧接着启动history-server,使用命令 

mr-jobhistory-daemon.sh start historyserver

---

上传 oozie-4.1.0-cdh5.14.0.tar.gz 到/usr/local目录下，并解压，然后进入解压目录

---

---

tar -zxvf oozie-hadooplibs-4.1.0-cdh5.14.0.tar.gz -C ../

 解压后目录结构如下：

 

---

mkdir -p libext

---

cp -ra  hadooplibs/hadooplib-2.6.0-cdh5.14.0.oozie-4.1.0-cdh5.14.0/*  libext/

---

cd  /usr/local/oozie-4.1.0-cdh5.14.0/libext 

---

上传下面两个文件到libext目录

---

切到conf目录

cd  /usr/local/oozie-4.1.0-cdh5.14.0/conf

---

修改oozie-site.xml

vim  oozie-site.xml

 

     <property>
        <name>oozie.service.JPAService.jdbc.driver</name>
        <value>com.mysql.jdbc.Driver</value>
     </property>
     <property>
        <name>oozie.service.JPAService.jdbc.url</name>
        <value>jdbc:mysql://machine01:3306/oozie</value>
     </property>
     <property>
        <name>oozie.service.JPAService.jdbc.username</name>
        <value>root</value>
     </property>
     <property>
        <name>oozie.service.JPAService.jdbc.password</name>
        <value>123456</value>
     </property>
     <property>
        <name>oozie.processing.timezone</name>
        <value>GMT+0800</value>                                                                                                                                         
     </property>
     <property>
        <name>oozie.service.coord.check.maximum.frequency</name>
        <value>false</value>
     </property>
     <property>
        <name>oozie.service.HadoopAccessorService.hadoop.configurations</name>
        <value>*=/usr/local/hadoop-2.7.6/etc/hadoop/</value>                                                                                                                   
     </property>

 

 

---

接下来配置mysql相关信息，mysql安装参考这里

---

cd   /usr/local/oozie-4.1.0-cdh5.14.0
bin/oozie-setup.sh  sharelib create -fs hdfs://machine01:9000 -locallib oozie-sharelib-4.1.0-cdh5.14.0-yarn.tar.gz

---

---

 接下来初始化mysql数据库

---

mysql -u root -p

---

create database oozie

  

---

cd /usr/local/oozie-4.1.0-cdh5.14.0/

---

bin/oozie-setup.sh   db create  -run -sqlfile  oozie.sql 

  

---

 

 

---

打包项目，生成war包

---

bin/oozie-setup.sh  prepare-war

---

---

下面配置一下oozie的环境变量

---

---

使用下面命令使环境变量立即生效

source /etc/profile

---

---

至此，oozie已经部署完毕

---

  启动o'o'zi'e 

bin/oozied.sh  start

---

---

注意停止oozie ，一定要使用下面的stop命令，如果使用kill -s 9 进程号  的方式，则记得要执行rm -rf /usr/local/oozie-4.1.0-cdh5.14.0/oozie-server/temp/oozie.pid 这个文件

bin/oozied.sh  stop

---

 

---

启动oozie后，可以访问如下网址，访问oozie

http://machine01:11000/oozie/

---

---

此时发现一个小bug，Timezone默认是GMT，如果想默认返回GMT+8，则做如下配置

---

进入oozie的安装根目录 

cd   /usr/local/oozie-4.1.0-cdh5.14.0

     

---

然后进入如下目录

cd oozie-server/webapps/oozie

---

vim oozie-console.js 

 

---

 

 

---

FR：徐海涛（hunk xu)
QQ技术交流群：386476712