azkaban 在centos 编译出错以及编译过程总结

最新推荐文章于 2024-06-12 20:24:18 发布

Accpdaiyekun

最新推荐文章于 2024-06-12 20:24:18 发布

阅读量1.9k

点赞数 4

本文链接：https://blog.csdn.net/Accpdaiyekun/article/details/124177720

版权

python 同时被 3 个专栏收录

10 篇文章 0 订阅

订阅专栏

python spark

3 篇文章 0 订阅

订阅专栏

azkaban

1 篇文章 0 订阅

订阅专栏

编译命令

cd azkaban; ./gradlew build installDist

编译错误结果：

 Task :azkaban-web-server:npm_install
npm WARN deprecated later@1.2.0: Please upgrade to the maintained and new drop-i                                                                                    n replacement @breejs/later at https://github.com/breejs/later 🚀 Thanks and hap                                                                                    py hacking! 🚀  @niftylettuce
npm WARN deprecated json3@3.3.2: Please use the native JSON object instead of JS                                                                                    ON 3

> Task :azkaban-common:test

azkaban.utils.UtilsTest > testValidCronExpressionV FAILED
    java.lang.AssertionError
        at org.junit.Assert.fail(Assert.java:86)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at org.junit.Assert.assertTrue(Assert.java:52)
        at azkaban.utils.UtilsTest.testValidCronExpressionV(UtilsTest.java:63)

azkaban.trigger.BasicTimeCheckerTest > testPDTtoPSTdst1 FAILED
    java.lang.IllegalStateException: 100000 increments of period did not get to                                                                                     present time.
        at azkaban.trigger.builtin.BasicTimeChecker.calculateNextCheckTime(Basic                                                                                    TimeChecker.java:167)
        at azkaban.trigger.builtin.BasicTimeChecker.<init>(BasicTimeChecker.java                                                                                    :55)
        at azkaban.trigger.BasicTimeCheckerTest.testPDTtoPSTdst1(BasicTimeChecke                                                                                    rTest.java:174)

azkaban.trigger.BasicTimeCheckerTest > testPDTtoPSTdst2 FAILED
    java.lang.IllegalStateException: 100000 increments of period did not get to                                                                                     present time.
        at azkaban.trigger.builtin.BasicTimeChecker.calculateNextCheckTime(Basic                                                                                    TimeChecker.java:167)
        at azkaban.trigger.builtin.BasicTimeChecker.<init>(BasicTimeChecker.java                                                                                    :55)
        at azkaban.trigger.BasicTimeCheckerTest.testPDTtoPSTdst2(BasicTimeChecke                                                                                    rTest.java:216)

azkaban.trigger.BasicTimeCheckerTest > testPDTtoPSTdst3 FAILED
    java.lang.IllegalStateException: 100000 increments of period did not get to                                                                                     present time.
        at azkaban.trigger.builtin.BasicTimeChecker.calculateNextCheckTime(Basic                                                                                    TimeChecker.java:167)
        at azkaban.trigger.builtin.BasicTimeChecker.<init>(BasicTimeChecker.java                                                                                    :55)
        at azkaban.trigger.BasicTimeCheckerTest.testPDTtoPSTdst3(BasicTimeChecke                                                                                    rTest.java:252)

azkaban.trigger.BasicTimeCheckerTest > testPSTtoPDTunderUTC FAILED
    java.lang.IllegalStateException: 100000 increments of period did not get to                                                                                     present time.
        at azkaban.trigger.builtin.BasicTimeChecker.calculateNextCheckTime(Basic                                                                                    TimeChecker.java:167)
        at azkaban.trigger.builtin.BasicTimeChecker.<init>(BasicTimeChecker.java                                                                                    :55)
        at azkaban.trigger.BasicTimeCheckerTest.testPSTtoPDTunderUTC(BasicTimeCh                                                                                    eckerTest.java:113)

azkaban.trigger.BasicTimeCheckerTest > testPSTtoPDTdst2 FAILED
    java.lang.IllegalStateException: 100000 increments of period did not get to                                                                                     present time.
        at azkaban.trigger.builtin.BasicTimeChecker.calculateNextCheckTime(Basic                                                                                    TimeChecker.java:167)
        at azkaban.trigger.builtin.BasicTimeChecker.<init>(BasicTimeChecker.java                                                                                    :55)
        at azkaban.trigger.BasicTimeCheckerTest.testPSTtoPDTdst2(BasicTimeChecke                                                                                    rTest.java:143)

315 tests completed, 6 failed, 18 skipped

> Task :azkaban-web-server:npm_install
npm WARN deprecated mkdirp@0.5.1: Legacy versions of mkdirp are no longer suppor                                                                                    ted. Please update to mkdirp 1.x. (Note that the API surface has changed to use                                                                                     Promises in 1.x.)
azkaban@ /home/handoop/source/azkaban-3.40.0/azkaban-web-server
├─┬ chai@3.5.0
│ ├── assertion-error@1.1.0
│ ├─┬ deep-eql@0.1.3
│ │ └── type-detect@0.1.1
│ └── type-detect@1.0.0
├─┬ eonasdan-bootstrap-datetimepicker@4.17.47
│ ├── bootstrap@3.4.1
│ ├── jquery@3.6.0
│ └── moment-timezone@0.4.1
├── later@1.2.0
├─┬ mocha@3.0.2
│ ├── browser-stdout@1.3.0
│ ├─┬ commander@2.9.0
│ │ └── graceful-readlink@1.0.1
│ ├─┬ debug@2.2.0
│ │ └── ms@0.7.1
│ ├── diff@1.4.0
│ ├── escape-string-regexp@1.0.5
│ ├─┬ glob@7.0.5
│ │ ├── fs.realpath@1.0.0
│ │ ├─┬ inflight@1.0.6
│ │ │ └── wrappy@1.0.2
│ │ ├── inherits@2.0.4
│ │ ├─┬ minimatch@3.1.2
│ │ │ └─┬ brace-expansion@1.1.11
│ │ │   ├── balanced-match@1.0.2
│ │ │   └── concat-map@0.0.1
│ │ ├── once@1.4.0
│ │ └── path-is-absolute@1.0.1
│ ├── growl@1.9.2
│ ├── json3@3.3.2
│ ├─┬ lodash.create@3.1.1
│ │ ├─┬ lodash._baseassign@3.2.0
│ │ │ ├── lodash._basecopy@3.0.1
│ │ │ └─┬ lodash.keys@3.1.2
│ │ │   ├── lodash._getnative@3.9.1
│ │ │   ├── lodash.isarguments@3.1.0
│ │ │   └── lodash.isarray@3.0.4
│ │ ├── lodash._basecreate@3.0.3
│ │ └── lodash._isiterateecall@3.0.9
│ ├─┬ mkdirp@0.5.1
│ │ └── minimist@0.0.8
│ └─┬ supports-color@3.1.2
│   └── has-flag@1.0.0
├── moment@2.14.1
├── UNMET PEER DEPENDENCY moment-timezone@0.5.5
└── rewire@2.5.2

npm WARN eonasdan-bootstrap-datetimepicker@4.17.47 requires a peer of moment-tim                                                                                    ezone@^0.4.0 but none was installed.


FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':azkaban-common:test'.
> There were failing tests. See the report at: file:///home/handoop/source/azkab                                                                                    an-3.40.0/azkaban-common/build/reports/tests/test/index.html

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug                                                                                     option to get more log output.

* Get more help at https://help.gradle.org

最近解决办法：

改为使用命令./gradlew build installDist -x test，-x test表示跳过测试。

./gradlew clean

./gradlew build installDist -x test

最终编译结果

[handoop@bogon azkaban-3.40.0]$ ./gradlew clean
Parallel execution with configuration on demand is an incubating feature.
Build cache is an incubating feature.

BUILD SUCCESSFUL in 3s
10 actionable tasks: 10 executed
[handoop@bogon azkaban-3.40.0]$ ./gradlew build installDist -x test
Parallel execution with configuration on demand is an incubating feature.
Build cache is an incubating feature.

> Task :azkaban-web-server:npm_install
npm WARN deprecated later@1.2.0: Please upgrade to the maintained and new drop-i                                                                                    n replacement @breejs/later at https://github.com/breejs/later 🚀 Thanks and hap                                                                                    py hacking! 🚀  @niftylettuce
npm WARN deprecated json3@3.3.2: Please use the native JSON object instead of JS                                                                                    ON 3
npm WARN deprecated mkdirp@0.5.1: Legacy versions of mkdirp are no longer suppor                                                                                    ted. Please update to mkdirp 1.x. (Note that the API surface has changed to use                                                                                     Promises in 1.x.)
azkaban@ /home/handoop/source/azkaban-3.40.0/azkaban-web-server
├─┬ chai@3.5.0
│ ├── assertion-error@1.1.0
│ ├─┬ deep-eql@0.1.3
│ │ └── type-detect@0.1.1
│ └── type-detect@1.0.0
├─┬ eonasdan-bootstrap-datetimepicker@4.17.47
│ ├── bootstrap@3.4.1
│ ├── jquery@3.6.0
│ └── moment-timezone@0.4.1
├── later@1.2.0
├─┬ mocha@3.0.2
│ ├── browser-stdout@1.3.0
│ ├─┬ commander@2.9.0
│ │ └── graceful-readlink@1.0.1
│ ├─┬ debug@2.2.0
│ │ └── ms@0.7.1
│ ├── diff@1.4.0
│ ├── escape-string-regexp@1.0.5
│ ├─┬ glob@7.0.5
│ │ ├── fs.realpath@1.0.0
│ │ ├─┬ inflight@1.0.6
│ │ │ └── wrappy@1.0.2
│ │ ├── inherits@2.0.4
│ │ ├─┬ minimatch@3.1.2
│ │ │ └─┬ brace-expansion@1.1.11
│ │ │   ├── balanced-match@1.0.2
│ │ │   └── concat-map@0.0.1
│ │ ├── once@1.4.0
│ │ └── path-is-absolute@1.0.1
│ ├── growl@1.9.2
│ ├── json3@3.3.2
│ ├─┬ lodash.create@3.1.1
│ │ ├─┬ lodash._baseassign@3.2.0
│ │ │ ├── lodash._basecopy@3.0.1
│ │ │ └─┬ lodash.keys@3.1.2
│ │ │   ├── lodash._getnative@3.9.1
│ │ │   ├── lodash.isarguments@3.1.0
│ │ │   └── lodash.isarray@3.0.4
│ │ ├── lodash._basecreate@3.0.3
│ │ └── lodash._isiterateecall@3.0.9
│ ├─┬ mkdirp@0.5.1
│ │ └── minimist@0.0.8
│ └─┬ supports-color@3.1.2
│   └── has-flag@1.0.0
├── moment@2.14.1
├── UNMET PEER DEPENDENCY moment-timezone@0.5.5
└── rewire@2.5.2

npm WARN eonasdan-bootstrap-datetimepicker@4.17.47 requires a peer of moment-tim                                                                                    ezone@^0.4.0 but none was installed.


BUILD SUCCESSFUL in 1m 33s
46 actionable tasks: 37 executed, 9 from cache

编译完成以后，将对于文件夹下文件拷贝到安装目录

目录：/home/handoop/source/azkaban-3.40.0/azkaban-solo-server/build/distributions 单机启动服务

目录2：/home/handoop/source/azkaban-3.40.0/azkaban-web-server/build/distributions

web 服务。

当然还有其他执行服务自行拷贝就可以

[handoop@bogon distributions]$ cd ..
[handoop@bogon build]$ cd ..
[handoop@bogon azkaban-solo-server]$ cd ..
[handoop@bogon azkaban-3.40.0]$ cd azkaban-web-server
[handoop@bogon azkaban-web-server]$ ls
build  build.gradle  node_modules  package.json  src
[handoop@bogon azkaban-web-server]$ cd build
[handoop@bogon build]$ ls
classes  distributions  dust  install  jsToPackage  less  libs  nodejs  resources  tmp
[handoop@bogon build]$ cd distributions/
[handoop@bogon distributions]$ ls
azkaban-web-server-0.1.0-SNAPSHOT.tar.gz  azkaban-web-server-0.1.0-SNAPSHOT.zip
[handoop@bogon distributions]$ cp azkaban-web-server-0.1.0-SNAPSHOT.zip ~/software
[handoop@bogon distributions]$ cp azkaban-web-server-0.1.0-SNAPSHOT.tar.gz ~/software
[handoop@bogon distributions]$ cd ..
[handoop@bogon build]$ cd ..
[handoop@bogon azkaban-web-server]$ cd ..
[handoop@bogon azkaban-3.40.0]$ ls
az-core                azkaban-db                      azkaban-spi         gradle             LICENSE          test
az-exec-util           azkaban-exec-server             azkaban-web-server  gradle.properties  NOTICE
az-intellij-style.xml  azkaban-hadoop-security-plugin  build.gradle        gradlew            README.md
azkaban-common         azkaban-solo-server             CONTRIBUTING.md     gradlew.bat        settings.gradle
[handoop@bogon azkaban-3.40.0]$ cd azkaban-solo-server
[handoop@bogon azkaban-solo-server]$ ls
azkaban-webserver.log  build  build.gradle  src  temp
[handoop@bogon azkaban-solo-server]$ cd build
[handoop@bogon build]$ ls
classes  distributions  install  libs  resources  tmp
[handoop@bogon build]$ cd distributions
[handoop@bogon distributions]$ ls
azkaban-solo-server-0.1.0-SNAPSHOT.tar.gz  azkaban-solo-server-0.1.0-SNAPSHOT.zip
[handoop@bogon distributions]$ cp azkaban-solo-server-0.1.0-SNAPSHOT.zip ~/software
[handoop@bogon distributions]$ cp azkaban-solo-server-0.1.0-SNAPSHOT.tar.gz ~/software
[handoop@bogon distributions]$

拷贝到制定目录 tar -zxvf 解压

执行下面命令启动单机实例

bin/azkaban-solo-start.sh

[handoop@bogon app]$ cd azkaban-solo-server-0.1.0-SNAPSHOT/
[handoop@bogon azkaban-solo-server-0.1.0-SNAPSHOT]$ bin/start-solo.sh
-bash: bin/start-solo.sh: 没有那个文件或目录
[handoop@bogon azkaban-solo-server-0.1.0-SNAPSHOT]$ ./bin/start-solo.sh
-bash: ./bin/start-solo.sh: 没有那个文件或目录
[handoop@bogon azkaban-solo-server-0.1.0-SNAPSHOT]$ cd bin
[handoop@bogon bin]$ ls
azkaban-solo-shutdown.sh  azkaban-solo-start.sh  util.sh
[handoop@bogon bin]$ cd ..
[handoop@bogon azkaban-solo-server-0.1.0-SNAPSHOT]$ bin/azkaban-solo-start.sh

关于更多内容可以看官网文档：Getting Started — Azkaban documentation

可以参考：在CentOS6.9安装Azkaban3.50.0_andyguan01_2的博客-CSDN博客