【Bigtop编译】gradle配置nexus私服提速

已于 2024-09-18 15:42:37 修改
阅读量365 收藏 3
点赞数 15
分类专栏： 大数据专栏 文章标签： centos gradle java 数据库 oracle ambari hadoop
于 2024-09-18 15:32:22 首次发布
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/TTBIGDATA/article/details/142334736
版权

gradle配置nexus私服提速🚀

快捷导航

正题

一、gradle设置nexus私服方案

🌟 1. 项目级别配置（Project-Level） 🌟

项目级别配置适用于单个项目的 build.gradle 文件。这样可以针对不同的项目进行特定的 Nexus 私服配置。

⚙️ 在 build.gradle 中的配置：
// 应用Java插件和Maven发布插件
plugins {
    id 'java' // Java插件
    id 'maven-publish' // Maven发布插件
}

// 定义项目的组名和版本
group = 'com.example'
version = '1.0.0'

// 仓库配置 - 使用私服作为依赖源
repositories {
    maven {
        url "http://your-nexus-server/repository/maven-public/"
        credentials {
            username 'your-username' // 用户名
            password 'your-password' // 密码
        }
    }
}

// 项目依赖
dependencies {
    implementation 'org.apache.hadoop:hadoop-common:3.3.0'
    implementation 'org.apache.spark:spark-core_2.12:3.1.2'
}

// 发布配置 - 将项目发布到Nexus仓库
publishing {
    publications {
        mavenJava(MavenPublication) {
            from components.java // 发布Java组件
        }
    }
    repositories {
        maven {
            url "http://your-nexus-server/repository/maven-releases/"
            credentials {
                username 'your-username' // 用户名
                password 'your-password' // 密码
            }
        }
    }
}

📌 说明：

  • 每个项目的 build.gradle 文件需要单独配置。
  • 使用该方法可以灵活管理每个项目的依赖和发布配置。
🌐 2. 全局配置（Global-Level） 🌐

全局配置适用于在多个项目中共享 Nexus 私服配置。你可以通过修改 ~/.gradle/init.gradle 文件，一次性对所有项目生效。

🛠️ 在 init.gradle 中的配置：
allprojects {
    repositories {
        // 全局Nexus私服配置，适用于所有项目
        maven {
            url "http://your-nexus-server/repository/maven-public/"
            credentials {
                username 'your-username' // 用户名
                password 'your-password' // 密码
            }
        }
    }
}

// 如果项目需要发布，也可以在全局设置发布仓库
gradle.projectsEvaluated {
    allprojects {
        publishing {
            repositories {
                maven {
                    url "http://your-nexus-server/repository/maven-releases/"
                    credentials {
                        username 'your-username' // 用户名
                        password 'your-password' // 密码
                    }
                }
            }
        }
    }
}

💡 特点：

  • 自动生效：此配置文件会对所有使用 Gradle 构建的项目生效，无需每个项目手动配置。
  • 依赖与发布管理：所有项目会共享同一个 Nexus 私服仓库，无需重复配置。
🤔 3. 选择建议：
  • 如果你想单独控制每个项目的配置，并根据项目需求灵活管理依赖，建议使用 项目级别配置。
  • 如果你有很多项目，并且希望所有项目共享同一套 Nexus 私服配置，那么 全局配置 是最佳选择。

本人更倾向于全局设置：

在这里插入图片描述

我这里做了统一的汇聚，关联所有的下载镜像：

在这里插入图片描述

二、在 Bigtop 项目中编译案例—Kafka

2.1 编译日志
# kafka 2.8.1 基于gradle 打rpm的编译
gradle \
kafka-rpm \
-PparentDir=/usr/bigtop \
-Dbuildwithdeps=true \
-PpkgSuffix \
-d


# kafka 2.8.1 独立编译命令
export NEXUS_URL=172.20.0.2
./gradlew -PscalaVersion=2.12.13 clean releaseTarGz -x signArchives -d

2024-09-18T07:07:05.990+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpResponseResource] Attempting to download resource http://172.20.0.2:8081/repository/maven-public/xpp3/xpp3_min/1.1.4c/xp
p3_min-1.1.4c.jar.sha1.
2024-09-18T07:07:05.990+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpResponseResource] Attempting to download resource http://172.20.0.2:8081/repository/maven-public/xmlpull/xmlpull/1.1.3.1
/xmlpull-1.1.3.1.jar.sha1.
2024-09-18T07:07:05.990+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection [id: 19][route: {}->http://172.20.0.2:8081] can be kept alive indefinitely
2024-09-18T07:07:05.990+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-19: set socket timeout to 0
2024-09-18T07:07:05.990+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection released: [id: 19][route: {}->http://172.20.0.2:8081][total kept alive: 2; route allocated: 12
of 20; total allocated: 12 of 20]
2024-09-18T07:07:05.990+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection [id: 14][route: {}->http://172.20.0.2:8081] can be kept alive indefinitely
2024-09-18T07:07:05.990+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-14: set socket timeout to 0
2024-09-18T07:07:05.990+0000 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Download http://172.20.0.2:8081/repository/maven-public/xpp3/xpp3_min/1.1.4c/xpp3_min-1.1.4
c.jar.sha1' completed
2024-09-18T07:07:05.990+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection released: [id: 14][route: {}->http://172.20.0.2:8081][total kept alive: 3; route allocated: 12
of 20; total allocated: 12 of 20]
2024-09-18T07:07:05.990+0000 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Download http://172.20.0.2:8081/repository/maven-public/xmlpull/xmlpull/1.1.3.1/xmlpull-1.1
.3.1.jar.sha1' completed
2024-09-18T07:07:05.993+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpResourceAccessor] Constructing external resource: http://172.20.0.2:8081/repository/maven-public/org/whitesource/pecoff4
j/0.0.2.1/pecoff4j-0.0.2.1.jar
2024-09-18T07:07:05.993+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpClientHelper] Performing HTTP GET: http://172.20.0.2:8081/repository/maven-public/org/whitesource/pecoff4j/0.0.2.1/pecof
f4j-0.0.2.1.jar
2024-09-18T07:07:05.993+0000 [DEBUG] [org.apache.http.client.protocol.RequestAddCookies] CookieSpec selected: default
2024-09-18T07:07:05.993+0000 [DEBUG] [org.apache.http.client.protocol.RequestAuthCache] Auth cache not set in the context
2024-09-18T07:07:05.993+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection request: [route: {}->http://172.20.0.2:8081][total kept alive: 3; route allocated: 12 of 20; to
tal allocated: 12 of 20]
2024-09-18T07:07:05.993+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection leased: [id: 14][route: {}->http://172.20.0.2:8081][total kept alive: 2; route allocated: 12 of
 20; total allocated: 12 of 20]
2024-09-18T07:07:05.993+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-14: set socket timeout to 30000
2024-09-18T07:07:05.993+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-14: set socket timeout to 30000
2024-09-18T07:07:05.993+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Executing request GET /repository/maven-public/org/whitesource/pecoff4j/0.0.2.1/pecoff4j-0.0.2.1.jar HTTP/1.1
2024-09-18T07:07:05.993+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Target auth state: UNCHALLENGED
2024-09-18T07:07:05.993+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Proxy auth state: UNCHALLENGED
2024-09-18T07:07:05.997+0000 [INFO] [org.gradle.internal.resource.transfer.DefaultCacheAwareExternalResourceAccessor] Found locally available resource with matching checksum: [http://172.20.0.2:8081/reposit
ory/maven-public/xmlpull/xmlpull/1.1.3.1/xmlpull-1.1.3.1.jar, /root/.m2/repository/xmlpull/xmlpull/1.1.3.1/xmlpull-1.1.3.1.jar]
2024-09-18T07:07:05.998+0000 [INFO] [org.gradle.internal.resource.transfer.DefaultCacheAwareExternalResourceAccessor] Found locally available resource with matching checksum: [http://172.20.0.2:8081/reposit
ory/maven-public/xpp3/xpp3_min/1.1.4c/xpp3_min-1.1.4c.jar, /root/.m2/repository/xpp3/xpp3_min/1.1.4c/xpp3_min-1.1.4c.jar]
2024-09-18T07:07:05.998+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Connection can be kept alive indefinitely
2024-09-18T07:07:05.999+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpResponseResource] Attempting to download resource http://172.20.0.2:8081/repository/maven-public/com/diffplug/durian/dur
ian-core/1.2.0/durian-core-1.2.0.jar.
2024-09-18T07:07:05.999+0000 [INFO] [org.gradle.internal.resource.transfer.DefaultCacheAwareExternalResourceAccessor] Downloading http://172.20.0.2:8081/repository/maven-public/com/diffplug/durian/durian-co
re/1.2.0/durian-core-1.2.0.jar to /tmp/gradle_download7437757401819609827bin
2024-09-18T07:07:06.001+0000 [DEBUG] [org.gradle.api.internal.artifacts.ivyservice.ivyresolve.CachingModuleComponentRepository] Downloaded artifact 'xmlpull-1.1.3.1.jar (xmlpull:xmlpull:1.1.3.1)' from resol
ver: maven
2024-09-18T07:07:06.002+0000 [DEBUG] [org.gradle.api.internal.artifacts.repositories.resolver.DefaultExternalResourceArtifactResolver] Loading http://172.20.0.2:8081/repository/maven-public/org/apache/commo
ns/commons-jcs-core/2.2.1/commons-jcs-core-2.2.1.jar
2024-09-18T07:07:06.002+0000 [DEBUG] [org.gradle.internal.resource.transfer.DefaultCacheAwareExternalResourceAccessor] Constructing external resource: http://172.20.0.2:8081/repository/maven-public/org/apac
he/commons/commons-jcs-core/2.2.1/commons-jcs-core-2.2.1.jar
2024-09-18T07:07:06.003+0000 [DEBUG] [org.gradle.api.internal.artifacts.ivyservice.ivyresolve.CachingModuleComponentRepository] Downloaded artifact 'xpp3_min-1.1.4c.jar (xpp3:xpp3_min:1.1.4c)' from resolver
: maven
2024-09-18T07:07:06.003+0000 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Resolve xpp3_min-1.1.4c.jar (xpp3:xpp3_min:1.1.4c)' completed
2024-09-18T07:07:06.003+0000 [DEBUG] [org.gradle.api.internal.artifacts.repositories.resolver.DefaultExternalResourceArtifactResolver] Loading http://172.20.0.2:8081/repository/maven-public/com/github/packa
ge-url/packageurl-java/1.1.1/packageurl-java-1.1.1.jar
2024-09-18T07:07:06.003+0000 [DEBUG] [org.gradle.internal.resource.transfer.DefaultCacheAwareExternalResourceAccessor] Constructing external resource: http://172.20.0.2:8081/repository/maven-public/com/gith
ub/package-url/packageurl-java/1.1.1/packageurl-java-1.1.1.jar
2024-09-18T07:07:06.006+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection [id: 11][route: {}->http://172.20.0.2:8081] can be kept alive indefinitely
2024-09-18T07:07:06.006+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-11: set socket timeout to 0
2024-09-18T07:07:06.006+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection released: [id: 11][route: {}->http://172.20.0.2:8081][total kept alive: 3; route allocated: 12
of 20; total allocated: 12 of 20]
2024-09-18T07:07:06.006+0000 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Download http://172.20.0.2:8081/repository/maven-public/com/diffplug/durian/durian-core/1.2
.0/durian-core-1.2.0.jar' completed
2024-09-18T07:07:06.008+0000 [DEBUG] [org.gradle.api.internal.artifacts.ivyservice.ivyresolve.CachingModuleComponentRepository] Downloaded artifact 'durian-core-1.2.0.jar (com.diffplug.durian:durian-core:1.
2.0)' from resolver: maven
2024-09-18T07:07:06.009+0000 [DEBUG] [org.gradle.api.internal.artifacts.repositories.resolver.DefaultExternalResourceArtifactResolver] Loading http://172.20.0.2:8081/repository/maven-public/com/vdurmont/sem
ver4j/3.1.0/semver4j-3.1.0.jar
2024-09-18T07:07:06.009+0000 [DEBUG] [org.gradle.internal.resource.transfer.DefaultCacheAwareExternalResourceAccessor] Constructing external resource: http://172.20.0.2:8081/repository/maven-public/com/vdur
mont/semver4j/3.1.0/semver4j-3.1.0.jar
2024-09-18T07:07:06.010+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpResourceAccessor] Constructing external resource: http://172.20.0.2:8081/repository/maven-public/com/github/package-url/
packageurl-java/1.1.1/packageurl-java-1.1.1.jar
2024-09-18T07:07:06.010+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpClientHelper] Performing HTTP GET: http://172.20.0.2:8081/repository/maven-public/com/github/package-url/packageurl-java
/1.1.1/packageurl-java-1.1.1.jar
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.client.protocol.RequestAddCookies] CookieSpec selected: default
2024-09-18T07:07:06.010+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpResourceAccessor] Constructing external resource: http://172.20.0.2:8081/repository/maven-public/com/vdurmont/semver4j/3
.1.0/semver4j-3.1.0.jar
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.client.protocol.RequestAuthCache] Auth cache not set in the context
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection request: [route: {}->http://172.20.0.2:8081][total kept alive: 3; route allocated: 12 of 20; to
tal allocated: 12 of 20]
2024-09-18T07:07:06.010+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpClientHelper] Performing HTTP GET: http://172.20.0.2:8081/repository/maven-public/com/vdurmont/semver4j/3.1.0/semver4j-3
.1.0.jar
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection leased: [id: 11][route: {}->http://172.20.0.2:8081][total kept alive: 2; route allocated: 12 of
 20; total allocated: 12 of 20]
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-11: set socket timeout to 30000
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-11: set socket timeout to 30000
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Executing request GET /repository/maven-public/com/github/package-url/packageurl-java/1.1.1/packageurl-java-1.1.1.jar HTT
P/1.1
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.client.protocol.RequestAddCookies] CookieSpec selected: default
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Target auth state: UNCHALLENGED
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Proxy auth state: UNCHALLENGED
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.client.protocol.RequestAuthCache] Auth cache not set in the context
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection request: [route: {}->http://172.20.0.2:8081][total kept alive: 2; route allocated: 12 of 20; to
tal allocated: 12 of 20]
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection leased: [id: 19][route: {}->http://172.20.0.2:8081][total kept alive: 1; route allocated: 12 of
 20; total allocated: 12 of 20]
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-19: set socket timeout to 30000
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-19: set socket timeout to 30000
2024-09-18T07:07:06.010+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Executing request GET /repository/maven-public/com/vdurmont/semver4j/3.1.0/semver4j-3.1.0.jar HTTP/1.1
2024-09-18T07:07:06.011+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Target auth state: UNCHALLENGED
2024-09-18T07:07:06.011+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Proxy auth state: UNCHALLENGED
2024-09-18T07:07:06.011+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Connection can be kept alive indefinitely
2024-09-18T07:07:06.011+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpResponseResource] Attempting to download resource http://172.20.0.2:8081/repository/maven-public/org/apache/velocity/vel
ocity-engine-core/2.2/velocity-engine-core-2.2.jar.
2024-09-18T07:07:06.012+0000 [INFO] [org.gradle.internal.resource.transfer.DefaultCacheAwareExternalResourceAccessor] Downloading http://172.20.0.2:8081/repository/maven-public/org/apache/velocity/velocity-
engine-core/2.2/velocity-engine-core-2.2.jar to /tmp/gradle_download564974171062713694bin
2024-09-18T07:07:06.016+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpResourceAccessor] Constructing external resource: http://172.20.0.2:8081/repository/maven-public/org/apache/commons/comm
ons-jcs-core/2.2.1/commons-jcs-core-2.2.1.jar
2024-09-18T07:07:06.016+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpClientHelper] Performing HTTP GET: http://172.20.0.2:8081/repository/maven-public/org/apache/commons/commons-jcs-core/2.
2.1/commons-jcs-core-2.2.1.jar
2024-09-18T07:07:06.016+0000 [DEBUG] [org.apache.http.client.protocol.RequestAddCookies] CookieSpec selected: default
2024-09-18T07:07:06.016+0000 [DEBUG] [org.apache.http.client.protocol.RequestAuthCache] Auth cache not set in the context
2024-09-18T07:07:06.016+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection request: [route: {}->http://172.20.0.2:8081][total kept alive: 1; route allocated: 12 of 20; to
tal allocated: 12 of 20]
2024-09-18T07:07:06.016+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection leased: [id: 15][route: {}->http://172.20.0.2:8081][total kept alive: 0; route allocated: 12 of
 20; total allocated: 12 of 20]
2024-09-18T07:07:06.016+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-15: set socket timeout to 30000
2024-09-18T07:07:06.016+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-15: set socket timeout to 30000
2024-09-18T07:07:06.016+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Executing request GET /repository/maven-public/org/apache/commons/commons-jcs-core/2.2.1/commons-jcs-core-2.2.1.jar HTTP/
1.1
2024-09-18T07:07:06.016+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Target auth state: UNCHALLENGED
2024-09-18T07:07:06.016+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Proxy auth state: UNCHALLENGED
2024-09-18T07:07:06.021+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection [id: 13][route: {}->http://172.20.0.2:8081] can be kept alive indefinitely
2024-09-18T07:07:06.021+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-13: set socket timeout to 0
2024-09-18T07:07:06.021+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection released: [id: 13][route: {}->http://172.20.0.2:8081][total kept alive: 1; route allocated: 12
of 20; total allocated: 12 of 20]
2024-09-18T07:07:06.022+0000 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Download http://172.20.0.2:8081/repository/maven-public/org/apache/velocity/velocity-engine
-core/2.2/velocity-engine-core-2.2.jar' completed
2024-09-18T07:07:06.024+0000 [DEBUG] [org.gradle.api.internal.artifacts.ivyservice.ivyresolve.CachingModuleComponentRepository] Downloaded artifact 'velocity-engine-core-2.2.jar (org.apache.velocity:velocit
y-engine-core:2.2)' from resolver: maven
2024-09-18T07:07:06.024+0000 [DEBUG] [org.gradle.api.internal.artifacts.repositories.resolver.DefaultExternalResourceArtifactResolver] Loading http://172.20.0.2:8081/repository/maven-public/commons-validato
r/commons-validator/1.7/commons-validator-1.7.jar
2024-09-18T07:07:06.024+0000 [DEBUG] [org.gradle.internal.resource.transfer.DefaultCacheAwareExternalResourceAccessor] Constructing external resource: http://172.20.0.2:8081/repository/maven-public/commons-
validator/commons-validator/1.7/commons-validator-1.7.jar
2024-09-18T07:07:06.029+0000 [DEBUG] [org.apache.http.impl.execchain.MainClientExec] Connection can be kept alive indefinitely
2024-09-18T07:07:06.029+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpResponseResource] Attempting to download resource http://172.20.0.2:8081/repository/maven-public/us/springett/cpe-parser
/2.0.2/cpe-parser-2.0.2.jar.
2024-09-18T07:07:06.029+0000 [INFO] [org.gradle.internal.resource.transfer.DefaultCacheAwareExternalResourceAccessor] Downloading http://172.20.0.2:8081/repository/maven-public/us/springett/cpe-parser/2.0.2
/cpe-parser-2.0.2.jar to /tmp/gradle_download62967553629928659bin
2024-09-18T07:07:06.029+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection [id: 18][route: {}->http://172.20.0.2:8081] can be kept alive indefinitely
2024-09-18T07:07:06.029+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-18: set socket timeout to 0
2024-09-18T07:07:06.029+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection released: [id: 18][route: {}->http://172.20.0.2:8081][total kept alive: 2; route allocated: 12
of 20; total allocated: 12 of 20]
2024-09-18T07:07:06.029+0000 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationRunner] Build operation 'Download http://172.20.0.2:8081/repository/maven-public/us/springett/cpe-parser/2.0.2/cpe-p
arser-2.0.2.jar' completed
2024-09-18T07:07:06.030+0000 [DEBUG] [org.gradle.api.internal.artifacts.ivyservice.ivyresolve.CachingModuleComponentRepository] Downloaded artifact 'cpe-parser-2.0.2.jar (us.springett:cpe-parser:2.0.2)' fro
m resolver: maven
2024-09-18T07:07:06.031+0000 [DEBUG] [org.gradle.api.internal.artifacts.repositories.resolver.DefaultExternalResourceArtifactResolver] Loading http://172.20.0.2:8081/repository/maven-public/commons-beanutil
s/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar
2024-09-18T07:07:06.031+0000 [DEBUG] [org.gradle.internal.resource.transfer.DefaultCacheAwareExternalResourceAccessor] Constructing external resource: http://172.20.0.2:8081/repository/maven-public/commons-
beanutils/commons-beanutils/1.9.4/commons-beanutils-1.9.4.jar
2024-09-18T07:07:06.033+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpResourceAccessor] Constructing external resource: http://172.20.0.2:8081/repository/maven-public/commons-validator/commo
ns-validator/1.7/commons-validator-1.7.jar
2024-09-18T07:07:06.033+0000 [DEBUG] [org.gradle.internal.resource.transport.http.HttpClientHelper] Performing HTTP GET: http://172.20.0.2:8081/repository/maven-public/commons-validator/commons-validator/1.
7/commons-validator-1.7.jar
2024-09-18T07:07:06.034+0000 [DEBUG] [org.apache.http.client.protocol.RequestAddCookies] CookieSpec selected: default
2024-09-18T07:07:06.034+0000 [DEBUG] [org.apache.http.client.protocol.RequestAuthCache] Auth cache not set in the context
2024-09-18T07:07:06.034+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection request: [route: {}->http://172.20.0.2:8081][total kept alive: 2; route allocated: 12 of 20; to
tal allocated: 12 of 20]
2024-09-18T07:07:06.034+0000 [DEBUG] [org.apache.http.impl.conn.PoolingHttpClientConnectionManager] Connection leased: [id: 18][route: {}->http://172.20.0.2:8081][total kept alive: 1; route allocated: 12 of
 20; total allocated: 12 of 20]
2024-09-18T07:07:06.034+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-18: set socket timeout to 30000
2024-09-18T07:07:06.034+0000 [DEBUG] [org.apache.http.impl.conn.DefaultManagedHttpClientConnection] http-outgoing-18: set socket timeout to 30000
2.2 使用ambari-env 一键解决环境准备问题

项目地址: ambari-env: Ambari+Bigtop 一站式编译和部署解决方案 (gitee.com)

Step1 配置直刷指定位置

在这里插入图片描述

Step2 统一的模板文件

在这里插入图片描述

Step3 编译前自动准备环境

在这里插入图片描述

在这里插入图片描述

TTBIGDATA
关注
专栏目录
【Bigtop编译】maven配置nexus私服提速
TTBIGDATA的博客
09-18 139
maven 配置私服提速
如何使用bigtop编译大数据组件？
runningandrunning的博客
06-12 1598
如何使用bigtop编译大数据组件
安装BigTop编译的Hive
zwahut的专栏
05-24 479
1、安装Hive 在hdp1 yum install hive #会安装以下包 Downloading packages: (1/3): hadoop-client-3.1.1-1.el7.x86_64.rpm (2/3): hive-...
bigtop gradle 任务依赖关系
wk022的专栏
06-25 246
其他的16个任务和hadoop-deb任务的依赖关系类似，只是将hadoop替换为对应的组件名称即可。./gradlew deb 会编译ubuntu的所有deb包。比如hadoop替换为zookeeper。
ambari+ bigtop 编译、打包、部署步骤总览
weixin_55010563的博客
08-07 989
而现在，可以在稍微知晓概念之后，直接找AI要Demo先跑起来，应用到代码中去，然后反向结合代码去问AI每一步实现的逻辑与理论，再消化成自己技能，也就是概念-》应用-》理论知识-》技能。启动之后，会在终端显示密码，还有加入集群的Token，待会在启动kibana时要用，如果不小心关掉了，可以在docker desktop中，找到es的容器日志找到。.Enrich.FromLogContext()：添加从日志上下文中丰富日志事件的能力，例如，可以自动地将关联的 HTTP 请求信息添加到日志中。
安装BigTop编译的Hadoop3.1.1版本过程记录
zwahut的专栏
05-24 1792
本文记录安装编译后的rpm包的过程，主要是在不同主机上分配好需要安装的服务，使用yum命令安装，然后修改对应的配置文件，最后启动服务即可。 1、前期准备 主要包括主机的设置方面，配置主机名、IP和主机名映射、关闭防火墙等 #关闭防火墙 hostnamectl set-hostname hdp1 #修改主机名 172.16.25.139 hdp1 172.16.25.140 hdp2 17...
BigTop3.2.0 大数据组件编译--基础环境准备
m0_48319997的博客
11-25 3821
bigtop大数据组件编译分为三个部分1.操作系统准备2.编译工具准备3.组件编译本章先说环境准备。
BigTop3.2.0 大数据组件编译--组件编译
m0_48319997的博客
11-29 5103
接上篇环境准备，环境准备好以后就可以开始bigtop大数据组件编译了，建议使用科学上网方式，降低网络连接报错，主要网络报错出现在nodejs npm yarn bower等前端资源的下载上。搞定网络问题后，按本文的方式可以完成大数据相关组件的编译，编译后生成的rpm包在output目录中，包含源码rpm和二进制rpm。
gradle编译、打包时跳过test测试
热门推荐
Jim~LoveQ的博客
06-21 1万+
gradle编译、打包时跳过test测试 单单使用gradle build的时候会把测试类的方法也一起编译执行，这样就会导致一些测试数据会保存在DB中，为了避免这个情况出现，需要在编译或者打包时候跳过test的方法，使用以下的命令： gradle build -x test 更加详细的情况请参考这篇文章：https://www.jianshu.com/p/61c5d163a4c9 ...
Bigtop-Manager 是一个用于管理 Bigtop 组件的平台
02-27
5. **构建和部署工具**：如Maven、Gradle等，用于编译、测试和打包应用。 6. **示例或模板**：供用户参考和快速入门。 了解并掌握Bigtop-Manager的使用，不仅可以提升大数据集群的管理效率，还可以加深对大数据生态...
bigtop
03-19
Bigtop是一个用于开发Apache Hadoop生态系统的打包和测试的项目。 Bigtop的主要目标是围绕Hadoop相关项目的打包和互操作性测试建立一个社区。这包括社区开发的各个级别的测试（打包，平台，运行时，升级等），重点是...
bigtop:Apache Bigtop的镜像
03-07
Apache Bigtop的主要目标是围绕Apache Hadoop相关项目的打包和互操作性测试建立一个社区。 这包括社区开发的各个级别的测试（打包，平台，运行时，升级等），重点是整个系统，而不是单个项目。 立即开始BigTop的...
Apache Bigtop在AdMaster中的应用.pdf
10-14
* after 1.0：使用 Gradle 进行编译，使用 puppet 解决依赖。 Apache Bigtop vs. CDH package： * Bigtop：提供了一个高度可定制化的解决方案，满足不同的业务需求。 * CDH package：提供了一个完整的 Hadoop 生态...
Centos挂载和删除nfs
wd520521的博客
09-14 488
Centos挂载和删除nfs
CentOS 入门
最新发布
qq_64272546的博客
09-14 1298
CentOS 自由开源操作系统，广泛应用于服务器和开发环境。作为一名初学者，掌握 CentOS 的基本操作和常用命令是非常重要的。
CentOS详细解析及其配置方法
sheenboy的博客
09-14 857
CentOS，作为一款基于Red Hat Enterprise Linux（RHEL）源代码构建的开源类服务器操作系统，自发布以来，凭借其卓越的稳定性、安全性和易用性，在企业级Linux发行版中占据了重要地位。以下是对CentOS的详细解析及其配置方法的全面介绍。
图片转换之heic转jpg(使用ImageMagick)
总钻风
07-22 2276
安装路径没要求，安装时候记得勾选“Install legacy utilities (e.g. convert)”解决：查找了一些博文，可以用软件解决。这里我还是习惯性看下java -- 也是简单的借助exe转换图片格式。安装成功后，这个命令就可以测试图片转换了。magick支持90多种图片格式，喜欢的可以自己去看,常用的都有。选择ImageMagick-7.XX-Q16-HDRI-x64-dll.exe下载。分析：现在就是解决小图预览的问题（大图用wps可以看）安装成功，cmd可以测试。
Java-网络
2301_81543552的博客
09-14 708
Java中的网络编程主要涉及使用Socket类进行网络通信，以及理解各种网络协议。以下是一些关键概念和示例代码，帮助您入门。
ambari+bigtop大数据平台安装部署指南
07-27
Ambari是Apache软件基金会下的一个子项目，是一个开源的管理和监控Hadoop集群的工具。而Bigtop是一个Apache软件基金会下的开源项目，主要用于构建，测试和部署大数据平台。 Ambari Bigtop大数据平台安装部署指南主要包括以下几个步骤： 1. 准备工作：在开始安装之前，需要确保系统已经安装了合适的操作系统和相关的依赖软件，如Java、SSH等。此外，还需要确定网络环境是否能够正常访问所需的软件源和资源。 2. 下载和安装Ambari：从Ambari官方网站上下载适用于目标操作系统的Ambari软件包。安装Ambari时，需要注意选择合适的数据库和用户认证方式。 3. 配置Ambari服务器：根据实际需求，对Ambari服务器进行配置。一般需要设置主机名和端口号等基本信息，并选择适当的安装选项。 4. 启动Ambari服务器：启动Ambari服务器后，可以通过浏览器访问Ambari web界面，并使用默认的用户名和密码登录。登录成功后，可以进行集群的配置和管理。 5. 创建集群：使用Ambari web界面创建新的集群。在创建集群时，需要指定集群的名称，选择合适的Hadoop分发版本和相应的服务组件。 6. 配置集群：根据需要，配置集群中各个节点的主机名、IP地址、SSH访问等信息，并为各个服务组件分配合适的角色。 7. 安装集群：在配置完成后，可以开始安装集群。Ambari会自动根据所选的服务组件和配置要求，安装相应的软件包并启动服务。 8. 部署集群：安装完成后，可以对集群进行进一步的配置和优化。可以为各个服务组件设置参数，并在需要时添加额外的节点和组件。 9. 监控和管理：Ambari提供了丰富的监控和管理功能，可以用于实时监控集群的运行状态、性能参数等。还可以进行服务的启停、组件的升级等操作。 10. 测试和维护：在部署完成后，还需要进行一些测试和维护工作。可以运行一些测试工具对集群进行测试，以确保其正常运行。同时，定期进行安全和性能优化等维护工作也是非常重要的。 通过遵循Ambari Bigtop大数据平台安装部署指南，用户可以快速搭建和部署大数据平台，实现集群的管理和监控，为大数据处理提供便利和支持。
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值