maven配置Hadoop环境

最新推荐文章于 2024-06-04 23:55:28 发布

weixin_34067049

最新推荐文章于 2024-06-04 23:55:28 发布

阅读量540

点赞数

文章标签：大数据 java python

原文链接：https://my.oschina.net/yuhangyes/blog/3013650

版权

2019独角兽企业重金招聘Python工程师标准>>>

项目需求，开始自学Hadoop。首先新建Java项目，maven导入Hadoop依赖包就发现问题，经过一番研究发现，无法在aliyun和central镜像库中成功下载，也可能这只是我们公司网络问题。最后发现一可用镜像库。现将配置pom分享如下。

<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
  <modelVersion>4.0.0</modelVersion>
  <groupId>com.me</groupId>
  <artifactId>hadoop</artifactId>
  <version>0.0.1-SNAPSHOT</version>
  <description>		</description>
  <properties> 
  	<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
  </properties>
/*可用镜像库*/
  <repositories>  
   <repository>  
     <id>repo2</id>  
     <name>Maven Repository Switchboard</name>  
     <layout>default</layout>  
     <url >http://repo2.maven.org/maven2</url>  
     <snapshots>  
       <enabled>false</enabled>  
     </snapshots>  
   </repository>  
</repositories>
  
<dependencies>
<dependency>
        <groupId>junit</groupId>
        <artifactId>junit</artifactId>
        <version>3.8.1</version>
        <scope>test</scope>
  </dependency>

  <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-hdfs</artifactId>
      <version>2.6.0</version>
  </dependency>

  <dependency>  
      <groupId>org.apache.hadoop</groupId>  
      <artifactId>hadoop-client</artifactId>  
      <version>2.6.0</version>  
  </dependency> 

  <dependency>
      <groupId>org.apache.hadoop</groupId>
      <artifactId>hadoop-common</artifactId>
      <version>2.6.0</version>
  </dependency>
  <!-- https://mvnrepository.com/artifact/jdk.tools/jdk.tools -->
<dependency>
    <groupId>jdk.tools</groupId>
    <artifactId>jdk.tools</artifactId>
    <version>1.7</version>
    <scope>system</scope>
    <systemPath>${JAVA_HOME}/lib/tools.jar</systemPath>
</dependency>
  
</dependencies>	

  <build> 
  	<plugins>
  		<plugin>
  			<groupId>org.apache.maven.plugins</groupId>
  			<artifactId>maven-compiler-plugin</artifactId>
  			<version>3.1</version>
  			<configuration>
  				<source>1.7</source>
 				<target>1.7</target>
  			</configuration>
  		</plugin>
  	</plugins>
  </build>
</project>

转载于:https://my.oschina.net/yuhangyes/blog/3013650