用Maven构建Mahout开发环境 环境

用Maven构建Mahout开发环境

环境：

• 
  
• Apache Maven 3.3.3
  
• Java version: 1.7.0_75
  
• Default locale: en_US,     platform encoding: UTF-8
  
• OS name:Red Hat Enterprise     Linux 7 64-bit
  
• hadoop 2.6.0 分布式集群
  
• Mahout 0.10.0
  
• Eclipse：eclipse-java-luna-SR2-linux-gtk-x86_64
  

Eclipseeclipse-java-luna-SR2-linux-gtk-x86_64IDE for Java Developers Version: LunaService Release 2 (4.4.2)

步骤：

1. 用Maven创建一个标准化的Java项目

2. 导入项目到eclipse

3. 增加mahout依赖，修改pom.xml

4. 下载依赖

1). 用Maven创建一个标准化的Java项目

[hadoop@hadoopworkspace]$ pwd

/home/hadoop/workspace

[hadoop@hadoopworkspace]$ mvn archetype:generate-DarchetypeGroupId=org.apache.maven.archetypes -DgroupId=org.conan.mymahout-DartifactId=myMahout -DpackageName=org.conan.mymahout -Dversion=1.0-SNAPSHOT-DinteractiveMode=false

[hadoop@hadoopworkspace]$ cd myMahout

[hadoop@hadoopmyMahout]$ mvn clean install

2). 导入项目到eclipse

我们创建好了一个基本的maven项目，然后导入到eclipse中。 这里我们最好已安装好了Maven的插件。

File-->Impot-->Maven-->Existing Maven Projects

3). 增加mahout依赖，修改pom.xml

这里我使用hadoop-2.6版本，修改文件：pom.xml

1. <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
   
2.   xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
   
3.   <modelVersion>4.0.0</modelVersion>
   
4.   <groupId>org.conan.mymahout</groupId>
   
5.   <artifactId>myMahout</artifactId>
   
6.   <packaging>jar</packaging>
   
7.   <version>1.0-SNAPSHOT</version>
   
8.   <name>myMahout</name>
   
9.   <url>http://maven.apache.org</url>
   
10.   <properties>
    
11.         <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
    
12.         <mahout.version>0.10.0</mahout.version>
    
13.   </properties>
    
14.   
    
15.   <dependencies>
    
16.   <dependency>
    
17.       <groupId>junit</groupId>
    
18.       <artifactId>junit</artifactId>
    
19.       <version>3.8.1</version>
    
20.       <scope>test</scope>
    
21.     </dependency>
    
22.   <dependency>
    
23.     <groupId>org.apache.mahout</groupId>
    
24.     <artifactId>mahout-math</artifactId>
    
25.     <version>${mahout.version}</version>
    
26. </dependency>
    
27. <dependency>
    
28.     <groupId>org.apache.mahout</groupId>
    
29.     <artifactId>mahout-hdfs</artifactId>
    
30.     <version>${mahout.version}</version>
    
31. </dependency>
    
32.     <dependency>
    
33.                 <groupId>org.apache.hadoop</groupId>
    
34.                 <artifactId>hadoop-client</artifactId>
    
35.                 <version>2.6.0</version>
    
36.         </dependency>
    
37.         <dependency>
    
38.                 <groupId>org.apache.hadoop</groupId>
    
39.                 <artifactId>hadoop-common</artifactId>
    
40.                 <version>2.6.0</version>
    
41.         </dependency>
    
42.         <dependency>
    
43.                 <groupId>org.apache.hadoop</groupId>
    
44.                 <artifactId>hadoop-hdfs</artifactId>
    
45.                 <version>2.6.0</version>
    
46.         </dependency>
    
47. </dependencies>
    
48. </project>

复制代码

4). 配置完后mvn clean install

或Eclipse中RunAs-->Maven Build

在Goals：中设置参数clean install

相应的依赖包自动下载到本地库：/home/hadoop/.m2/repository

1. [INFO] Scanning for projects...
   
2. [INFO]                                                                        
   
3. [INFO] ------------------------------------------------------------------------
   
4. [INFO] Building myMahout 1.0-SNAPSHOT
   
5. [INFO] ------------------------------------------------------------------------
   
6. [INFO]
   
7. [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ myMahout ---
   
8. [INFO] Deleting /home/hadoop/workspace/myMahout/target
   
9. [INFO]
   
10. [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ myMahout ---
    
11. [INFO] Using 'UTF-8' encoding to copy filtered resources.
    
12. [INFO] skip non existing resourceDirectory /home/hadoop/workspace/myMahout/src/main/resources
    
13. [INFO]
    
14. [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ myMahout ---
    
15. [INFO] Changes detected - recompiling the module!
    
16. [INFO] Compiling 1 source file to /home/hadoop/workspace/myMahout/target/classes
    
17. [INFO]
    
18. [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ myMahout ---
    
19. [INFO] Using 'UTF-8' encoding to copy filtered resources.
    
20. [INFO] skip non existing resourceDirectory /home/hadoop/workspace/myMahout/src/test/resources
    
21. [INFO]
    
22. [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ myMahout ---
    
23. [INFO] Changes detected - recompiling the module!
    
24. [INFO] Compiling 1 source file to /home/hadoop/workspace/myMahout/target/test-classes
    
25. [INFO]
    
26. [INFO] --- maven-surefire-plugin:2.12.4:test (default-test) @ myMahout ---
    
27. [INFO] Surefire report directory: /home/hadoop/workspace/myMahout/target/surefire-reports
    
28. 
    
29. -------------------------------------------------------
    
30. T E S T S
    
31. -------------------------------------------------------
    
32. Running org.conan.mymahout.AppTest
    
33. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.029 sec
    
34. 
    
35. Results :
    
36. 
    
37. Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
    
38. 
    
39. [INFO]
    
40. [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ myMahout ---
    
41. [INFO] Building jar: /home/hadoop/workspace/myMahout/target/myMahout-1.0-SNAPSHOT.jar
    
42. [INFO]
    
43. [INFO] --- maven-install-plugin:2.4:install (default-install) @ myMahout ---
    
44. [INFO] Installing /home/hadoop/workspace/myMahout/target/myMahout-1.0-SNAPSHOT.jar to /root/.m2/repository/org/conan/mymahout/myMahout/1.0-SNAPSHOT/myMahout-1.0-SNAPSHOT.jar
    
45. [INFO] Installing /home/hadoop/workspace/myMahout/pom.xml to /root/.m2/repository/org/conan/mymahout/myMahout/1.0-SNAPSHOT/myMahout-1.0-SNAPSHOT.pom
    
46. [INFO] ------------------------------------------------------------------------
    
47. [INFO] BUILD SUCCESS
    
48. [INFO] ------------------------------------------------------------------------
    
49. [INFO] Total time: 7.451 s
    
50. [INFO] Finished at: 2015-06-11T03:53:35-04:00
    
51. [INFO] Final Memory: 23M/56M
    
52. [INFO] ------------------------------------------------------------------------
    
53. 
    

复制代码

参考：用Maven构建Mahout项目

http://blog.fens.me/hadoop-mahout-maven-eclipse/

maven常用命令介绍

http://www.cnblogs.com/adolfmc/archive/2012/07/31/2616908.html

pom.xml配置：

http://mahout.apache.org/general/downloads.html