1、pom问题记录
[ERROR] /Users/bingdada/recproj/recommend-offline/spark-etl/src/main/scala/com/meituan/recommend/etl/package.scala:6: error: object mobile is not a member of package com.meituan
[ERROR] import com.meituan.mobile.service.recommend.modules.ranker.utils.{FeatureTranslator, MultiFeatureIDUtil}
[ERROR] ^
[ERROR] /Users/bingdada/recproj/recommend-offline/spark-etl/src/main/scala/com/meituan/recommend/etl/package.scala:62: error: not found: value utils
[ERROR] val unusefeatureSet = sc.broadcast(utils.get_unusefeature(unusefeature))
[ERROR] ^
[ERROR] /Users/bingdada/recproj/recommend-offline/spark-etl/src/main/scala/com/meituan/recommend/etl/package.scala:102: error: not found: value utils
[ERROR] utils.delete_hdfs_path(save_path)
[ERROR] ^
[ERROR] /Users/bingdada/recproj/recommend-offline/spark-etl/src/main/scala/com/meituan/recommend/etl/package.scala:104: error: not found: value utils
[ERROR] val featureMapBroadcast = sc.broadcast(utils.get_feature_mapping(feature_mapping))
[ERROR] ^
[ERROR] /Users/bingdada/recproj/recommend-offline/spark-etl/src/main/scala/com/meituan/recommend/etl/package.scala:108: error: not found: type MultiFeatureIDUtil
[ERROR] val featureIDUtil = new MultiFeatureIDUtil(featureMap)
[ERROR] ^
[WARNING] three warnings found
[ERROR] 5 errors found
后来发现 com.meituan.mobile.service.recommend.modules.ranker.utils.{FeatureTranslator, MultiFeatureIDUtil} 这个类所在的模块就没有加入pom文件,是其他项目源代码贴在这个包里来着。
2、maven在执行过程中抛错:
引用... was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced -> [Help 1]
(这个是在编译机器配置上加的,而自己调用服务时不能修改;向服务方反映问题后服务方更换maven找仓库顺序就好了)
原因就是有些jar包没有完全下载完成,在编译的时候找不到jar包。只需要在配置文件中增加一个更新策略<updatePolicy>always</updatePolicy>就可以了。
找到你的conf/setting.xml
引用
<profile>
<id>nexus</id>
<!--Enable snapshots for the built in central repo to direct -->
<!--all requests to nexus via the mirror -->
<repositories>
<repository>
<id>central</id>
<url>http://central</url>
<releases><enabled>true</enabled><updatePolicy>always</updatePolicy></releases>
<snapshots><enabled>true</enabled><updatePolicy>always</updatePolicy></snapshots>
</repository>
</repositories>
<pluginRepositories>
<pluginRepository>
<id>central</id>
<url>http://central</url>
<releases><enabled>true</enabled><updatePolicy>always</updatePolicy></releases>
<snapshots><enabled>true</enabled><updatePolicy>always</updatePolicy></snapshots>
</pluginRepository>
</pluginRepositories>
</profile>