2014.6.15总结

在跳转访问数据库时，一直报 数据库链接错误，url null

配置N次，更换connector版本均无效

后来查看代码，发现问题在MyDataModel.java文件中

    //dataModel = new MySQLJDBCDataModel(DataBaseUtil.getDataSource(),"movie_preferences", "userID", "movieID","preference");
    //dataModel = new MySQLJDBCDataModel(DataBaseUtil.getDataSource(),"movie_preferences", "userID", "movieID","preference", null);
     dataModel = new MySQLJDBCDataModel(dataSource,"movie_preferences", "userID", "movieID","preference", null);//Modified at 6.11 for reason of "null url"

修改之后链接数据库成功，但是处理时间太长，造成页面响应时间过长，接下来需要处理！

2014.6.15

window下中文乱码，文本转换

iconv -c -f gb2312 -t utf-8 log.txt>users.rat

-c:忽略无效字符

2014.6.24

运行HdfsDAO之hdfs.copyFile("movie/movie_preferences.txt", "/tmp/new");

hdfs.ls("/tmp/new");

1\org,apache.commons.configuration.Configuration :class not found

百度原因：hadoop版本与hadoop eclipse 插件匹配问题

实际解决：发现该类在lib下的commons-configuration-1.6.jar中，将lib下jar包全部include

测试成功：输出结果

copy from: movie/movie_preferences.txt to /tmp/new
ls: /tmp/new
==========================================================
name: hdfs://127.0.0.1:9000/tmp/new, folder: false, size: 11553456
==========================================================