草稿
文章平均质量分 55
j3smile
专注于分布式计算、数据挖掘。坚韧平和,不浮躁。
展开
-
hadoop修改权限问题
core-site.xml106 107 #jiangmingyan@2012.07.26 for sqoop uses mjiang form remote node108 109 hadoop.proxyuser.oozie.groups110 mjiang111 Allow the superuser oozie to impersonate any memb原创 2012-08-10 15:04:31 · 2609 阅读 · 0 评论 -
20120820
hive> load data inpath '/fenxi_system/r_fx_daily_all/stat_time=20120612/000000_0' overwrite into table r_fx_daily_all partition(stat_time='20120612'); FAILED: Parse Error: line 1:0 character ' ' n原创 2012-08-20 15:32:45 · 3252 阅读 · 0 评论 -
20120817
6:28hive> from r_fx_daily_all > insert into table r_fx_period_all partition(stat_time='20120807') > select user_name,1,sum(sms_send_count),1,1,1,1,1,1,1,1,1,1,1,1 > group by原创 2012-08-17 18:23:54 · 742 阅读 · 0 评论 -
ubuntu下hive安装
hadoophive版本0.9.0下载hive0.9.0版本:http://mirror.bjtu.edu.cn/apache/hive/hive-0.9.0/解压 tar zxvf hive-0.9.0.tar.gz配置:$$ $HADOOP_HOME/bin/hadoop fs -mkdir /tmp$$ $HADOOP_HOME/bin/hadoop原创 2012-08-17 13:49:14 · 1704 阅读 · 0 评论 -
record
````````````````5:15xxxxxxxxxxxxx select user_name,task_id,send_time,count(uid) from s_sms group by user_name,task_id,send_time; >>re ;xxxxxxxxxxxxx select user_name,task_id,send_time,count原创 2012-08-14 17:12:08 · 2492 阅读 · 0 评论 -
record
11111111111tipsinsert into table r_fx_period_all partition(stat_time='{CURRENT_DATE}')`````````````3:47 Context Line Control -A NUM, --after-context=NUM Print NUM line原创 2012-08-13 10:48:51 · 649 阅读 · 0 评论 -
hadoop多个模式的安全转换
1:确保不同模式在HDFS下有不同的文件存储位置所有配置文件都在conf下,只需修改其下的配置即可默认配置在find ./ -name core-default.xml src/core/core-default.xml1)file:///home/mjiang/hadoop-1.0.0/docs/core-default.htmlhadoop.t原创 2012-08-10 11:39:18 · 453 阅读 · 0 评论 -
hadoop1.0.3 源码通过svn导入eclipse
svn插件安装版本与eclipse不对应重新ant原创 2012-08-10 15:20:01 · 1956 阅读 · 0 评论 -
20120815
`````````````````????insert overwrite table t_calc_sms_ex_base partition(stat_time='20120807')select /*+mapjoin(b)*/a.user_name,b.camp_id,b.project_id,b.camp_type,a.send_time,a.mobile,a.sms_bill原创 2012-08-15 15:05:07 · 1902 阅读 · 0 评论