BidData
树深时见鹿_ic
这个作者很懒,什么都没留下…
展开
-
HBaseAPI
HBase的API:HBaseUtilspublic class HBaseUtils { private static Logger logger = LoggerFactory.getLogger(HBaseUtils.class); public static Admin getAdmin() { Configuration conf = HBaseCo...原创 2019-10-24 13:54:30 · 344 阅读 · 0 评论 -
MapReduce二次排序及自定义Writable
package MapReducer05;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.fs.Path;import org.apache.hadoop.io.*;import org.apache.hadoop.mapreduce.Job;import org.apache.hadoop.ma...原创 2019-09-04 19:02:32 · 110 阅读 · 0 评论 -
MapReduce倒排索引及Combiner
package MapReducer05;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.fs.Path;import org.apache.hadoop.io.*;import org.apache.hadoop.mapreduce.Job;import org.apache.hadoop.ma...原创 2019-09-04 21:03:43 · 125 阅读 · 0 评论 -
MapReduce自定义分组比较器
package MapReducer05;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.fs.Path;import org.apache.hadoop.io.*;import org.apache.hadoop.mapreduce.Job;import org.apache.hadoop.ma...原创 2019-09-05 08:53:09 · 683 阅读 · 0 评论 -
MapReduce多Job串联及Partitioner
数据:Input:name hwl chinese 100 math 100 english 55name lh chinese 99 math 45 english 54name zs chinese 52 math 95 english 51name bb chinese 96 math 89 english 57name lk chinese 71 math 60 english...原创 2019-09-05 19:52:18 · 121 阅读 · 1 评论 -
MapReduce的map端join和reduce端join
MapReduce的map端join和reduce端join原创 2019-09-05 20:00:23 · 176 阅读 · 0 评论 -
MapReduce结合MySQL(实现从MySQL读写数据)
需求统计stu每个年龄段人数,将结果写入stu_res表数据stu表:stu_res表:代码MySQLTest.javapackage mapReduceTest;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.io.*;import org.apache.hadoop.mapred...原创 2019-09-08 08:56:52 · 693 阅读 · 0 评论 -
MapReduce结合MongoDB(实现从MongoDB读写数据)
需求统计students每个年龄段人数,将结果写入res数据students集:res集:代码MongoDBTest.java:package MapReduce07;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.io.IntWritable;import org.apache.h...原创 2019-09-08 15:04:35 · 494 阅读 · 1 评论