java
司马看山
人生苦短,我用python
展开
-
Java----一维数组
package javacore;import java.util.Arrays;public class DataList { public static void main(String[] args) { //定义数组 int[] a = new int[100]; for (int i = 0; i < 100; i++) { a[i] = i; System.out.println原创 2021-01-15 21:19:16 · 75 阅读 · 0 评论 -
Java-变量定义
package javacore;public class VarExplain { public static void main(String[]args){ //变量初始化 int vacationDays = 12; double salary = 650000; System.out.println("假期天数:"+vacationDays+" , 工资是: "+salary); //常量,final定义的原创 2021-01-15 20:34:08 · 92 阅读 · 0 评论 -
Java-数据类型说明
package javacore;public class PrimitiveTypes { public static void main(String[] args){ System.out.println("整型数据说明:-----------------------------------------"); //Int 最大最小值 System.out.println("Int 最大值是: "+Integer.MAX_VALUE);原创 2021-01-15 20:12:39 · 55 阅读 · 0 评论 -
KeyValueTextInputFormat使用案例
(1)输入数据banzhang ni haoxihuan hadoop banzhangbanzhang ni haoxihuan hadoop banzhang(2)期望结果数据banzhang 2xihuan 2代码实现(1)编写Mapper类package MRS.kv;import java.io.IOException;import org.apache.hadoop.io.IntWritable;import org.apache.hadoop.io.Text;i原创 2020-12-22 22:40:29 · 79 阅读 · 0 评论 -
大数据开发之Mapper Reduce序列化案例实操
统计每一个手机号耗费的总上行流量、下行流量、总流量(1)输入数据1 13736230513 192.196.100.1 www.atguigu.com 2481 24681 2002 13846544121 192.196.100.2 264 0 2003 13956435636 192.196.100.3 132 1512 2004 13966251146 192.168.100.1 240 0 4045 18271575951 192.168.100.2 www.atg.原创 2020-12-21 23:45:38 · 201 阅读 · 0 评论 -
大数据开发之MapperReduce WordCount案例实操
在给定的文本文件中统计输出每一个单词出现的总次数输入数据atguigu atguiguss sscls clsjiaobanzhangxuehadoop按照MapReduce编程规范,分别编写Mapper,Reducer,Driver3.编写Mapper类package MRS;import org.apache.hadoop.io.IntWritable;import org.apache.hadoop.io.LongWritable;import org.apac原创 2020-12-21 22:14:50 · 286 阅读 · 0 评论 -
大数据开发之HDFS文件上传
把本地文件上传到HDFS根目录 @Test public void putFileToHDFS() throws URISyntaxException, IOException, InterruptedException { //获取文件系统 Configuration conf = new Configuration(); FileSystem fs = FileSystem.get(new URI("hdfs://hadoop1:9000"原创 2020-12-20 23:55:53 · 237 阅读 · 0 评论 -
大数据开发之HDFS的I/O流操作-文件下载
从HDFS上下载banhua.txt文件到本地package HDFS;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.fs.FSDataInputStream;import org.apache.hadoop.fs.FileSystem;import org.apache.hadoop.fs.Path;import org.apache.hadoop.io.IOUtils;import org....原创 2020-12-20 23:44:17 · 132 阅读 · 0 评论 -
大数据开发之Hdfs文件基本操作API
import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.fs.FileSystem;import org.apache.hadoop.fs.Path;import org.junit.Test;import java.io.IOException;import java.net.URI;import java.net.URISyntaxException;public class HdfsClient {原创 2020-12-20 19:58:39 · 84 阅读 · 0 评论 -
大数据之ZooKeeper API应用
配置POM文件 <dependency> <groupId>org.apache.zookeeper</groupId> <artifactId>zookeeper</artifactId> <version>3.6.2</version> </dependency> <dependen原创 2020-12-19 10:22:01 · 78 阅读 · 1 评论 -
KeyValueTextInputFormat使用案例
package kvalues;import org.apache.hadoop.io.LongWritable;import org.apache.hadoop.io.Text;import org.apache.hadoop.mapreduce.Mapper;import java.io.IOException;public class KVTextMapper extends Mapper<Text,Text, Text, LongWritable> { LongW原创 2020-12-13 11:37:12 · 95 阅读 · 0 评论 -
2020-12-09
package hdfsdemo;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.fs.FSDataOutputStream;import org.apache.hadoop.fs.FileSystem;import org.apache.hadoop.fs.Path;import org.apache.hadoop.io.IOUtils;import org.junit.Test;import ja原创 2020-12-13 11:33:21 · 71 阅读 · 0 评论 -
HADOOP-HDFS-文件上传
package hdfsdemo;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.fs.FileSystem;import org.apache.hadoop.fs.Path;import java.io.IOException;import java.net.URI;import java.net.URISyntaxException;import org.junit.Test;public c原创 2020-12-09 22:38:53 · 127 阅读 · 0 评论