ZZJXP的博客

package com.shujia.MapReduce;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.fs.FileSystem;import org.apache.hadoop.fs.Path;import org.apache.hadoop.io.IntWritable;import org.apache.hadoop.io.LongWritable;import org.apache.hado.

[root@master ~]# mv score.txt /usr/local/soft/data[root@master ~]# cd /usr/local/soft/data[root@master data]# lsnew_db.sql student.sql theZen.txtscore.sql students.txt wordcountscore.txt theZenOfPython.txt words.txt[root@master .

解析： 输入输出格式化的类map端处理完会先写到环形缓冲区，100M,80%溢写磁盘时会分区（哈希分区），排序（快速排序）合并（归并排序）//// Source code recreated from a .class file by IntelliJ IDEA// (powered by FernFlower decompiler)//package org.apache.hadoop.mapred.lib;import org.apache.hadoop.clas...

Java基本类型 Writable 序列化大小(字节) 布尔型（boolean） BooleanWritable 1 字节型（byte） ByteWritable 1 整型（int） IntWritable 4 VIntWritable ...

q

[root@master packages]# cd ..[root@master soft]# ls0?? hadoop-2.7.6 redis shell01 zookeeper-3.4.6A?? jdk1.8.0_171 redis-6.2.6 showdata packages shell test.txt[root@master soft]# cd zookeeper-3.4.6/[root@master zookeeper-.

package com.shijia.HDFS;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.fs.FileSystem;import org.apache.hadoop.fs.Path;import java.io.IOException;public class Demo01TestAPI { public static void main(String[] args) throws I.

[root@master ~]# hdfs dfs -ls /Found 4 itemsdrwxr-xr-x - root supergroup 0 2022-03-21 18:41 /testHDFSshell1drwxr-xr-x - root supergroup 0 2022-03-21 18:46 /testHDFSshell2drwxr-xr-x - root supergroup 0 2022-03-21 18:46 .

[root@master ~]# cd /usr/local/soft[root@master soft]# lsdata packages redis-6.2.6 shell01 test.txtjdk1.8.0_171 redis shell show[root@master soft]# ssh masterLast login: Mon Mar 21 16:34:46 2022 from fe80::e938:d89b:966:b6...