zhuwentaolove的专栏

The default HDFS block size is 128 MB. So you cannot read one line here, one line there. You always read and write 128 MB blocks. This is fine when you want to process the whole file. But it makes HDF...

InputFormat提供了两个方法：getSplits实现分片规则，createRecordReader读取数据规则K,V public abstract List<InputSplit> getSplits(JobContext context ) throws IOException, Interr...

1从srcnamenode获取到block的信息，2去dest addblock信息，3判断block进行拷贝，拷贝判断是不是同一个datanode，如果是进行硬链接拷贝。否进行复制数据LocatedBlock存放文件的block信息，通过DatanodeInfo[] getLocations()获取包含了文件所在的DatanodeInfoDatanodeInfo中包...

1开启事务 ，同一个事务会共享要给session，request 引用+1，执行完毕，released引用-12如果是没有开启事务的话，每一次执行都会关闭session3如果没有开启事务，一个线程查询两次可能不是同个session/*** Checks if {@code SqlSession} passed as an argument is managed by S...