向Hbase插入时,报错java.lang.IllegalArgumentException: KeyValue size too large的解决办法
使用configuration对象修改此配置
“hbase.client.keyvalue.maxsize”: “524288000”
完整配置:
conf = {“hbase.zookeeper.quorum”: host, “hbase.mapred.outputtable”: table,
“mapreduce.outputformat.class”: “org.apache.hadoop.hbase.mapreduce.TableOutputFormat”,
“mapreduce.job.output.key.class”: “org.apache.hadoop.hbase.io.ImmutableBytesWritable”,
“hbase.client.keyvalue.maxsize”: “524288000”,
“mapreduce.job.output.value.class”: “org.apache.hadoop.io.Writable”}