hive中MultiDelimitSerDe类的详细使用以及注意事项

hive中MultiDelimitSerDe类的详细使用

Introduction

Introduced in HIVE-5871, MultiDelimitSerDe allows user to specify multiple-character string as the field delimiter when creating a table.

Version

Hive 0.14.0 and later.

Hive QL Syntax

You can use MultiDelimitSerDe in a create table statement like this:

CREATE TABLE test (
id string,
hivearray array<binary>,
hivemap map<string,int>) 
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.MultiDelimitSerDe'                  
WITH SERDEPROPERTIES ("field.delim"="[,]","collection.delim"=":","mapkey.delim"="@");

where field.delim is the field delimiter, collection.delim and mapkey.delim is the delimiter for collection items and key value pairs, respectively.

HIVE-20619 moved MultiDelimitSerDe to hive.serde2 in release 4.0.0, so user won’t have to install hive-contrib JAR into the HiveServer2 auxiliary directory.

Limitations

• Among the delimiters, field.delim is mandatory and can be of multiple characters, whilecollection.delim and mapkey.delim is optional and only support single character.
• Nested complex type is not supported, e.g. an Array.
• To use MultiDelimitSerDe prior to Hive release 4.0.0, you have to add the hive-contrib jar to the class path, e.g. with the add jar command.

使用注意事项

field.delim	can be of multiple characters
collection.delim	only support single character
mapkey.delim	only support single character