sqoop 导数

hive 导出mysql

sqoop export --connect "jdbc:mysql://****" --username "aaa" --password "bbb" --table a
--export-dir "/user/hive/warehouse/adl.db/ --input-fields-terminated-by '\001' --update-key bp_emper --update-mode allowinsert -m 1

上面这种方式只适合导textfile表，parquet表可能会报错

ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.DatasetNotFoundException: Descriptor location does not exist: hdfs://cdhdev01:8020/user/hive/warehouse/adl.db/a_bf_marketer_dtl/dt=20190731/.metadata
org.kitesdk.data.DatasetNotFoundException: Descriptor location does not exist: hdfs://cdhdev01:8020/user/hive/warehouse/adl.db/a_bf_marketer_dtl/dt=20190731/.metadata
    at org.kitesdk.data.spi.filesystem.FileSystemMetadataProvider.checkExists(FileSystemMetadataProvider.java:562)
 

改为

/usr/bin/sqoop export --connect "jdbc:mysql:/" --username "aa" --password "aa" --table a_bf_marketer_dtl --hcatalog-database adl --hcatalog-table a_bf_marketer_dtl