1、从mysql抽数到hive,hive表为parquet存储格式,导入语句为:
sqoop import
–connect jdbc:mysql://${MYSQL_HOST}😒{MYSQL_PORT}/sx_channel?tinyInt1isBit=false
–username ${MYSQL_USER}
–password ${MYSQL_PSW}
–table $1
–columns $3
–hive-delims-replacement “”
–hive-table test.$2
–hive-partition-key part_dt
–hive-partition-value ‘2019-05-13’
–hive-import
–hive-overwrite
–delete-target-dir
–as-parquetfile
–m 1
–null-string ‘\N’
–null-non-string ‘\N’
报错:
19/05/13 17:33:04 ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.ValidationException: Dataset name test.xiaoneng_improt is not alphanumeric (plus '_')
org.kitesdk.data.ValidationException: Dataset name test.xiaoneng_improt is not alphanumeric (plus '_')
at org.kitesdk.data.ValidationException.check(ValidationException.j