sqoop从mysql到hive实现定时增量导入

整理自网络，其中有自己遇到的问题及解决方法。

• 1.第一次全量抽取，并创建hive表

sqoop import --connect jdbc:mysql://localhost:3306/test --username xxx --password xxx --direct --fields-terminated-by '\t' --target-dir /data/sqoop/shop --delete-target-dir --hive-import --hive-overwrite --hive-database shop --hive-table order --create-hive-table --query 'SELECT d.id,d.order_id,d.order_no,o.member_id,o.member_name,o.pay_status,o.pay_time,o.order_status,o.order_time,o.is_admin_order,o.source,o.ip_address,d.shop_id,ca2.id kz_id,ca2.category_name kz_name,ca1.id km_id,ca1.category_name km_name,d.category_id,d.goods_id,d.goods_type,d.goods_name,d.goods_sale_price,d.goods_num,d.goods_date FROM ec_order_detail d left join ec_order o on o.id = d.order_id LEFT JOIN ec_category ca ON ca.id = d.category_id LEFT JOIN ec_category ca1 ON ca1.id = ca.parentid LEFT JOIN ec_category ca2 ON ca2.id = ca1.parentid WHERE $CONDIT