For example, the following Sqoop invocation for import can be specified alternatively as shown below:
$ sqoop import –connect jdbc:mysql://localhost/db –username foo –table TEST
$ sqoop –options-file /users/homer/work/import.txt –table TEST
where the options file /users/homer/work/import.txt contains the following:
import
--connect
jdbc:mysql://localhost/db
--username
举例 将sqoop语句写到脚本文件/opt/datas/sqoop-import-hdfs.txt里
bin/sqoop import \
--connect jdbc:mysql://hadoop-CDH:3306/test \
--username root \
--password 123456 \
--table my_user \
--target-dir /user/sqoop/imp_my_user \
--num-mappers 1
改为:
import
--connect
jdbc:mysql://hadoop-CDH:3306/test
--username
root
--password
123456
--table
my_user
--target-dir
/user/sqoop/imp_my_user
--num-mappers
1
然后执行bin/sqoop –options-file /opt/datas/sqoop-import-hdfs.txt
shellscript
## step 1
load data ...
## step 2
bin/hive -f XXX.sql
## step 3
bin/sqoop --options-file /opt/datas/sqoop-import-hdfs.txt