sqoop配置好后,使用下面这条命令列出mysql数据库中sqoop库中的所有表,成功,说明链接mysql数据库是没有问题的
[grid@rhel0 ~]$ sqoop list-tables --connect jdbc:mysql://localhost:3306/sqoop --username sqoop -P
Warning: /usr/lib/hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Enter password:
14/09/25 21:08:40 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
demo_blog
demo_log
但接下来的一幕让我震精了,使用同样的链接字符串从mysql向hdfs导入一张表却出现链接被拒绝的异常:
[grid@rhel0 ~]$sqoop import --connect jdbc:mysql://localhost:3306/sqoop --username sqoop -P --table demo_blog
Warning: /usr/lib/hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Enter password:
14/09/25 21:11:07 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
14/09/25 21:11:07 INFO tool.CodeGenTool: Beginning code generation
14/09/25 21:11:07 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `demo_blog` AS t LIMIT 1
14/09/25 21:11:07 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `demo_blog` AS t LIMIT 1
14/09/25 21:11:07 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/hadoop-2.4.1
Note: /tmp/sqoop-grid/compile/bd4958cfadb8d7c2df3adabf176076cc/demo_blog.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
14/09/25 21:11:10 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-grid/compile/bd4958cfadb8d7c2df3adabf176076cc/demo_blog.jar
14/09/25 21:11:10 WARN manager.MySQLManager: It looks like you are importing from mysql.
14/09/25 21:11:10 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
14/09/25 21:11:10 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
14/09/25 21:11:10 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
14/09/25 21:11:10 INFO mapreduce.ImportJobBase: Beginning import of demo_blog
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hbase-0.94.22/lib/slf4j-log4j12-1.4.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
14/09/25 21:11:11 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
14/09/25 21:11:12 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
14