一、将数据从mysql导入 HDFS
sqoop import --connect jdbc:mysql://192.168.76.1:3306/workflow --username root --password a --table project
报错
tool.ImportTool: Encountered IOException running import job: java.io.IOException: No columns to generate for ClassWriter
分析: jdbc驱动问题,注意: mysql版本及jdbc驱动版本
请使用 mysql-connector-java-5.1.46.jar, 将它复制到 sqoop/lib下.
日志分析
19/07/31 21:27:17 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `project` AS t LIMIT 1
19/07/31 21:27:17 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `project` AS t LIMIT 1
19/07/31 21:27:17 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/local/hadoop275
Note: /tmp/sqoop-root/compile/904dde1997bf14585ed20790f49bf50f/project.java uses or overrides a deprecated API.
Note: Recompile with -Xlint: