oracle错误码1115,sqoop 常见错误以及处理方式

Oracle: Connection Reset Errors

11/05/26 16:23:47 INFO mapred.JobClient: Task Id : attempt_201105261333_0002_m_000002_0, Status : FAILED

java.lang.RuntimeException: java.lang.RuntimeException: java.sql.SQLRecoverableException: IO Error: Connection reset

at com.cloudera.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:164)

at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)

at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)

at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:605)

at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322)

at org.apache.hadoop.mapred.Child$4.run(Child.java:268)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:396)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1115)

at org.apache.hadoop.mapred.Child.main(Child.java:262)

Caused by: java.lang.RuntimeException: java.sql.SQLRecoverableException: IO Error: Connection reset

at com.cloudera.sqoop.mapreduce.db.DBInputFormat.getConnection(DBInputFormat.java:190)

at com.cloudera.sqoop.mapreduce.db.DBInputFormat.setConf(DBInputFormat.java:159)

... 9 more

这个问题的产生原因是由于缺少一个生成随机数的设备

找到 $JAVA_HOME/jre/lib/security目录下的java.security文件

修改securerandom.source=file:/dev/../dev/urandom

Oracle: Case-Sensitive Catalog Query Errors

下面是错误代码

1/09/21 17:18:49 INFO manager.OracleManager: Time zone has been set to

GMT

11/09/21 17:18:49 DEBUG manager.SqlManager: Using fetchSize for next

query: 1000

11/09/21 17:18:49 INFO manager.SqlManager: Executing SQL statement:

SELECT t.* FROM addlabel_pris t WHERE 1=0

11/09/21 17:18:49 DEBUG manager.OracleManager$ConnCache: Caching

released connection for jdbc:oracle:thin:

11/09/21 17:18:49 ERROR sqoop.Sqoop: Got exception running Sqoop:

java.lang.NullPointerException

java.lang.NullPointerException

at com.cloudera.sqoop.hive.TableDefWriter.getCreateTableStmt(TableDefWriter.java:148)

at com.cloudera.sqoop.hive.HiveImport.importTable(HiveImport.java:187)

at com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:362)

at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:423)

at com.cloudera.sqoop.Sqoop.run(Sqoop.java:144)

at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)

at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:180)

at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:219)

at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:228)

at com.cloudera.sqoop.Sqoop.main(Sqoop.java:237)

解决方式：

用户名和表名全用大写

Oracle: ORA-00933 error (SQL command not properly ended)

如果没有指定的话，sqoop会默认使用oracle.jdbc.OracleDriver

Omit选项 --driver oracle.jdbc.driver.OracleDriver 然后重新提交

MySQL: Import of TINYINT(1) from MySQL behaves strangely

jdbc会把tinyint(1)认为是java.sql.Types.BIT,然后sqoop就会转为Boolean了，悲剧吧

解决方法：

在连接上加上一句话tinyInt1isBit=false

jdbc:mysql://localhost/test?tinyInt1isBit=false

另一种解决方式是

hive使用 --map-column-hive foo=tinyint

非hive使用--map-column-java foo=integer