1. could only be written to 0 of the 1 minReplication nodes. There are 14 datanode(s) running and no node(s) are excluded in this operation
表象是磁盘不够、网络不稳定,是yarn的jar包副本为10,在ambari中修改副本为2,问题解决
2. hive使用decimal的时候会出现Error evaluating _col0,可以改成double
3. AssertionError: Index is not populated for 28
元数据和数据没有对应上
4. IndexOutOfBoundsException: Index: 0, Size: 0
join后面的类型要一致
5. FileNotFoundException: File does not exist: /warehouse/tablespace/external/hive/dw_test.db/ods_user_enterprise_wechat_external_user_hh/ds=20201209/000001_0
两个任务同时执行,一个任务在读文件、一个在写文件、导致文件找不到
6. hive3问题:
Can't parse input data
表的格式不对
字段没有对应
分隔符的原因