loxeed的博客

原创 解决ValueError: Some of types cannot be determined by the first 100 rows, please try again with sampli

在spark中试图将RDD转换成DataFrame时，有时会提示ValueError: Some of types cannot be determined by the first 100 rows, please try again with sampling，此时有2种解决方案：一是提高数据采样率(sampling ratio)，二是显示声明要创建的DataFrame的数据结构，即schema