SparkSQL写入MySQL的时候,主键ID重复
原代码:
spark.sql("select '"+UUID.randomUUID()+"' as ID, MEASUREPOINT_ID, SAMPLETIME from table")
改:
spark.sql("select regexp_replace(java_method('java.util.UUID','randomUUID'),'-','') as ID, MEASUREPOINT_ID, SAMPLETIME from table")
产生UUID : java_method(‘java.util.UUID’,‘randomUUID’)
HIveSQL替换函数:regexp_replace(已产生的UUID, ‘-’ , ’ ’ ) // 把UUID中的 - 去掉