Failed to get broadcast_0_piece0 of broadcast_0

在运行多个程序时，每个程序都建立了自己的sparkContext.

运行了几个之后会出现：
java.io.IOException: org.apache.spark.SparkException: Failed to get broadcast_0_piece0 of broadcast_0

在一个外国网站上找到了相关的解释

In my case, this issue was happening when spark context doesn't close successfully. When spark context closes abruptly, the files in spark-local and spark-worker directories are left uncleaned. The next time any job is run, the broadcast exception occurs. I managed a workaround by redirecting spark-worker and spark-local outputs to specific folders and cleaning them up in case the spark context doesn't close successfully.

大概就是上一个程序sparkContect没有关闭，就打开了另一个

解决方法就是把它关掉，在程序的最后加上sc.stop()就可以了