[url]https://issues.apache.org/jira/browse/SPARK-5594[/url]
Do you write sth like:
object XXX {
val sc = new SparkContext()
def main {
rdd.map
{ someFunc() }
}
def someFunc{}
}
Our user meet the same exception because make the sparkContext as static variable instead of a local variable.
Do you write sth like:
object XXX {
val sc = new SparkContext()
def main {
rdd.map
{ someFunc() }
}
def someFunc{}
}
Our user meet the same exception because make the sparkContext as static variable instead of a local variable.