`

SparkException: Failed to get broadcast (TorrentBroadcast)

 
阅读更多
https://issues.apache.org/jira/browse/SPARK-5594
Do you write sth like:
object XXX {
val sc = new SparkContext()
def main {
rdd.map
{ someFunc() }
}
def someFunc{}
}
Our user meet the same exception because make the sparkContext as static variable instead of a local variable.
分享到:
评论

相关推荐

Global site tag (gtag.js) - Google Analytics