an amazingly funny piece of code
Jul. 30th, 2016 07:42 pm![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png)
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/util/ClosureCleaner.scala
So, spark gets a function to apply to data (e.g. in foreach, or in filter). Before running it, it (like a raccoon) cleans the function.
Enjoy the nice reading.
ClosureCleaner
So, spark gets a function to apply to data (e.g. in foreach, or in filter). Before running it, it (like a raccoon) cleans the function.
Enjoy the nice reading.