Spark foreachPartition vs foreach | what to use?
In Spark foreachPartition() is used when you have a heavy initialization (like database connection) and wanted to initialize once per partition where as foreach() is used to apply a function…
0 Comments
August 24, 2020