Spark Persistence Storage Levels
All different persistence (persist() method) storage level Spark/PySpark supports are available at org.apache.spark.storage.StorageLevel and pyspark.StorageLevel classes respectively. The storage level specifies how and where to persist or cache a Spark/PySpark RDD, DataFrame,…
2 Comments
April 10, 2020