PySpark parallelize() – Create RDD from a list data

PySpark parallelize() is a function in SparkContext and is used to create an RDD from a list collection. In this article, I will explain the usage of parallelize to create…

2 Comments

August 13, 2020

Apache Spark / Apache Spark RDD

Create a Spark RDD using Parallelize

Let's see how to create Spark RDD using parallelize with sparkContext.parallelize() method and using Spark shell and Scala example. Before we start let me explain what is RDD, Resilient Distributed…

27 Comments

December 4, 2018