Spark Load CSV File into RDD
In this tutorial, I will explain how to load a CSV file into Spark RDD…
6 Comments
November 24, 2019
Spark – Read multiple text files into single RDD?
Spark core provides textFile() & wholeTextFiles() methods in SparkContext class which is used to read…
November 23, 2019
Spark – How to create an empty RDD?
We often need to create empty RDD in Spark, and empty RDD can be created…
November 21, 2019
Convert Spark RDD to DataFrame | Dataset
While working in Apache Spark with Scala, we often need to Convert Spark RDD to…
August 22, 2019
Photo by Deva Darshan on Unsplash
Different ways to create Spark RDD
Spark RDD can be created in several ways, for example, It can be created by…
February 4, 2019
Create a Spark RDD using Parallelize
Let's see how to create Spark RDD using sparkContext.parallelize() method and using Spark shell and…
December 4, 2018