Convert PySpark RDD to DataFrame
In PySpark, toDF() function of the RDD is used to convert RDD to DataFrame. We…
0 Comments
August 14, 2020
PySpark Create DataFrame with Examples
You can manually create a PySpark DataFrame using toDF() and createDataFrame() methods, both these function…
January 12, 2020
PySpark withColumnRenamed to Rename Column on DataFrame
Use PySpark withColumnRenamed() to rename a DataFrame column, we often need to rename one column…
January 11, 2020
Convert Spark RDD to DataFrame | Dataset
While working in Apache Spark with Scala, we often need to Convert Spark RDD to…
August 22, 2019
Spark withColumnRenamed to Rename Column
In Spark withColumnRenamed() is used to rename one column or multiple DataFrame column names. Depends…
February 27, 2019
Spark SQL “case when” and “when otherwise”
Like SQL "case when" statement and Swith statement from popular programming languages, Spark SQL Dataframe also supports similar syntax using "when otherwise" or we can also use "case when" statement.
February 5, 2019
Spark Create DataFrame with Examples
In Spark, createDataFrame() and toDF() methods are used to create a DataFrame manually, using these…
February 1, 2019