Skip to content
  • Home
  • About
  • Write For US
|         *** Please Subscribe for Ad Free & Premium Content ***
Spark By {Examples}
  • Log in
  •  | 
  • Join for Ad Free
  • Spark
    • Spark RDD
    • Spark DataFrame
    • Spark SQL Functions
    • What’s New in Spark 3.0?
    • Spark Streaming
    • Apache Spark on AWS
    • Apache Spark Interview Questions
  • PySpark
  • Pandas
  • R
    • R Programming
    • R Data Frame
    • R dplyr Tutorial
    • R Vector
  • Snowflake
  • Hive
  • ML
  • Inter Q
    • Spark Interview Questions
    • MongoDB Interview Questions
    • Machine Learning Interview Questions
  • More
    • AWS
    • Python
    • MongoDB
    • Apache Kafka
    • H2O.ai
    • Apache Hadoop
    • NumPy
    • Apache HBase
    • Apache Cassandra
    • H2O Sparkling Water
    • Scala Language
  • Toggle website search
Menu Close
  • Spark
    • Spark RDD
    • Spark DataFrame
    • Spark SQL Functions
    • What’s New in Spark 3.0?
    • Spark Streaming
    • Apache Spark on AWS
    • Apache Spark Interview Questions
  • PySpark
  • Pandas
  • R
    • R Programming
    • R Data Frame
    • R dplyr Tutorial
    • R Vector
  • Snowflake
  • Hive
  • ML
  • Inter Q
    • Spark Interview Questions
    • MongoDB Interview Questions
    • Machine Learning Interview Questions
  • More
    • AWS
    • Python
    • MongoDB
    • Apache Kafka
    • H2O.ai
    • Apache Hadoop
    • NumPy
    • Apache HBase
    • Apache Cassandra
    • H2O Sparkling Water
    • Scala Language
  • Toggle website search
  • Home
  • About
  • Write For US
Read more about the article Convert PySpark RDD to DataFrame
PySpark

Convert PySpark RDD to DataFrame

In PySpark, toDF() function of the RDD is used to convert RDD to DataFrame. We would need to convert RDD to DataFrame as DataFrame provides more advantages over RDD. For…

0 Comments
August 14, 2020
Read more about the article PySpark – Create DataFrame with Examples
PySpark

PySpark – Create DataFrame with Examples

You can manually create a PySpark DataFrame using toDF() and createDataFrame() methods, both these function takes different signatures in order to create DataFrame from existing RDD, list, and DataFrame. You…

4 Comments
January 12, 2020
Read more about the article PySpark withColumnRenamed to Rename Column on DataFrame
PySpark

PySpark withColumnRenamed to Rename Column on DataFrame

Use PySpark withColumnRenamed() to rename a DataFrame column, we often need to rename one column or multiple (or all) columns on PySpark DataFrame, you can do this in several ways.…

23 Comments
January 11, 2020
Read more about the article Convert Spark RDD to DataFrame | Dataset
Apache Spark / Apache Spark RDD

Convert Spark RDD to DataFrame | Dataset

While working in Apache Spark with Scala, we often need to Convert Spark RDD to DataFrame and Dataset as these provide more advantages over RDD. For instance, DataFrame is a…

4 Comments
August 22, 2019
Read more about the article Spark withColumnRenamed to Rename Column
Apache Spark

Spark withColumnRenamed to Rename Column

In Spark withColumnRenamed() is used to rename one column or multiple DataFrame column names. Depends on the DataFrame schema, renaming columns might get simple to complex, especially when a column…

0 Comments
February 27, 2019
Read more about the article Spark SQL “case when” and “when otherwise”
Apache Spark

Spark SQL “case when” and “when otherwise”

Like SQL "case when" statement and Swith statement from popular programming languages, Spark SQL Dataframe also supports similar syntax using "when otherwise" or we can also use "case when" statement.

9 Comments
February 5, 2019
Read more about the article Spark Create DataFrame with Examples
Apache Spark

Spark Create DataFrame with Examples

In Spark, createDataFrame() and toDF() methods are used to create a DataFrame manually, using these methods you can create a Spark DataFrame from already existing RDD, DataFrame, Dataset, List, Seq…

7 Comments
February 1, 2019

Top Tutorials

  • Apache Spark Tutorial
  • PySpark Tutorial
  • Python Pandas Tutorial
  • R Programming Tutorial
  • Python NumPy Tutorial
  • Apache Hive Tutorial
  • Apache HBase Tutorial
  • Apache Cassandra Tutorial
  • Apache Kafka Tutorial
  • Snowflake Data Warehouse Tutorial
  • H2O Sparkling Water Tutorial

Categories

  • Apache Spark
  • PySpark
  • Pandas
  • R Programming
  • Snowflake Database
  • NumPy
  • Apache Hive
  • Apache HBase
  • Apache Kafka
  • Apache Cassandra
  • H2O Sparkling Water

Legal

  • Privacy Policy
  • Refund Policy
  • Terms of Use

About SparkByExamples.com

SparkByExamples.com is a Big Data and Spark examples community page, all examples are simple and easy to understand, and well tested in our development environment Read more ..
  • Opens in a new tab
  • Opens in a new tab
  • Opens in a new tab
  • Opens in a new tab
  • Opens in a new tab
[email protected]
+1 (949) 345-0676
Desert Bloom
Irvine, CA 92618
USA
Copyright 2023 www.SparkByExamples.com. All rights reserved.