Skip to content
  • Home
  • About
  • Write For US
|       { One stop for all Spark Examples }
Spark by {Examples}
  • Spark
    • Spark RDD
    • Spark DataFrame
    • Spark SQL Functions
    • What’s New in Spark 3.0?
    • Spark Streaming
    • Apache Spark Interview Questions
  • PySpark
  • Pandas
  • Hive
  • Kafka
  • H2O.ai
  • Interview Q
    • Spark Interview Questions
  • More
    • Apache Hadoop
    • Apache HBase
    • Apache Cassandra
    • Snowflake Database
    • H2O Sparkling Water
    • Scala Language
    • Python NumPy
    • R Language
Menu Close
  • Spark
    • Spark RDD
    • Spark DataFrame
    • Spark SQL Functions
    • What’s New in Spark 3.0?
    • Spark Streaming
    • Apache Spark Interview Questions
  • PySpark
  • Pandas
  • Hive
  • Kafka
  • H2O.ai
  • Interview Q
    • Spark Interview Questions
  • More
    • Apache Hadoop
    • Apache HBase
    • Apache Cassandra
    • Snowflake Database
    • H2O Sparkling Water
    • Scala Language
    • Python NumPy
    • R Language
  • Home
  • About
  • Write For US
Read more about the article PySpark When Otherwise | SQL Case When Usage
PySpark

PySpark When Otherwise | SQL Case When Usage

PySpark When Otherwise and SQL Case When on DataFrame with Examples - Similar to SQL and programming languages, PySpark supports a way to check multiple conditions in sequence and returns…

0 Comments
August 15, 2020
Read more about the article PySpark withColumn() Usage with Examples
PySpark

PySpark withColumn() Usage with Examples

PySpark withColumn() is a transformation function of DataFrame which is used to change the value, convert the datatype of an existing column, create a new column, and many more. In…

3 Comments
June 20, 2020
Read more about the article PySpark withColumnRenamed to Rename Column on DataFrame
PySpark

PySpark withColumnRenamed to Rename Column on DataFrame

Use PySpark withColumnRenamed() to rename a DataFrame column, we often need to rename one column or multiple (or all) columns on PySpark DataFrame, you can do this in several ways.…

16 Comments
January 11, 2020
Read more about the article Spark – Add New Column & Multiple Columns to DataFrame
Apache Spark

Spark – Add New Column & Multiple Columns to DataFrame

Adding a new column or multiple columns to Spark DataFrame can be done using withColumn(), select(), map() methods of DataFrame, In this article, I will explain how to add a…

3 Comments
December 25, 2019
Read more about the article Spark DataFrame withColumn
Apache Spark

Spark DataFrame withColumn

Spark withColumn() is a DataFrame function that is used to add a new column to DataFrame, change the value of an existing column, convert the datatype of a column, derive…

9 Comments
February 28, 2019
Read more about the article Spark withColumnRenamed to Rename Column
Apache Spark

Spark withColumnRenamed to Rename Column

In Spark withColumnRenamed() is used to rename one column or multiple DataFrame column names. Depends on the DataFrame schema, renaming columns might get simple to complex, especially when a column…

0 Comments
February 27, 2019
Read more about the article Spark SQL “case when” and “when otherwise”
Apache Spark

Spark SQL “case when” and “when otherwise”

Like SQL "case when" statement and Swith statement from popular programming languages, Spark SQL Dataframe also supports similar syntax using "when otherwise" or we can also use "case when" statement.

8 Comments
February 5, 2019

Categories

  • Apache Hadoop
  • Apache Spark
  • Apache Spark Streaming
  • Apache Kafka
  • Apache HBase
  • Apache Cassandra
  • Snowflake Database
  • H2O Sparkling Water
  • PySpark

Recent Posts

  • R dplyr filter() – Subset DataFrame Rows
  • R Subset Data Frame by Column Value & Name
  • R Subset data frame with Examples
  • R subset() Function – Get Rows & Columns
  • R Select Rows with Examples
  • Select Rows with Row Names in R
  • Select Rows based on Column Value in R
  • Select Rows by Index in R with Examples
  • R Select Rows by Condition with Examples
Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy

About SparkByExamples.com

SparkByExamples.com is a Big Data and Spark examples community page, all examples are simple and easy to understand, and well tested in our development environment Read more ..
Copyright sparkbyexamples.com