Spark Cast String Type to Integer Type (int)
In Spark SQL, in order to convert/cast String Type to Integer Type (int), you can…
3 Comments
March 12, 2021
PySpark Convert String Type to Double Type
In PySpark SQL, using the cast() function you can convert the DataFrame column from String…
Comments Off on PySpark Convert String Type to Double Type
March 12, 2021
Spark select() vs selectExpr() with Examples
Spark SQL select() and selectExpr() are used to select the columns from DataFrame and Dataset,…
August 29, 2020
Pyspark – Get substring() from a column
The PySpark substring() function extracts a portion of a string column in a DataFrame. It…
August 28, 2020
PySpark – Cast Column Type With Examples
In PySpark, you can cast or change the DataFrame column data type using cast() function…
August 14, 2020
Spark – How to Change Column Type?
To change the Spark SQL DataFrame column type from one data type to another data…
November 12, 2019
Spark SQL – Add Day, Month, and Year to Date
Spark DataFrame example of how to add a day, month and year to a Date column using Scala language and Spark SQL Date and Time functions.
July 27, 2019