Spark SQL datediff()
Spark SQL provides datediff() function to get the difference between two timestamps/dates. In this article,…
Comments Off on Spark SQL datediff()
December 8, 2022
Spark array_contains() example
Spark array_contains() is an SQL Array function that is used to check if an element…
August 28, 2020
Spark – Working with collect_list() and collect_set() functions
Spark SQL collect_list() and collect_set() functions are used to create an array (ArrayType) column on…
August 27, 2020
Spark – Convert array of String to a String column
In this Spark article, I will explain how to convert an array of String column…
July 14, 2020
Spark split() function to convert string to Array column
Spark SQL provides split() function to convert delimiter separated String to array (StringType to ArrayType)…
April 22, 2020
Spark – How to slice an array and get a subset of elements
Spark SQL provides a slice() function to get the subset or range of elements from…
Comments Off on Spark – How to slice an array and get a subset of elements
April 22, 2020
Spark – How to Concatenate DataFrame columns
Using concat() or concat_ws() Spark SQL functions we can concatenate one or more DataFrame columns…
January 21, 2020
Spark SQL – Add row number to DataFrame
The row_number() is a window function in Spark SQL that assigns a row number (sequential integer number)…
December 25, 2019
Photo by Dimon Blr on Unsplash
Spark Window Functions with Examples
Spark Window functions are used to calculate results such as the rank, row number e.t.c…
December 25, 2019
Photo by Alex Kotliarskyi on Unsplash
Spark SQL Aggregate Functions
Spark SQL provides built-in standard Aggregate functions defines in DataFrame API, these come in handy…
December 25, 2019
- 1
- 2
- 3
- 4
- 5
- Go to the next page