Spark SQL datediff()
Spark SQL provides datediff() function to get the difference between two timestamps/dates. In this article, Let us see a Spark…
Spark SQL provides datediff() function to get the difference between two timestamps/dates. In this article, Let us see a Spark…
Spark array_contains() is an SQL Array function that is used to check if an element value is present in an…
Spark SQL collect_list() and collect_set() functions are used to create an array (ArrayType) column on DataFrame by merging rows, typically…
In this Spark article, I will explain how to convert an array of String column on DataFrame to a String…
Spark SQL provides split() function to convert delimiter separated String to array (StringType to ArrayType) column on Dataframe. This can…
Spark SQL provides a slice() function to get the subset or range of elements from an array (subarray) column of…
Using concat() or concat_ws() Spark SQL functions we can concatenate one or more DataFrame columns into a single column, In…
The row_number() is a window function in Spark SQL that assigns a row number (sequential integer number) to each row in the…
Spark Window functions are used to calculate results such as the rank, row number e.t.c over a range of input…
Spark SQL provides built-in standard Aggregate functions defines in DataFrame API, these come in handy when we need to make…