Spark SQL – How to Remove Duplicate Rows
Duplicate rows could be remove or drop from Spark SQL DataFrame using distinct() and dropDuplicates()…
4 Comments
December 25, 2019
Spark – Add New Column & Multiple Columns to DataFrame
Adding a new column or multiple columns to Spark DataFrame can be done using withColumn(),…
December 25, 2019
Spark SQL – Add row number to DataFrame
The row_number() is a window function in Spark SQL that assigns a row number (sequential integer number)…
December 25, 2019
Photo by Dimon Blr on Unsplash
Spark Window Functions with Examples
Spark Window functions are used to calculate results such as the rank, row number e.t.c…
December 25, 2019
Photo by Alex Kotliarskyi on Unsplash
Spark SQL Aggregate Functions
Spark SQL provides built-in standard Aggregate functions defines in DataFrame API, these come in handy…
December 25, 2019
Spark SQL – Get Distinct Multiple Columns
In this Spark SQL tutorial, you will learn different ways to get the distinct values…
December 24, 2019
Spark SQL – Count Distinct from DataFrame
In this Spark SQL tutorial, you will learn different ways to count the distinct values…
December 24, 2019
Spark Epoch time to timestamp and Date
In this Spark article, you will learn how to convert or cast Epoch time to…
December 24, 2019
Spark SQL – Working with Unix Timestamp
In this Spark article, you will learn how to convert or cast the DataFrame column…
December 24, 2019
Spark convert Unix timestamp (seconds) to Date
In this article, you will learn how to convert Unix timestamp (in seconds) as a…
December 23, 2019
- Go to the previous page
- 1
- …
- 181
- 182
- 183
- 184
- 185
- 186
- 187
- …
- 196
- Go to the next page