Spark SQL Inner Join with Example
Spark SQL Inner join is the default join in and it’s mostly used, this joins two DataFrame/Datasets on key columns, where keys don’t match the rows get dropped from both datasets.…
0 Comments
January 12, 2021
Spark SQL Self Join With Example
In this article, I will explain Spark SQL Self Join (Joining DataFrame to itself) with Scala Example. Joins are not complete without a self join, though there is no self-join…
January 12, 2021
Spark SQL Left Outer Join with Example
Spark SQL Left Outer Join (left, left outer, left_outer) join returns all rows from the left DataFrame regardless of match found on the right Dataframe, when join expression doesn’t match, it…
January 12, 2021
Spark SQL Left Anti Join with Example
When you join two DataFrame using Left Anti Join (left, left anti, left_anti), it returns only columns from the left DataFrame for non-matched records. In this Spark article, I will explain…
January 12, 2021
Spark SQL Left Semi Join Example
Spark Left Semi Join (semi, left semi, left_semi) is similar to inner join difference being left semi-join returns all columns from the left DataFrame/Dataset and ignores all columns from the right dataset. In other…
January 12, 2021
Spark SQL Right Outer Join with Example
Spark SQL Right Outer Join returns all rows from the right DataFrame regardless of math found on the left DataFrame, when the join expression doesn’t match, it assigns null for…
January 12, 2021
Spark SQL Full Outer Join with Example
Spark SQL Full Outer Join (outer, full,fullouter, full_outer) returns all rows from both DataFrame/Datasets, where join expression doesn’t match it returns null on respective columns. In this Spark article, I…
January 12, 2021