duplicate rows

PySpark distinct() transformation is used to drop/remove the duplicate rows (all columns) from DataFrame and…