Spark Types of Tables and Views
Apache Spark & PySpark supports SQL natively through Spark SQL API which allows us to run SQL queries by creating tables and views on top of DataFrame. In this article,…
0 Comments
November 29, 2022
Spark Web UI – Understanding Spark Execution
Apache Spark provides a suite of Web UI/User Interfaces (Jobs, Stages, Tasks, Storage, Environment, Executors, and SQL) to monitor the status of your Spark/PySpark application, resource consumption of Spark cluster,…
August 2, 2020