Spark Kill Running Application or Job?

Spark running application can be kill by issuing "yarn application -kill <application id>" CLI command, we can also stop the running spark application in different ways, it all depends on…

0 Comments

August 29, 2020

Apache Spark / PySpark

Spark Web UI – Understanding Spark Execution

Apache Spark provides a suite of Web UI/User Interfaces (Jobs, Stages, Tasks, Storage, Environment, Executors, and SQL) to monitor the status of your Spark/PySpark application, resource consumption of Spark cluster,…

5 Comments

August 2, 2020