Spark – Initial job has not accepted any resources; check your cluster UI
After setting up a new Spark cluster running on Yarn, I've come across an error…
0 Comments
September 8, 2020
java.io.IOException: org.apache.spark.SparkException: Failed to get broadcast_0_piece0 of broadcast_0
While running spark jobs, you may come across java.io.IOException: org.apache.spark.SparkException: Failed to get broadcast_0_piece0 of broadcast_0 error with below stack trace. This error occurs when you try to create multiple spark contexts. In another case, when I tried to crate SparkContext and Streamingcontext from scratch I was getting this error. Below is the code how to create StreamingContext from existing Sparkcontext.
January 31, 2019
Cassandra : java.lang.RuntimeException: Unable to gossip with any peers
If you are getting below exception while setting up Cassandra cluster, please follow below steps…
January 4, 2019
WARNING: “HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX.
Are you getting WARNING: "HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX. ? for every command you issue on a cluster, follow below step to resolve it.
December 9, 2018
Incompatible clusterIDs error in datanode logs
When your datanodes are not starting due to java.io.IOException: Incompatible clusterIDs error, means you have formatted namenode with out deleting files from datanode.
December 9, 2018