Site icon Spark By {Examples}

WARNING: “HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX.

Are you getting WARNING: “HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX. ? for every command you issue on a cluster, follow below step to resolve it.

 WARNING: "HADOOP_PREFIX has been replaced by HADOOP_HOME. 
Using value of HADOOP_PREFIX.

simply edit ~/.bashrc and replace HADOOP_PREFIX to HADOOP_HOME on all datanodes and namenode.

from

export HADOOP_PREFIX="/home/ubuntu/hadoop"
export PATH=$PATH:$HADOOP_PREFIX/bin
export PATH=$PATH:$HADOOP_PREFIX/sbin
export HADOOP_MAPRED_HOME=${HADOOP_PREFIX}
export HADOOP_COMMON_HOME=${HADOOP_PREFIX}
export HADOOP_HDFS_HOME=${HADOOP_PREFIX}
export YARN_HOME=${HADOOP_PREFIX}

to

export HADOOP_HOME="/home/ubuntu/hadoop"
export PATH=$PATH:$HADOOP_HOME/bin
export PATH=$PATH:$HADOOP_HOME/sbin
export HADOOP_MAPRED_HOME=${HADOOP_HOME}
export HADOOP_COMMON_HOME=${HADOOP_HOME}
export HADOOP_HDFS_HOME=${HADOOP_HOME}
export YARN_HOME=${HADOOP_HOME}

After applying above change, just reload .bashrc by running following command.

source ~/.bashrc

Now you should not see this WARNING: “HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX.

Please leave me a comment if this post is helpful and resolved your issue.

Thanks!!

Exit mobile version