One more interesting thing that I don’t know if it matters or not. The file hadoop-layout.sh references /usr/hdp/2.2.0.0-2041/ … while other variables get overwritten to /usr/hdp/current/…
In some cases, I have env variables looking in different places, albeit with what appears to be correct configs from my ambari setup. IE, when I source hadoop-config.sh, I get the following:
HADOOP_LIBEXEC_DIR=/usr/hdp/current/hadoop-client/libexec
HADOOP_PREFIX=/usr/hdp/2.2.0.0-2041/hadoop
And then some class paths start to look like this:
HADOOP_CLASSPATH=:/usr/share/java/mysql-connector-java-5.1.17.jar:/usr/share/java/mysql-connector-java.jar:/usr/hdp/current/hadoop-mapreduce-client/*:/usr/hdp/current/tez-client/*:/usr/hdp/current/tez-client/lib/*:/etc/tez/conf/:/usr/hdp/2.2.0.0-2041/tez/*:/usr/hdp/2.2.0.0-2041/tez/lib/*:/etc/tez/conf
HADOOP_CONF_DIR=/usr/hdp/2.2.0.0-2041/hadoop/conf
Those are all real directories with real libs and appear to be correct but not sure if that is contributing to the problem. I don’t see where/how ambari sets hadoop-layout.sh.