Support Questions
Find answers, ask questions, and share your expertise

HADOOP_CONF_DIR may be incomplete

HADOOP_CONF_DIR may be incomplete

Explorer

After deploying an instance of the CDSW and starting to play with the sample project, we've encountered an error while trying to interact with the underlying HDFS as described in the docs:

 

2019-10-28 13_32_54-Untitled Session · stemper _ Sample · Cloudera Data Science Workbench.png

We know it is possible to set and save the environment variables on a project basis, but the same issue occurred nonetheless. Anyone encountered this before or knows how to resolve it?

2 REPLIES 2

Re: HADOOP_CONF_DIR may be incomplete

New Contributor

Hi, I have the same issue when testing on CDH 6.2.0 /w CDSW 1.6.0.

It appears that the cluster does not like having multiple paths to be defined for HADOOP_CONF_DIR.

Any way to fix this without having to set the environment variable on project basis?

 

Re: HADOOP_CONF_DIR may be incomplete

Explorer

Hi, I can confirm that setting the env variable HADOOP_CONF_DIR to only /etc/hadoop/conf in the project settings resolves the issue with CDH 1.5 and CDSW 1.6.1. However, as @Finn points out, this works only on a project basis, and fixing this for the entire workbench seems preferable.