Hi,   We have an overlay network on top of your CDSW hosts where the pods are getting their IPs from (100.66.x.x).   Based on your description it seems that DNS resolution is not working from inside the container while it works on the host. This can happen when multiple nameservers are configured in /etc/resolv.conf but some of them can't resolve your clouderamaster. You could figure out what nameserver can resolve your host and drop the rest of them or make sure that all nameservers can resolve the clouderamaster.  I like to use `dig @nameserver clouderamaster.com` command to test these.   Regards, Peter ... View more

You need to make sure that forward/reverse DNS resolution works from the CDSW terminal to host where you have the YARN ResourceManager and HDFS NameNode services. You referred to this as clouderamaster.<domain>.com before. This issue is not related to the CDSW master DNS resolution, you mentioned that you are using the session terminal, as it works, the CDSW master DNS is configured properly.   Regards, Peter ... View more

Hi,   You seem to have some network connectivity issue. I have seen many variations for this, please check - that you don't have a firewall between the machines,  - you resolve the hosts with DNS and not /etc/hosts https://www.cloudera.com/documentation/data-science-workbench/1-3-x/topics/cdsw_known_issues.html#networking - DNS can do forward/reverse resolution on your master hostname/ip   I think if you are ok on the above, this should work.   Regards, Peter ... View more

Hi Rob,   This is a good question. CDSW gives you isolation by having project specific dependencies stored in the project folders out of the box. If you need isolated dependencies on the Cluster side (Spark Executor side) also you need to follow the steps described in this blog post:  https://blog.cloudera.com/blog/2017/04/use-your-favorite-python-library-on-pyspark-cluster-with-cloudera-data-science-workbench/   The "Cloudera Data Science Workbench is not ready yet" output for the cdsw status message while everything looks good is a known issue which we currently working on.   Regards, Peter ... View more