Hi,   The documentation has an image explaining this:  https://www.cloudera.com/documentation/data-science-workbench/latest/topics/cdsw_dist_comp_with_Spark.html   The answer is yes, if you start a Python 2 session and you create a SparkSession object there you will run the Spark application in client mode and the Spark driver will be inside the CDSW session (docker container).  This is the primary use-case for CDSW.   Regards, Peter ... View more

Hello,   I can reproduce the "Engine exited with status 2." if I'm using the v1 engine but it works with the v2 engine.   What version are you using?  - If you are using 1.0.x then I recommend upgrading to 1.1.1. - If you are already using 1.1.1 then you should use the v2 engine. You can go to your Settings menu on the Project page and select the "Base Image v2, docker.repository.cloudera.com/cdsw/engine:2" on the Engines tab. You can also change the default engine in the Admin menu but it will be applied to new projects, for already existing ones you need to select it manually.   Regards, Peter ... View more

Hello,   I fixed it.   In the Spark2 Configuration Screen (In Cloudera Manager for the CDH cluster), Hiver Service was set to none   I set it to Hive and CDSW is now working as expected. Thanks! ... View more

Hi   the problem when stuck in ContainerCreating state, base on logs generated by command"kubectl describe pod web-3826671331-5b7wk" was failing to mount masterserverIP:/var/lib/cdsw/projects   the reason was the the incorrect master IP at /etc/cdsw/config/cdsw.conf   Regards. NES             ... View more