Member since
03-04-2021
5
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1355 | 03-16-2021 06:57 AM |
09-28-2023
03:23 PM
We are using CDSW version 1.10.3.38240717 (xac2a42d). We cannot use the jupyterlab images when creating a job but we need them. Only Workbench images are available. We have spark magic notebooks that need to be put on a scheduler. Any advise would be appreciated.
... View more
Labels:
05-25-2023
08:39 PM
Hi Dankenstein, Thanks for your post. Considering the nature of the query, may I request you to create a support case. Besides, I would encourage you review the Cloudera Machine Learning which will be replacing the CDSW after its End of Support [May 2024]. https://docs.cloudera.com/machine-learning/1.5.0/private-cloud-requirements/topics/ml-getting-started.html https://docs.cloudera.com/machine-learning/cloud/index.html https://www.cloudera.com/legal/policies/support-lifecycle-policy.html
... View more
09-15-2022
08:01 AM
We have been utilizing CDSW jobs for the past couple years and have users moving onto other projects. The only way that we can find to run the jobs under someone else's account is to delete the jobs and recreate them with the new user. It is insanely annoying and keeps resulting in imperfect recreations. Is there a way to do this without deleting/recreating?
... View more
Labels:
03-16-2021
06:57 AM
What our organization did is we have base project that we created that we get everyone the pull from that has everything set up. It is really not ideal but it was the best we could come up with given our control over the product. You are correct that the .jupyter dir does not exist until jupyter-notebooks is run and we could not stick it in any directory to get copied on the docker build. We actually had upgraded over the weekend for other reasons and i tested out the auto kill for jupyter. If you are a CLOUDERA rep or a rep reads this please understand that the main reason our organization chose CDSW is because of this functionality and the ability to edit the docker build. We have been through Anaconda Enterprise, IBM Watson studio, and even tried to run JupyterHub. Our organization has 150+ data scientists/ analysts and they are all irresponsible when it comes to stopping their sessions. Anaconda was by far the worst performing product/company to work with for support. Now with CDSW we can propagate project configuration/ tutorial scripts/ spark and hive config from the top down to all projects via the docker build and we love it. Below are the contents of jupyter-notebook-config.py located in .juypter, it worked for us. , c.NotebookApp.shutdown_no_activity_timeout = 3600 c.MappingKernelManager.cull_idle_timeout = 2600
... View more