Hi Salim, you cannot access root in the containers - this is due to security concerns.  Sometimes customers need root to install something from pip (some pip libraries need make, for instance.) If that's the case, you'll need to create a custom Runtime (or Legacy Engine if you are still on CDSW) and install those libraries when you create the image - at creation time, you will have root. SEe here: https://docs.cloudera.com/machine-learning/cloud/runtimes/topics/ml-customized-runtimes.html Here is another example of a "dockerfile" and you can see that basically you can install anything in the Runtime(engine) container: https://github.com/cloudera/community-ml-runtimes/blob/main/ollama/Dockerfile ... View more

Hi, the LDAP paramaters are stored inside the postgres database that backs CDSW. It's best not to change these database entries manually. You can use the "debug login" URL here to fix the LDAP configuration: https://docs.cloudera.com/cdsw/1.10.5/external-authentication/topics/cdsw-debug-login-url.html The "debug login URL" will bypass LDAP and let you log in directly to CDSW as the first user that was created, typically an account named "admin" or something like that. If you do NOT know the admin user login information, you can reset that in the database with a procedure like: 1) SSH to the CDSW master host 2) accesss the db kubectl exec -it $(kubectl get pods -l role=db -o jsonpath='{.items[*].metadata.name}') -- psql -P pager=off -U sense 3) Set the "password1" password for an existing user, for example 'admin': sense=# UPDATE users SET password='$2a$12$soyqZyDasDpsU/vDx3Y0Euq23OMLxqxDffAIjighiH.oVdV64VVvC' WHERE username='CDSW_Admin'; make sure to update the username to whatever user you want to log in as. Before LDAP is set up, users are managed locally by the database, which is why this procedure works. The password is just a bcrypt'd version of "password1" but you can change this after you log in. Once you log in, you'll be able to go to the Admin page and update the LDAP configurations.     ... View more

Hi, yes, that is expected error message. You have to add that user into whatever CDSW Admin group you are using and then sync the users. When you log in, if CDSW is configured to use SAML or LDAP, it will pull the user information that way and determine if that user should have admin privileges. ... View more

Hi, you can build your own LLMs in CML, or you can access existing ones in huggingface. The HuggingFace ones can be installed as an AMP, see here: https://docs.cloudera.com/machine-learning/cloud/applied-ml-prototypes/topics/ml-huggingface.html#concept_gs1_vb4_21c This is the quickest way to get started. The actual model is still stored on HF so if your cluster is airgapped you will have some trouble using the AMP feature - it's possible but is kind of a pain. Cloudera does not SHIP any LLMs as far as I know. ... View more