Member since
12-21-2017
141
Posts
6
Kudos Received
6
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
681 | 09-18-2024 11:52 AM | |
801 | 09-12-2024 04:54 PM | |
1128 | 07-30-2024 11:49 AM | |
1177 | 02-06-2023 09:56 AM | |
4238 | 02-01-2023 09:19 AM |
10-16-2024
06:33 AM
FYI you can use this site to set the password to something else: https://www.browserling.com/tools/bcrypt
... View more
09-18-2024
11:52 AM
Hi, the LDAP paramaters are stored inside the postgres database that backs CDSW. It's best not to change these database entries manually. You can use the "debug login" URL here to fix the LDAP configuration: https://docs.cloudera.com/cdsw/1.10.5/external-authentication/topics/cdsw-debug-login-url.html The "debug login URL" will bypass LDAP and let you log in directly to CDSW as the first user that was created, typically an account named "admin" or something like that. If you do NOT know the admin user login information, you can reset that in the database with a procedure like: 1) SSH to the CDSW master host 2) accesss the db kubectl exec -it $(kubectl get pods -l role=db -o jsonpath='{.items[*].metadata.name}') -- psql -P pager=off -U sense 3) Set the "password1" password for an existing user, for example 'admin': sense=# UPDATE users SET password='$2a$12$soyqZyDasDpsU/vDx3Y0Euq23OMLxqxDffAIjighiH.oVdV64VVvC' WHERE username='CDSW_Admin'; make sure to update the username to whatever user you want to log in as. Before LDAP is set up, users are managed locally by the database, which is why this procedure works. The password is just a bcrypt'd version of "password1" but you can change this after you log in. Once you log in, you'll be able to go to the Admin page and update the LDAP configurations.
... View more
09-12-2024
04:54 PM
1 Kudo
Hi, yes, that is expected error message. You have to add that user into whatever CDSW Admin group you are using and then sync the users. When you log in, if CDSW is configured to use SAML or LDAP, it will pull the user information that way and determine if that user should have admin privileges.
... View more
07-30-2024
11:49 AM
3 Kudos
Hi, you can build your own LLMs in CML, or you can access existing ones in huggingface. The HuggingFace ones can be installed as an AMP, see here: https://docs.cloudera.com/machine-learning/cloud/applied-ml-prototypes/topics/ml-huggingface.html#concept_gs1_vb4_21c This is the quickest way to get started. The actual model is still stored on HF so if your cluster is airgapped you will have some trouble using the AMP feature - it's possible but is kind of a pain. Cloudera does not SHIP any LLMs as far as I know.
... View more
11-02-2023
08:37 AM
Hmm, that makes sense I suppose. That was my next guess 😉 Glad you figured it out, and thanks for posting the answer here, I appreciate it!
... View more
10-31-2023
06:38 AM
I would expect that you need to use A1234567 as that will be the username which matches the API key. If the only thing that changed was the VPN... that must be the issue. Perhaps the VPN is blocking ssh access or rewriting some header or something? I'm pretty sure that the error about an invalid API key is not the real error - it likely cannot even get to your CML in the first place. When you get back on VPN, can you try to just cURL your server with and without VPN?
... View more
10-31-2023
03:58 AM
Oh weird the first time I read this I didn't see you using the server anywhere. No, the command you are using is correct. Can you expand on this statement? >Could it be due to case of the usernames? In CDSW my username is uppercase and on my mac it is lower case? The username you are using in the command is the CDSW username, not your mac username.
... View more
10-30-2023
06:47 AM
Hi @BubbaBoBobBrain , you need to include the workspace in your login command, see this page: https://docs.cloudera.com/cdsw/1.10.3/cli-reference/topics/cdsw-login-cdswctl.html This command worked fine for me: ./cdswctl login -u https://mikes-cdsw.cloudera.com -n mike -y u8ryf6a2977rfsr8zajesand2jhwoa44 Btw on Mac you usually need to first right click on the cdswcli icon and select "Open" - this will let you open the tool once which lets your mac system trust the application, which it won't do by default since it was downloaded from the internet. After this you can use it as normal.
... View more
06-01-2023
02:39 PM
1 Kudo
Hi, the documentation suggests to use SparklyR to read from Impala in R: https://docs.cloudera.com/cdsw/1.10.3/import-data/topics/cdsw-running-queries-on-impala-tables.html#pnavId4 I think you could also use RJDBC library to set up a JDBC connection to impala: https://cran.r-project.org/web/packages/RJDBC/index.html
... View more
05-30-2023
06:39 AM
Hi, do you have access to the actual CDSW host environment on the CDSW master host? If so, you will be ablet o use sftp - the project files will be located in /var/lib/cdsw/current/projects/projects/[number]/[number] where the first [number] is usually 0 and the next number will be the id of your project. You can find what this ID is by running something like: kubectl exec -it $(kubectl get pods -l role=db -o jsonpath='{.items[*].metadata.name}') -- psql -P pager=off --expanded -U sense -c "select id from projects where name='my_test_project'" Another way you could transfer files from the CDSW project would be to simply open the project, start a session, open the _Terminal, and run: python -m http.server 8080 --bind 127.0.0.1 This will start the SimpleHTTPServer. Let this run, and go back to the project. Where the little 9 dot menu is, there will be a new option to view the directory listing: You can just click this, or manually go to the generated URL (https://public-9hcxj43aavpxk7gt.cdsw.company.com/ in your browser (where the public- is required, and the next chunk is the user session) or use wget or something to download files. There are probably a lot of other ways to pull files directly from CDSW, but these two methods should get you started on whatever you are trying to do.
... View more