Member since
12-21-2017
134
Posts
2
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
606 | 02-06-2023 09:56 AM | |
2379 | 02-01-2023 09:19 AM | |
893 | 11-02-2021 08:28 AM |
11-02-2023
08:37 AM
Hmm, that makes sense I suppose. That was my next guess 😉 Glad you figured it out, and thanks for posting the answer here, I appreciate it!
... View more
10-31-2023
06:38 AM
I would expect that you need to use A1234567 as that will be the username which matches the API key. If the only thing that changed was the VPN... that must be the issue. Perhaps the VPN is blocking ssh access or rewriting some header or something? I'm pretty sure that the error about an invalid API key is not the real error - it likely cannot even get to your CML in the first place. When you get back on VPN, can you try to just cURL your server with and without VPN?
... View more
10-31-2023
03:58 AM
Oh weird the first time I read this I didn't see you using the server anywhere. No, the command you are using is correct. Can you expand on this statement? >Could it be due to case of the usernames? In CDSW my username is uppercase and on my mac it is lower case? The username you are using in the command is the CDSW username, not your mac username.
... View more
10-30-2023
06:47 AM
Hi @BubbaBoBobBrain , you need to include the workspace in your login command, see this page: https://docs.cloudera.com/cdsw/1.10.3/cli-reference/topics/cdsw-login-cdswctl.html This command worked fine for me: ./cdswctl login -u https://mikes-cdsw.cloudera.com -n mike -y u8ryf6a2977rfsr8zajesand2jhwoa44 Btw on Mac you usually need to first right click on the cdswcli icon and select "Open" - this will let you open the tool once which lets your mac system trust the application, which it won't do by default since it was downloaded from the internet. After this you can use it as normal.
... View more
06-01-2023
02:39 PM
1 Kudo
Hi, the documentation suggests to use SparklyR to read from Impala in R: https://docs.cloudera.com/cdsw/1.10.3/import-data/topics/cdsw-running-queries-on-impala-tables.html#pnavId4 I think you could also use RJDBC library to set up a JDBC connection to impala: https://cran.r-project.org/web/packages/RJDBC/index.html
... View more
05-30-2023
06:39 AM
Hi, do you have access to the actual CDSW host environment on the CDSW master host? If so, you will be ablet o use sftp - the project files will be located in /var/lib/cdsw/current/projects/projects/[number]/[number] where the first [number] is usually 0 and the next number will be the id of your project. You can find what this ID is by running something like: kubectl exec -it $(kubectl get pods -l role=db -o jsonpath='{.items[*].metadata.name}') -- psql -P pager=off --expanded -U sense -c "select id from projects where name='my_test_project'" Another way you could transfer files from the CDSW project would be to simply open the project, start a session, open the _Terminal, and run: python -m http.server 8080 --bind 127.0.0.1 This will start the SimpleHTTPServer. Let this run, and go back to the project. Where the little 9 dot menu is, there will be a new option to view the directory listing: You can just click this, or manually go to the generated URL (https://public-9hcxj43aavpxk7gt.cdsw.company.com/ in your browser (where the public- is required, and the next chunk is the user session) or use wget or something to download files. There are probably a lot of other ways to pull files directly from CDSW, but these two methods should get you started on whatever you are trying to do.
... View more
03-20-2023
11:55 AM
Hi, the docker repository is available publicly. You can test by running: docker pull docker.repository.cloudera.com/cdsw/engine:13 does that work? Can you paste the actual authentication error you are seeing? Is it an x509 error? Can you paste the contents of /etc/docker/daemon.json?
... View more
02-06-2023
09:56 AM
1 Kudo
I think you will have to write the output you want to share into an attachment and simply share the attachment only. When you set up a job you can tell it not to send the console output.
... View more
02-06-2023
09:27 AM
Hi. When you go to share a session, there is a box to "Hide code and text" - does this work for you? I don't really see a way to do this inside of a scheduled job. I think your best bet is to write whatever important data that you want to share to a file, and then when you set up your job, uncheck the button to share the console and include the attachment. Can you try that?
... View more
02-01-2023
11:30 AM
Hi, whichever user you log in as under the User Settings -> Hadoop Authentication should be what CDSW uses when accessing the rest of the cluster. Typically your CDSW username/password is your SSO login, but you can change this Hadoop Authentication settings if you want. Let me know if that works for you!
... View more