Member since
10-01-2018
802
Posts
144
Kudos Received
130
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3543 | 04-15-2022 09:39 AM | |
| 2864 | 03-16-2022 06:22 AM | |
| 7485 | 03-02-2022 09:44 PM | |
| 3450 | 03-02-2022 08:40 PM | |
| 2362 | 01-05-2022 07:01 AM |
08-03-2021
07:54 AM
@devdb Take a look of this may be it can help : https://archive.cloudera.com/cm7/7.2.4/generic/jar/cm_api/apidocs/ Also you can get the hosts details from this : http://CM-SERVER:7180/api/v19/clusters/cluster1/services For each ‘hosts’ in http://cm:7180/api/v19/hosts iterate through the hostId … { "items" : [ { "maintenanceOwners" : [ ], "hostId" : "15b5c47f-9156-4347-abd4-efbc79d27ba2", <=== hostid "ipAddress" : "IP", "hostname" : "host", http://cm:7180/api/v19/hosts/15b5c47f-9156-4347-abd4-efbc79d27ba2. which should give you the roleName ... { "clusterName" : "Cluster 1", "serviceName" : "HDFS-1", "roleName" : "HDFS-1-DATANODE-d1ee4c53b9fbc4786263f0420c5157e8" }, { ... using the roleName http://cm:7180/api/v19/clusters/Cluster%201/services/HDFS-1/roles/HDFS-1-DATANODE-d1ee4c53b9fbc4786263f0420c5157e8 Also full deployment details http://cm:7180/api/v19/cm/deployment
... View more
07-30-2021
06:58 AM
This seems a Connection time out to the name node so you may want to check if there is any Network issue or something else going on with CM's help. That should give you some clue.
... View more
07-27-2021
08:51 AM
@Ging As per my opinion it should work with proper setup. I don don’t see any doc specific to this. Here are some references about CDE. https://docs.cloudera.com/data-engineering/cloud/manage-jobs/topics/cde-create-job.html https://blog.cloudera.com/cloudera-data-engineering-integration-steps-to-leverage-spark-on-kubernetes/ https://www.cloudera.com/tutorials/cdp-getting-started-with-cloudera-data-engineering.html I would suggest to contact Cloudera Support to get insight on This and explore the possibilities around.
... View more
07-15-2021
03:32 AM
@Sam2020 This is because Cloudera recently changed the download policy and now to download Cloudera Software you need a valid subscription. Please see the announcement here: Transition to private repositories for CDH, HDP and HDF This is because of recent changes with respect to Paywall. Same has been answered in below thread : https://community.cloudera.com/t5/Support-Questions/http-public-repo-1-hortonworks-com-ambari-centos... One solution would be to download the installed (Trial version from here) $ wget https://archive.cloudera.com/cm7/7.1.4/cloudera-manager-installer.bin $ chmod u+x cloudera-manager-installer.bin $ sudo ./cloudera-manager-installer.bin For more details on Trial see: https://www.cloudera.com/downloads/cdp-private-cloud-trial.html
... View more
07-12-2021
09:13 PM
@sur I believe you have to Set below properties before executing create table statement. SET hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager; SET hive.support.concurrency=true; This seems a very known behaviour and I did a simple Googling and found the solutions on several places. Below are the references. https://stackoverflow.com/questions/42669171/semanticexception-error-10265-while-running-simple-hive-select-query-on-a-tran https://dbmstutorials.com/hive/hive-errors.html https://knowledge.informatica.com/s/article/526538?language=en_USv Hope this helps.
... View more
07-12-2021
07:14 AM
2 Kudos
@flowerbirds For CM server DB you can try something like below: In db.properties: com.cloudera.cmf.db.type = mysql
com.cloudera.cmf.orm.hibernate.connection.url=jdbc:mysql://<db_host>/scm?useSSL=true
com.cloudera.cmf.orm.hibernate.connection.username=scm
com.cloudera.cmf.orm.hibernate.connection.password=cloudera In /etc/default/cloudera-scm-server add the following to export CMF_JAVA_OPTS: -Djavax.net.ssl.trustStore=/opt/cloudera/security/jks/truststore.jks Restart the Cloudera Manager server. NOTE: Just remember in some case we set ssl=true&sslmode=require so if the normal method means com.cloudera.cmf.orm.hibernate.connection.url=jdbc:mysql://<db_host>/scm?useSSL=true failed please try the `ssl=true&sslmode=require as well and see.
... View more
07-11-2021
05:33 AM
1 Kudo
@gfranco In CDSW almost every POD is serving it's own purpose. The only thing which is possible is scale/de-scale the Web PODs if needed. Regarding the monitoring this is running K8s in the heart so you can use K8s command to watch the usages. Here is a good discussion about such commands/utility: https://github.com/kubernetes/kubernetes/issues/17512 From CDSW public doc you can refer this: https://docs.cloudera.com/cdsw/1.9.1/monitoring/topics/cdsw-monitoring.html?
... View more
07-11-2021
05:27 AM
@kalaicool261 There is nothing like terminal memory. This seems a engine memory issue. You should launch the session (engine) with larger memory and CPU from the drop down menu on Session launch page and see if the helps.
... View more
07-11-2021
05:18 AM
@sur I believe you have to run the queries over Impala not Hive. I have tested below and it works several time in the past. # Install Libraries !pip3 install impyla==0.13.8 !pip3 install thrift_sasl==0.2.1 !pip3 install thrift==0.9.3 !pip3 install sasl==0.2.1 # Connect to Impala from impala.dbapi import connect conn = connect(host='host', port=21050, auth_mechanism='GSSAPI', use_ssl=True, kerberos_service_name='impala') # Execute Query sql = "select * from table" cursor = conn.cursor() cursor.execute(sql) results = cursor.fetchall() You can refer the below doc: https://docs.cloudera.com/cdsw/1.9.1/import-data/topics/cdsw-running-queries-on-impala-tables.html
... View more
07-02-2021
04:21 AM
@lovebo Does this folder exists? This seems coming from Webhdfs. You may have to look at permission as well for users.
... View more