Member since
10-01-2018
799
Posts
139
Kudos Received
128
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
305 | 04-15-2022 09:39 AM | |
239 | 03-16-2022 06:22 AM | |
240 | 03-02-2022 09:44 PM | |
182 | 03-02-2022 08:40 PM | |
274 | 01-05-2022 07:01 AM |
09-30-2021
09:21 PM
@reca This should work. The Oracle Database earlier versions are supported for C5.13. Please see the support matrix here. https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_ag_migrate_postgres_db_to_oracle_mysql.html Once you decide the Oracle DB version you can just follow this guide for migrating a Postgres DB to Oracle. https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_ag_migrate_postgres_db_to_oracle_mysql.html
... View more
09-26-2021
09:24 PM
@RizkyMei I would suggest you to Stop CDSW and then deploy Client configuration from CM > Cluster > Action menu. This seems Client Configuration not being pushed. After that start CDSW and try again.
... View more
09-26-2021
09:21 PM
@Chetankumar Make sure you have credentials entered for parcels because every Cloudera binary is now behind the paywall so you need a valid subscription to access the parcels etc. Just a sanity check.
... View more
09-20-2021
07:06 AM
That fine. can you try below? sparkSession.builder() <--------------should work? then .config( config prop) .appName().getOrCreate() Also most important thing this could be a red herring you have to see if the session is running and you job succeed. We have seen this issue in past seems.
... View more
09-20-2021
06:07 AM
@engerej The issue could lies with JNDI and the fact that it does not handle a group with a leading space. So check if your groups having space in the name.
... View more
09-20-2021
06:03 AM
1 Kudo
@wert_1311 A Cloudera Enterprise license is required for the following features: LDAP and SAML authentication Configuration history Alerts delivered as SNMP traps and custom alert scripts Backup and disaster recovery Operational reports Cloudera Navigator Commands such as Rolling Restart, History and Rollback, and Send Diagnostic Data Cluster Utilization Reports Role Based Access Control and Cluster-specific Roles https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_ag_licenses.html
... View more
- Tags:
- licensing
09-20-2021
06:01 AM
@wbivp Is the TLS enabled? Can you try after disabling TLS.
... View more
09-20-2021
05:58 AM
@dmharshit 2 things going on here. 1. The link https://archive.cloudera.com/cm7/ is not valid because thus is showing Cloudera Manager not the CDH (Cloudera Runtime Version). 2. So what you need is to download the CDH binary for CDP7.1.6 version which can be found here: https://archive.cloudera.com/cdh7/latest/parcels/ Or for the Spark Standalone parcels https://archive.cloudera.com/p/spark3/3.1.7270.0/
... View more
09-20-2021
05:52 AM
@SHUAIPENG I would suggest to deploy Kerberos Client Configuration once from CM > Cluster > Action menu and Also restart the CM server after that and try again to generate the credentials and see how it goes.
... View more
08-20-2021
10:32 AM
@Seedy There could be various reasons. You have to see the full agent logs. However to start with this issue I would suggest few sanity checks. 1)Resolve network issue related to firewall restrictions in accessing the repo files
2)Correct permissions on /opt/cloudera/ directories
3)Check and change the ownership.
$chown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo/*
4)Re - add the hosts from Cloudera Manager However most importantly you have to see if you can download the parcels manually on the node under this dir. Please follow the below page for detailed overview. https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ig_parcels.html
... View more
08-18-2021
01:08 AM
Yes it's available now: HDP to CDP Upgrade Overview In-place upgrade overview CDP Upgrade Readiness
... View more
08-17-2021
11:55 AM
@vishal_ That's the correct way. See deprecated items in CDP: https://docs.cloudera.com/cdp-private-cloud-upgrade/latest/upgrade-cdh/topics/hive-unsupported.html See the recommendation for CLI in CDP: https://docs.cloudera.com/cdp-private-cloud-base/7.1.3/concepts/topics/sdx-workflow-1--using-impala-shell-and-hive.html
... View more
08-15-2021
03:35 AM
@vishal_ There may be a chance the The property "tez.history.logging.proto-base-dir" is pointing to wrong HDFS path location so check that once and correct if needed. > Then Go to CM > Tez > Actions > "Upload Tez tar file to HDFS". > Also check if hive user dir exist in hdfs else you have to go CM > Hive > Action > Create hive dir > Also, check the Hive on Tez service Environment Advanced Configuration Snippet (Safety Valve) and mention it below. AUX_CLASSPATH="$AUX_CLASSPATH:$TEZ_JARS" > Then Save changes and restart the service.
... View more
08-14-2021
08:06 PM
@zinal I would request you to check if you have root privileges on the host because that's needed for Auto-TLS. Also check the permission on the directory where CM Auto-TLS stores the certificate. Lastly you can bypass this issue by copying certs manually from below dir: Temporary directory is at: /tmp/generateHostCerts16944646874431887540 to the Auto-TLS dirs on the host and modify the config.ini file (refer the config.ini file from working host) and restart the agent.
... View more
08-14-2021
07:54 PM
@vishal_ You might be hitting this issue : https://community.cloudera.com/t5/Support-Questions/hive-server-restarted-failed-with-error-stopping-schq/td-p/312210 Please take a look and let us know if this resolves your issue.
... View more
08-14-2021
07:49 PM
@Sam2020 you are missing an important point here that is the Trial installation will always we available for latest software version. Since we have released CM7.4.4 last week so the error you are seeing is expected. You have to change you repo to https://archive.cloudera.com/cm7/7.4.4/redhat7/yum/repodata/ (try accessing this from browser you will understand). Bottom-line is if you have valid subscription you can still have 7.3.1 but if you want trial than you have to go for 7.4.4.
... View more
08-03-2021
07:54 AM
@devdb Take a look of this may be it can help : https://archive.cloudera.com/cm7/7.2.4/generic/jar/cm_api/apidocs/ Also you can get the hosts details from this : http://CM-SERVER:7180/api/v19/clusters/cluster1/services For each ‘hosts’ in http://cm:7180/api/v19/hosts iterate through the hostId … { "items" : [ { "maintenanceOwners" : [ ], "hostId" : "15b5c47f-9156-4347-abd4-efbc79d27ba2", <=== hostid "ipAddress" : "IP", "hostname" : "host", http://cm:7180/api/v19/hosts/15b5c47f-9156-4347-abd4-efbc79d27ba2. which should give you the roleName ... { "clusterName" : "Cluster 1", "serviceName" : "HDFS-1", "roleName" : "HDFS-1-DATANODE-d1ee4c53b9fbc4786263f0420c5157e8" }, { ... using the roleName http://cm:7180/api/v19/clusters/Cluster%201/services/HDFS-1/roles/HDFS-1-DATANODE-d1ee4c53b9fbc4786263f0420c5157e8 Also full deployment details http://cm:7180/api/v19/cm/deployment
... View more
08-03-2021
07:39 AM
@zxcware Please follow below discussion, hopefully you will get the answers: Paywall question: https://community.cloudera.com/t5/Support-Questions/How-do-I-get-repository-credentials/m-p/311145#M224492 https://community.cloudera.com/t5/Support-Questions/https-archive-cloudera-com-cm6-6-2-0-ubuntu1604-displaying/m-p/311060#M224430 Long story short every Cloudera bits is behind Paywall now. You need a valid subscription for that Except you can Try the CDP latest version but not any Older version.
... View more
07-30-2021
06:58 AM
This seems a Connection time out to the name node so you may want to check if there is any Network issue or something else going on with CM's help. That should give you some clue.
... View more
07-29-2021
01:02 AM
@haxsaansiddiqi This is expected. There seems to be a confusion about the different products. What you are doing is installing Private Cloud Experiences (Means CML, CDW & CDE etc.) which Needs a CDP Private Cloud Base Cluster which is synonyms of CDH/CM cluster in old days. CDP Experience don’t have TRIAL available that’s what the error says Installation of the Kubernetes components of the CDP experience needs a License. So if you want CDP Private Cloud Base cluster for TRIAL it's available and you can play around using the doc: https://www.cloudera.com/downloads/cdp-private-cloud-trial.html & https://docs.cloudera.com/cdp-private-cloud-base/7.1.4/installation/topics/cdpdc-trial-installation.html For Experience install you have to contact Sales Team to get the License. Hope this helps.
... View more
07-27-2021
08:51 AM
@Ging As per my opinion it should work with proper setup. I don don’t see any doc specific to this. Here are some references about CDE. https://docs.cloudera.com/data-engineering/cloud/manage-jobs/topics/cde-create-job.html https://blog.cloudera.com/cloudera-data-engineering-integration-steps-to-leverage-spark-on-kubernetes/ https://www.cloudera.com/tutorials/cdp-getting-started-with-cloudera-data-engineering.html I would suggest to contact Cloudera Support to get insight on This and explore the possibilities around.
... View more
07-22-2021
06:50 AM
@rjwiggins80 May be this thread can guide a little: https://community.cloudera.com/t5/Support-Questions/Bad-Credentials-on-Accumulo-Tracer/td-p/131423 Else please send the full error message.
... View more
07-20-2021
01:48 AM
@exploer The role logs needs to be in given format because at every start of service CM creates a runtime process directory as well for the Role logs it has rotation for logs after a given period of time/size. So the mm-dd-yy after logs makes it convenient and hard coded.
... View more
07-20-2021
01:45 AM
@Narendra_ No, For production purposes you have to buy subscription given that Cloudera software can’t be setup without using Ambari and Cloudera Manager and you can’t effectively monitor the cluster. You can install Hadoop Open Source version (Vanilla) but you are on own and will not get any Cloudera Support on that.
... View more
07-15-2021
03:32 AM
@Sam2020 This is because Cloudera recently changed the download policy and now to download Cloudera Software you need a valid subscription. Please see the announcement here: Transition to private repositories for CDH, HDP and HDF This is because of recent changes with respect to Paywall. Same has been answered in below thread : https://community.cloudera.com/t5/Support-Questions/http-public-repo-1-hortonworks-com-ambari-centos... One solution would be to download the installed (Trial version from here) $ wget https://archive.cloudera.com/cm7/7.1.4/cloudera-manager-installer.bin $ chmod u+x cloudera-manager-installer.bin $ sudo ./cloudera-manager-installer.bin For more details on Trial see: https://www.cloudera.com/downloads/cdp-private-cloud-trial.html
... View more
07-12-2021
09:13 PM
@sur I believe you have to Set below properties before executing create table statement . SET hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager; SET hive.support.concurrency=true; This seems a very known behaviour and I did a simple Googling and found the solutions on several places. Below are the references. https://stackoverflow.com/questions/42669171/semanticexception-error-10265-while-running-simple-hive-select-query-on-a-tran https://dbmstutorials.com/hive/hive-errors.html https://knowledge.informatica.com/s/article/526538?language=en_USv Hope this helps.
... View more
07-12-2021
07:14 AM
2 Kudos
@flowerbirds For CM server DB you can try something like below: In db.properties : com.cloudera.cmf.db.type = mysql
com.cloudera.cmf.orm.hibernate.connection.url=jdbc:mysql://<db_host>/scm?useSSL=true
com.cloudera.cmf.orm.hibernate.connection.username=scm
com.cloudera.cmf.orm.hibernate.connection.password=cloudera In /etc/default/ cloudera - scm -server add the following to export CMF_JAVA_OPTS : -Djavax.net.ssl.trustStore=/opt/cloudera/security/jks/truststore.jks Restart the Cloudera Manager server. NOTE: Just remember in some case we set ssl=true&sslmode=require so if the normal method means com.cloudera.cmf.orm.hibernate.connection.url=jdbc:mysql://<db_host>/scm?useSSL=true failed please try the ` ssl=true&sslmode=require as well and see.
... View more
07-11-2021
05:33 AM
1 Kudo
@gfranco In CDSW almost every POD is serving it's own purpose. The only thing which is possible is scale/de-scale the Web PODs if needed. Regarding the monitoring this is running K8s in the heart so you can use K8s command to watch the usages. Here is a good discussion about such commands/utility: https://github.com/kubernetes/kubernetes/issues/17512 From CDSW public doc you can refer this: https://docs.cloudera.com/cdsw/1.9.1/monitoring/topics/cdsw-monitoring.html?
... View more
07-11-2021
05:27 AM
@kalaicool261 There is nothing like terminal memory. This seems a engine memory issue. You should launch the session (engine) with larger memory and CPU from the drop down menu on Session launch page and see if the helps.
... View more