Member since
10-01-2018
802
Posts
139
Kudos Received
128
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
386 | 04-15-2022 09:39 AM | |
282 | 03-16-2022 06:22 AM | |
299 | 03-02-2022 09:44 PM | |
219 | 03-02-2022 08:40 PM | |
300 | 01-05-2022 07:01 AM |
09-20-2021
07:06 AM
That fine. can you try below? sparkSession.builder() <--------------should work? then .config( config prop) .appName().getOrCreate() Also most important thing this could be a red herring you have to see if the session is running and you job succeed. We have seen this issue in past seems.
... View more
09-20-2021
06:07 AM
@engerej The issue could lies with JNDI and the fact that it does not handle a group with a leading space. So check if your groups having space in the name.
... View more
09-20-2021
06:03 AM
1 Kudo
@wert_1311 A Cloudera Enterprise license is required for the following features: LDAP and SAML authentication Configuration history Alerts delivered as SNMP traps and custom alert scripts Backup and disaster recovery Operational reports Cloudera Navigator Commands such as Rolling Restart, History and Rollback, and Send Diagnostic Data Cluster Utilization Reports Role Based Access Control and Cluster-specific Roles https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_ag_licenses.html
... View more
- Tags:
- licensing
09-20-2021
05:58 AM
@dmharshit 2 things going on here. 1. The link https://archive.cloudera.com/cm7/ is not valid because thus is showing Cloudera Manager not the CDH (Cloudera Runtime Version). 2. So what you need is to download the CDH binary for CDP7.1.6 version which can be found here: https://archive.cloudera.com/cdh7/latest/parcels/ Or for the Spark Standalone parcels https://archive.cloudera.com/p/spark3/3.1.7270.0/
... View more
09-03-2021
01:05 AM
Hi Please check the CF stack in AWS for this deployment. If it is failing at creating a load balancer then check Maybe it hit ELB quota. The dex-base installation creates an LB. You might want to increase the AWS ELB quota and retry the provisioning. Otherwise, let us know if you have overcome this issue with a different resolution
... View more
08-20-2021
10:32 AM
@Seedy There could be various reasons. You have to see the full agent logs. However to start with this issue I would suggest few sanity checks. 1)Resolve network issue related to firewall restrictions in accessing the repo files
2)Correct permissions on /opt/cloudera/ directories
3)Check and change the ownership.
$chown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo/*
4)Re - add the hosts from Cloudera Manager However most importantly you have to see if you can download the parcels manually on the node under this dir. Please follow the below page for detailed overview. https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ig_parcels.html
... View more
08-20-2021
05:23 AM
Thank you for marking the solution. It appears that you have two different community accounts. Of your two accounts, only the one that posted the question can mark the solution. If you have any further questions on the accounts or using the community, feel free to reach out to me via private message.
... View more
08-18-2021
01:08 AM
Yes it's available now: HDP to CDP Upgrade Overview In-place upgrade overview CDP Upgrade Readiness
... View more
08-14-2021
07:49 PM
@Sam2020 you are missing an important point here that is the Trial installation will always we available for latest software version. Since we have released CM7.4.4 last week so the error you are seeing is expected. You have to change you repo to https://archive.cloudera.com/cm7/7.4.4/redhat7/yum/repodata/ (try accessing this from browser you will understand). Bottom-line is if you have valid subscription you can still have 7.3.1 but if you want trial than you have to go for 7.4.4.
... View more
08-03-2021
07:54 AM
@devdb Take a look of this may be it can help : https://archive.cloudera.com/cm7/7.2.4/generic/jar/cm_api/apidocs/ Also you can get the hosts details from this : http://CM-SERVER:7180/api/v19/clusters/cluster1/services For each ‘hosts’ in http://cm:7180/api/v19/hosts iterate through the hostId … { "items" : [ { "maintenanceOwners" : [ ], "hostId" : "15b5c47f-9156-4347-abd4-efbc79d27ba2", <=== hostid "ipAddress" : "IP", "hostname" : "host", http://cm:7180/api/v19/hosts/15b5c47f-9156-4347-abd4-efbc79d27ba2. which should give you the roleName ... { "clusterName" : "Cluster 1", "serviceName" : "HDFS-1", "roleName" : "HDFS-1-DATANODE-d1ee4c53b9fbc4786263f0420c5157e8" }, { ... using the roleName http://cm:7180/api/v19/clusters/Cluster%201/services/HDFS-1/roles/HDFS-1-DATANODE-d1ee4c53b9fbc4786263f0420c5157e8 Also full deployment details http://cm:7180/api/v19/cm/deployment
... View more
08-03-2021
07:39 AM
@zxcware Please follow below discussion, hopefully you will get the answers: Paywall question: https://community.cloudera.com/t5/Support-Questions/How-do-I-get-repository-credentials/m-p/311145#M224492 https://community.cloudera.com/t5/Support-Questions/https-archive-cloudera-com-cm6-6-2-0-ubuntu1604-displaying/m-p/311060#M224430 Long story short every Cloudera bits is behind Paywall now. You need a valid subscription for that Except you can Try the CDP latest version but not any Older version.
... View more
07-30-2021
06:58 AM
This seems a Connection time out to the name node so you may want to check if there is any Network issue or something else going on with CM's help. That should give you some clue.
... View more
07-30-2021
05:51 AM
@Ging Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
... View more
07-29-2021
01:02 AM
@haxsaansiddiqi This is expected. There seems to be a confusion about the different products. What you are doing is installing Private Cloud Experiences (Means CML, CDW & CDE etc.) which Needs a CDP Private Cloud Base Cluster which is synonyms of CDH/CM cluster in old days. CDP Experience don’t have TRIAL available that’s what the error says Installation of the Kubernetes components of the CDP experience needs a License. So if you want CDP Private Cloud Base cluster for TRIAL it's available and you can play around using the doc: https://www.cloudera.com/downloads/cdp-private-cloud-trial.html & https://docs.cloudera.com/cdp-private-cloud-base/7.1.4/installation/topics/cdpdc-trial-installation.html For Experience install you have to contact Sales Team to get the License. Hope this helps.
... View more
07-22-2021
06:50 AM
@rjwiggins80 May be this thread can guide a little: https://community.cloudera.com/t5/Support-Questions/Bad-Credentials-on-Accumulo-Tracer/td-p/131423 Else please send the full error message.
... View more
07-21-2021
01:46 AM
Hi, when i enabled this feature, hue is able to import all users from the LDAP group however sync_ldap_users_and_groups is trying to create same user again and its failing with duplicate key error. see my question at https://community.cloudera.com/t5/Support-Questions/hue-ldap-sync-duplicate-error/m-p/320951/highlight/true#M228224
... View more
07-20-2021
01:48 AM
@exploer The role logs needs to be in given format because at every start of service CM creates a runtime process directory as well for the Role logs it has rotation for logs after a given period of time/size. So the mm-dd-yy after logs makes it convenient and hard coded.
... View more
07-20-2021
01:45 AM
@Narendra_ No, For production purposes you have to buy subscription given that Cloudera software can’t be setup without using Ambari and Cloudera Manager and you can’t effectively monitor the cluster. You can install Hadoop Open Source version (Vanilla) but you are on own and will not get any Cloudera Support on that.
... View more
07-13-2021
06:11 AM
@JatinMalik You can find an answer to your question here: Re: How to download Ambari-repo
... View more
07-12-2021
09:13 PM
@sur I believe you have to Set below properties before executing create table statement . SET hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager; SET hive.support.concurrency=true; This seems a very known behaviour and I did a simple Googling and found the solutions on several places. Below are the references. https://stackoverflow.com/questions/42669171/semanticexception-error-10265-while-running-simple-hive-select-query-on-a-tran https://dbmstutorials.com/hive/hive-errors.html https://knowledge.informatica.com/s/article/526538?language=en_USv Hope this helps.
... View more
07-12-2021
07:14 AM
2 Kudos
@flowerbirds For CM server DB you can try something like below: In db.properties : com.cloudera.cmf.db.type = mysql
com.cloudera.cmf.orm.hibernate.connection.url=jdbc:mysql://<db_host>/scm?useSSL=true
com.cloudera.cmf.orm.hibernate.connection.username=scm
com.cloudera.cmf.orm.hibernate.connection.password=cloudera In /etc/default/ cloudera - scm -server add the following to export CMF_JAVA_OPTS : -Djavax.net.ssl.trustStore=/opt/cloudera/security/jks/truststore.jks Restart the Cloudera Manager server. NOTE: Just remember in some case we set ssl=true&sslmode=require so if the normal method means com.cloudera.cmf.orm.hibernate.connection.url=jdbc:mysql://<db_host>/scm?useSSL=true failed please try the ` ssl=true&sslmode=require as well and see.
... View more
07-11-2021
05:33 AM
1 Kudo
@gfranco In CDSW almost every POD is serving it's own purpose. The only thing which is possible is scale/de-scale the Web PODs if needed. Regarding the monitoring this is running K8s in the heart so you can use K8s command to watch the usages. Here is a good discussion about such commands/utility: https://github.com/kubernetes/kubernetes/issues/17512 From CDSW public doc you can refer this: https://docs.cloudera.com/cdsw/1.9.1/monitoring/topics/cdsw-monitoring.html?
... View more
07-11-2021
05:27 AM
@kalaicool261 There is nothing like terminal memory. This seems a engine memory issue. You should launch the session (engine) with larger memory and CPU from the drop down menu on Session launch page and see if the helps.
... View more
07-10-2021
08:32 PM
- Make sure in the phase of Install Agent , the heart beat test passed. - Make sure each host has cm_guid. [root@redhat1 cloudera-scm-agent]# pwd /var/lib/cloudera-scm-agent [root@redhat1 cloudera-scm-agent]# ls active_parcels.json cm_guid response.avro uuid [root@redhat1 cloudera-scm-agent]#
... View more
07-09-2021
11:03 AM
Hi @Bender Correct, our cluster is not kerberized yet. Is it possible connect SMM without kerberos? thanks Eduardo
... View more
07-02-2021
04:21 AM
@lovebo Does this folder exists? This seems coming from Webhdfs. You may have to look at permission as well for users.
... View more
06-29-2021
12:01 AM
@sanjaysubramani CDP Trial is available at : https://docs.cloudera.com/cdp-private-cloud/latest/release-guide/topics/cdpdc-trial-download-information.html But there is no older version which is available for trial due to Paywall Changes.
... View more
06-28-2021
11:54 PM
@exploer What you would like to customise? Parcels can be opened with tar utility and you can make some changes.
... View more
06-28-2021
11:52 PM
1 Kudo
@rok The Threshold value look less here. To avoid getting the reported health alerts we recommend to increase the corresponding configuration values: CM -> Cloudera Management Services -> Configuration -> Search for "Descriptor Fetch Max Tries" CM -> Cloudera Management Services -> Configuration -> Event Server -> Search for "Descriptor Fetch Tries Interval" and change this value for all the roles. We would recommend to increase the "Descriptor Fetch Max Tries" value from the default 5 to 10 in a first step. I after that you are facing the issue than you should look at the agent logs and start from there.
... View more