That fine. can you try below? sparkSession.builder() <--------------should work? then .config( config prop) .appName().getOrCreate() Also most important thing this could be a red herring you have to see if the session is running and you job succeed. We have seen this issue in past seems. ... View more

@engerej The issue could lies with JNDI and the fact that it does not handle a group with a leading space. So check if your groups having space in the name.  ... View more

@dmharshit  2 things going on here. 1. The link https://archive.cloudera.com/cm7/ is not valid because thus is showing Cloudera Manager not the CDH (Cloudera Runtime Version).  2. So what you need is to download the CDH binary for CDP7.1.6 version which can be found here:  https://archive.cloudera.com/cdh7/latest/parcels/ Or for the Spark Standalone parcels https://archive.cloudera.com/p/spark3/3.1.7270.0/   ... View more

Hi  Please check the CF stack in AWS for this deployment. If it is failing at creating a load balancer then check  Maybe it hit ELB quota. The dex-base installation creates an LB. You might want to increase the AWS ELB quota and retry the provisioning. Otherwise, let us know if you have overcome this issue with a different resolution ... View more

@Seedy There could be various reasons. You have to see the full agent logs. However to start with this issue I would suggest few sanity checks.  1)Resolve network issue related to firewall restrictions in accessing the repo files 2)Correct permissions on /opt/cloudera/ directories 3)Check and change the ownership. $chown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo/* 4)Re - add the hosts from Cloudera Manager However most importantly you have to see if you can download the parcels manually on the node under this dir. Please follow the below page for detailed overview.  https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ig_parcels.html ... View more

@devdb Take a look of this may be it can help : https://archive.cloudera.com/cm7/7.2.4/generic/jar/cm_api/apidocs/   Also you can get the hosts details from this :  http://CM-SERVER:7180/api/v19/clusters/cluster1/services   For each ‘hosts’ in http://cm:7180/api/v19/hosts    iterate through the hostId … { "items" : [ { "maintenanceOwners" : [ ], "hostId" : "15b5c47f-9156-4347-abd4-efbc79d27ba2", <=== hostid "ipAddress" : "IP", "hostname" : "host", http://cm:7180/api/v19/hosts/15b5c47f-9156-4347-abd4-efbc79d27ba2. which should give you the roleName ... { "clusterName" : "Cluster 1", "serviceName" : "HDFS-1", "roleName" : "HDFS-1-DATANODE-d1ee4c53b9fbc4786263f0420c5157e8" }, { ... using the roleName http://cm:7180/api/v19/clusters/Cluster%201/services/HDFS-1/roles/HDFS-1-DATANODE-d1ee4c53b9fbc4786263f0420c5157e8  Also full deployment details http://cm:7180/api/v19/cm/deployment ... View more

@zxcware  Please follow below discussion, hopefully you will get the answers:   Paywall question: https://community.cloudera.com/t5/Support-Questions/How-do-I-get-repository-credentials/m-p/311145#M224492 https://community.cloudera.com/t5/Support-Questions/https-archive-cloudera-com-cm6-6-2-0-ubuntu1604-displaying/m-p/311060#M224430   Long story short every Cloudera bits is behind Paywall now. You need a valid subscription for that Except you can Try the CDP latest version but not any Older version.  ... View more

@haxsaansiddiqi This is expected. There seems to be a confusion about the different products.  What you are doing is installing Private Cloud Experiences (Means CML, CDW & CDE etc.) which Needs a CDP Private Cloud Base Cluster which is synonyms of CDH/CM cluster in old days.  CDP Experience don’t have TRIAL available that’s what the error says Installation of the Kubernetes components of the CDP experience needs a License.  So if you want CDP Private Cloud Base cluster for TRIAL it's available and you can play around using the doc:  https://www.cloudera.com/downloads/cdp-private-cloud-trial.html & https://docs.cloudera.com/cdp-private-cloud-base/7.1.4/installation/topics/cdpdc-trial-installation.html   For Experience install you have to contact Sales Team to get the License. Hope this helps.  ... View more

@Chaitrali I responded to your question in that earlier thread.     ... View more

@rjwiggins80 May be this thread can guide a little: https://community.cloudera.com/t5/Support-Questions/Bad-Credentials-on-Accumulo-Tracer/td-p/131423   Else please send the full error message.  ... View more

@exploer The role logs needs to be in given format because at every start of service CM creates a runtime process directory as well for the Role logs it has rotation for logs after a given period of time/size. So the mm-dd-yy after logs makes it convenient and hard coded.  ... View more

@Narendra_ No, For production purposes you have to buy subscription given that Cloudera software can’t be setup without using Ambari and Cloudera Manager and you can’t effectively monitor the cluster.    You can install Hadoop Open Source version (Vanilla) but you are on own and will not get any Cloudera Support on that.  ... View more

@sur I believe you have to Set below properties before executing create table statement .  SET hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager; SET hive.support.concurrency=true; This seems a very known behaviour and I did a simple Googling and found the solutions on several places. Below are the references.  https://stackoverflow.com/questions/42669171/semanticexception-error-10265-while-running-simple-hive-select-query-on-a-tran https://dbmstutorials.com/hive/hive-errors.html https://knowledge.informatica.com/s/article/526538?language=en_USv Hope this helps.  ... View more

- Make sure in the phase of Install Agent , the heart beat test passed. - Make sure each host has cm_guid. [root@redhat1 cloudera-scm-agent]# pwd /var/lib/cloudera-scm-agent [root@redhat1 cloudera-scm-agent]# ls active_parcels.json cm_guid response.avro uuid [root@redhat1 cloudera-scm-agent]#   ... View more

@lovebo Does this folder exists? This seems coming from Webhdfs. You may have to look at permission as well for users.  ... View more

@sanjaysubramani CDP Trial is available at : https://docs.cloudera.com/cdp-private-cloud/latest/release-guide/topics/cdpdc-trial-download-information.html   But there is no older version which is available for trial due to Paywall Changes.  ... View more

@exploer What you would like to customise? Parcels can be opened with tar utility and you can make some changes.  ... View more

@rok The Threshold value look less here. To avoid getting the reported health alerts we recommend to increase the corresponding configuration values: CM -> Cloudera Management Services -> Configuration -> Search for "Descriptor Fetch Max Tries" CM -> Cloudera Management Services -> Configuration -> Event Server -> Search for "Descriptor Fetch Tries Interval" and change this value for all the roles. We would recommend to increase the "Descriptor Fetch Max Tries" value from the default 5 to 10 in a first step. I after that you are facing the issue than you should look at the agent logs and start from there.  ... View more