@bgooley Hi, I have an requirement for installing CDH5.11 to be installed in my cluster. So i have followed your above point and installed the latest Clouderamanager and post that the cluster created with CDH5.16.1(as default mentioned in the cloudera docs). And after that I have uninstalled the CD5.16.1 parcel and added the parcel repo for CDH5.11 and installed the same. Now my cluster is active with the CDH5.11. I am only bothered about my CDH5.11. Could you please confirm what i did is correct or do i need to follow any other instruction to install the CDH5.11.   Sorry to add in the old thread.   Thanks in Advance! ... View more

@peter_ableda Thanks Peter for your time and have a grt day! ... View more

@peter_ableda Thanks Peter. Now I am able to submit the spark job from cdsw master. Does cloudera provide the user level isoloation when they access to the cdsw project/content as different user can distrub /edit the same content? ... View more

@peter_ableda You need to make sure that this host can be resolved (both forward/reverse) from inside a CDSW session via DNS. Is that means we need add another dns entry for the CDH master host(clouderamaster.lab.test.com) so that it can be accessiable from cdsw master host? ... View more

@peter_ableda Hi Peter, When we say we need to add the dns entry details of the master host. Are we trying to say we need to add the dns entry of the clouderamaster host dns entry or the cdswmaster dns entry?   As of now I have added the dns entry of the cdsw master host. Also, we need to add the xtra dot(.) after the hostname as per the documentation(*.cdsw.lab.test.com./cdsw.lab.test.com.)? Sorry I am little confused with the docs. ... View more

@peter_ableda  One Final Question. In my cdsw terminal the Ip addess was different(pod ip not the cdsw host ip) and that was the reason i am unable to connect to the master hostname(clouderamaster.<domain>.com) but i am able to ping using the master host ip from cdsw terminal.    Also, I have not done hadoop Authentication in the cdsw admin web ui. Do you think its must to have access to the cluster and from where I can find the Principal/username and pwd/keytab to get access to the cluster.  ... View more

@peter_ableda Thanks Peter for your detailed explanation and your valuable time. Will check how I can access the CDH master node(YARN/HDFS Name Node) from my cdsw terminal.Not sure if the HTTP proxy set up will help or not. ... View more

@peter_ableda Thanks for your response.   Step 1: I have checked and could find we dont have any firewall between my machines. Step 2:  DNS can do forward/reverse resolution on your master hostname/ip> Yes its working for cdswmaster host where I have installed cdsw(added to the dns entry as below which resolves forward as well as backword resolution) Step 3: I have added 2 DNS entries as below for the cdswmaster host(cdswmaster.lab.test.com) *.cdswmaster.lab.test.com  IN A IP cdswmaster.lab.test.com     IN A IP Little confused here do i need to add the dns names as above or do i need to change as cdsw(cdsw.lab.test.com) from cdswmaster as per the documentation.   Step 4: Checked the terminal from cdsw web ui and i am unable to ping to clouderamaster.lab.test.com(where cloudera manager was install). But I am able to ping to the terminal ip from the clouderamaster.lab.test.com. I believe here some set up should be corrected inorder to ping the clouderamaster host correctly. Please advise   Also, do you see anyother set up i need to correct from my end to get going in cdsw. Sorry for little more demanding on the same as i find cdsw is little more complex interms of the set up. ... View more

@cjervis Thanks for your quick response.  ... View more

@peter_ableda Sorry to ask you. Actually I have installed cdsw 1.4 on my cdsw machine and when I am trying to start the sparksession/running any hdfs commands then I am getting the error as unknowhostException with the  clouderamaster hostname. I am very new to cloudera so not sure which set up i am missing as i followed the set up related to pyspark(by importing the template while creating the project and starting the pyhton 2 env to run the pyspark job). It would be great help if you can guide me something which I am missing from my set up. Thanks in Advance!!! ... View more