Member since
09-15-2016
13
Posts
1
Kudos Received
0
Solutions
02-04-2020
06:33 AM
I have a CDH cluster with below configuration. Spark gateway is installed on all machines. Each node has 22 cores
2 name nodes
3 Kafka nodes
4 data nodes
1 node to run mysql content store
I am trying to find out how many worker/slave nodes are assigned to run spark applications in the cluster. When I see the hadoop UI it shows total vcores assinged as 88. Does that mean only 4 data nodes are configured as worker nodes ? Where and how can I see what all worker/slave nodes are configured.
We are using YARN as resource manager.
thanks
RM
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache YARN
-
Cloudera Manager
09-15-2016
09:28 PM
Found how to solve No need to add a public DNS, the welcome screen will come up with IP address as well goto mysandbxo->network interfaces->click interface name->network security group->inbound security rules-> change Tutorials to protocol any http://<ip address>:80/ you will see the welcome screenscreen.jpg
... View more
09-15-2016
09:17 PM
Thanks. I checked in my smartphone and its working. I am at work right now so I am guessing some policy at my work place is preventing to bring it up
... View more
09-15-2016
08:48 PM
I was able to assign a public DNS http:// dns name>.eastus.cloudapp.azure.com:8888/ http:// dns name>.eastus.cloudapp.azure.com/ neither works http:// dns name>.eastus.cloudapp.azure.com:8080/ does bring up the ambari login page but have no idea what is the userid/password, to be able to log into VM (using putty), I believe you have to set the authentication type as SSH while purchasing, but I purchased with password type
... View more
09-15-2016
08:31 PM
Thanks Hellmar. How do I assign a public DNS entry to the sandbox? I
don't know how to and the instructions don't provide much info.
... View more
09-15-2016
06:15 PM
Followed URL to setup VM on Azure http://hortonworks.com/hadoop-tutorial/deploying-hortonworks-sandbox-on-microsoft-azure/ Step 12. Take note of the IP address. In this example, it is 22.99.9.232 and
highlighted in a green box. Your machine will have a different IP.
Open up a new browser tab and enter in your IP address followed by the
port 8888. first of all 8888 shows network timed out error tried 8080 and get to Ambari login page. Used the userid and password given at the time of sandbox creation but it don't login searched various blogs, forum here but don't know how to ssh into the vm and set things. Please help
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)