Cloudera Community
Announcements
Celebrating as our community reaches 100,000 members! Thank you!
Rahul_Tikekar
user rank
Contributor

Re: Basic Question: Install Spark on HDP 2.3 using...

by Contributor in Support Questions
‎02-12-2016 07:52 PM
‎02-12-2016 07:52 PM
@Neeraj Sabharwal I guess my confusion lies with where the Spark binaries are installed. And that in turn may have to do with the execution of Spark: there are three modes: local, standalone, and YARN Cluster. I guess the way it is set up now, I can run it as a YARN cluster or local but not in standalone mode. If I want to run it in a standalone mode, I will need the Sparl clients on all nodes and will have to configure the slaves files, etc. Am I correct in this understanding? Thanks. ... View more

Re: Basic Question: Install Spark on HDP 2.3 using...

by Contributor in Support Questions
‎02-12-2016 02:48 PM
1 Kudo
‎02-12-2016 02:48 PM
1 Kudo
@ Neeraj Sabharwal My question is will Ambari configure the hosts (spark master and spark client) or should I do that? ... View more

Basic Question: Install Spark on HDP 2.3 using Amb...

by Contributor in Support Questions
‎02-12-2016 02:38 PM
2 Kudos
‎02-12-2016 02:38 PM
2 Kudos
I have a 9-node (6 slaves, 2 masters and 1 edge node) cluster of HDP 2.3 with Ambari running. Currently only HDFS, YARN, Zookeeper, and Ambari metrics are running. I'd like to install Spark. When I did an install of Spark 1.4.1 via Ambari, it installed a Spark history server on one node and spark client on 2 nodes. I don't see spark on the other nodes. Do I have to install Spark client on every node and set the master and slaves configuration and start spark manually? I am not connected to the Internet and there are no proxy servers. ... View more
Labels:

Re: Ambari metrics display issue

by Contributor in Support Questions
‎02-08-2016 08:04 PM
1 Kudo
‎02-08-2016 08:04 PM
1 Kudo
Yes! Thank you @Geoffrey Shelton Okot. That did it - I followed the instructions in the document to sync the ntp servers and I'm in business. Thanks! ... View more

Re: Ambari metrics display issue

by Contributor in Support Questions
‎02-08-2016 03:11 PM
1 Kudo
‎02-08-2016 03:11 PM
1 Kudo
The firewall on all the nodes is off. The metrics monitors are running on all nodes (I can even see the log file where the emitter.py is contacting the metrics collector). ... View more

Re: Ambari metrics display issue

by Contributor in Support Questions
‎02-08-2016 02:59 PM
1 Kudo
‎02-08-2016 02:59 PM
1 Kudo
I am not using a proxy server. The strange part is that the metrics from the edge node and two master servers are displayed but those from the data nodes are not. ... View more

Re: Ambari metrics display issue

by Contributor in Support Questions
‎01-14-2016 03:01 PM
‎01-14-2016 03:01 PM
@Neeraj Sabharwal Yes we use FQDN and local repositories. So proxy server should not be an issue because the cluster has no Internet access. Also, all the nodes are set up identically so why do metrics from 3 hosts show and 6 don't? Thanks. ... View more

Ambari metrics display issue

by Contributor in Support Questions
‎01-14-2016 02:53 PM
1 Kudo
‎01-14-2016 02:53 PM
1 Kudo
I have a HDP 2.3 cluster with 9 nodes: 1 management node, 2 master nodes, and 6 slave nodes. The Ambari dashboard shows the metrics (cpu usage, disk usage, etc.) from the management and master nodes. The metrics from the slave nodes are not displayed (metrics service may not be installed or inaccessible). I have checked and the metrics monitor service is installed, running, and sending messages to the collector. Ntp is also running. So why am I not seeing those metrics? ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎07-09-2018 08:10 PM
Community Statistics
Member Since ‎01-14-2016 02:44 PM
Last Visited ‎07-09-2018 08:10 PM
Posts 10
Kudos received 8