Cloudera Community
jsensharma
user rank
user rank
Master Mentor

Re: need to control spark2-history size

by Master Mentor Master Mentor in Support Questions
‎07-07-2019 10:32 PM
‎07-07-2019 10:32 PM
@John Did it help? Please update the thread. If you have any followup query ... of not then please mark this thread as answered by clicking on the "Accept" button. ... View more

Re: REST API + how to verify that component not ex...

by Master Mentor Master Mentor in Support Questions
‎07-07-2019 10:27 PM
1 Kudo
‎07-07-2019 10:27 PM
1 Kudo
@Michael Bronson You can make the following API call to find out on how many nodes the "SPARK2_THRIFTSERVER" is installed. Please check the property "installed_count" in the response. # curl -iv -u admin:admin -H "X-Requested-By: ambari" -X GET "http://$AMBARI_SERVER:8080/api/v1/clusters/hdp/services/SPARK2/components/SPARK2_THRIFTSERVER" If you want to know the list of hosts where the "SPARK2_THRIFTSERVER" might be installed in your cluster and to know their current state you can make the following API call. # curl -iv -u admin:admin -H "X-Requested-By: ambari" -X GET "http://$AMBARI_SERVER:8080/api/v1/clusters/hdp/services/SPARK2/components/SPARK2_THRIFTSERVER?fields=host_components/HostRoles/host_name,host_components/HostRoles/state" . ... View more

Re: why ambari version not displayed from ambari G...

by Master Mentor Master Mentor in Support Questions
‎07-05-2019 02:11 PM
1 Kudo
‎07-05-2019 02:11 PM
1 Kudo
@Michael Bronson Ambari version can be seen in the Ambari UI as following: Ambari UI ---> admin (Top Right corner dropdown) --> About . Ambari binaries comes from Ambari Repo. The Stack & Version Page in the Ambari UI shows the versions of HDP (HDF..etc) service version. . One additional thing we noticed in your output is this : "ambari-metrics-collector-2.5.0.3-7.x86_64". Looks like some how the AMS collector is not completely upgraded. The Ambari Post upgrade steps are important. https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.2/bk_ambari-upgrade/content/upgrade_ambari_metrics.html ... View more

Re: time gap between machines in ambari cluster

by Master Mentor Master Mentor in Support Questions
‎07-05-2019 08:04 AM
‎07-05-2019 08:04 AM
@Michael Bronson There should be ideally no Gap in time. All the cluster nodes should be in exact time sync. Else there can be many issues like Metrics data (incorrect time), Kerberos ticket issue like well known "Clock skew" error ...etc https://community.hortonworks.com/content/supportkb/187925/gssexception-failure-unspecified-at-gss-api-level.html ... View more

Re: time gap between machines in ambari cluster

by Master Mentor Master Mentor in Support Questions
‎07-05-2019 07:59 AM
1 Kudo
‎07-05-2019 07:59 AM
1 Kudo
@Michael Bronson Enabling "ntpd" services or "chronyd" are one of the requirement for setting up Ambari Cluster. https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.2/bk_ambari-installation/content/enable_ntp_on_the_cluster_and_on_the_browser_host.html . https://github.com/apache/ambari/blob/release-2.6.2/ambari-agent/src/main/python/ambari_agent/HostInfo.py#L128-L130 ... View more

Re: Rolling upgrade to 2.6.5

by Master Mentor Master Mentor in Support Questions
‎07-05-2019 07:35 AM
‎07-05-2019 07:35 AM
@Michael Bronson You do not need to delete the whole Spark2 Service. You can delete the "SparkThrift Server" host component which are installed on the two hosts (as per your initial screenshot) and then check if your Spark2 is all working fine ... Prior to the HDP upgrade please check/run the Spark2 service check. If everything is green and running then you can start upgrading to HDP 2.6.5. Once the upgrade is completed then any time you can click on the Ambari UI --> Hosts (Tab) --> Specific Host --> "Add" (Button) and then add the "SparkThrift Server" when you need it. ... View more

Re: how to remove the spark thrift servers compone...

by Master Mentor Master Mentor in Support Questions
‎07-05-2019 07:19 AM
1 Kudo
‎07-05-2019 07:19 AM
1 Kudo
@Michael Bronson . Example: # curl -iv -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://$AMBARI_SERVER:8080/api/v1/clusters/$CLUSTER_NAME/hosts/$HOSTNAME_WHERE_SPART_IS_INSTALLED/host_components/SPARK2_THRIFTSERVER ... View more

Re: Rolling upgrade to 2.6.5

by Master Mentor Master Mentor in Support Questions
‎07-05-2019 07:16 AM
‎07-05-2019 07:16 AM
@Michael Bronson No, you can do this: Ambari UI --> Spark2 --> Summary Page (here you will see SparkThrift Server 0/2) Which means it is already installed on 2 host in your cluster. Just click on the "SparkThrift Server" 0/2 and then it will show the Hosts where it is installed. Then in the Hosts page of those host you can click on the "Delete" option. . ... View more

Re: Rolling upgrade to 2.6.5

by Master Mentor Master Mentor in Support Questions
‎07-05-2019 06:00 AM
‎07-05-2019 06:00 AM
@Michael Bronson Yes either option1 or option 2 . If you have not used spark thrift server in your cluster then you can remove it before starting the Upgrade and once the upgrade is done then later whenever you need it then you can just add it by clicking on the individual host page "Add" button. ... View more

Re: why the option uninstall not defined when perf...

by Master Mentor Master Mentor in Support Questions
‎07-04-2019 11:31 PM
1 Kudo
‎07-04-2019 11:31 PM
1 Kudo
@Michael Bronson This is in intended behaviour in Ambari that it does not provide the "Uninstall" option. Uninstalling binaries via some automated tasks/API may be risky as some fo the packages comes with a lots of dependencies. Hence there is no such option offered. . What is the reason that you want to uninstall a newly registered/installed HDP binary? ... View more
Contact Me
Community Statistics
Member Since ‎03-14-2016 01:07 PM
Last Visited
Posts 4,721
Kudos received 1096