Re: App Timeline server duplicated (sort of) after...

yusaku · ‎02-14-2017

Perhaps Hive is pointing to the specific NameNode instance and not by the name service ID. You can use "hive metatool" to check (and update the pointer). Please see: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_hadoop-ha/content/ha-update-the-hive-metastore.html

yusaku · ‎02-09-2017

Ah, I see. That's a bummer.

yusaku · ‎02-09-2017

@Clifton Eyre Can you confirm if only the Metric Monitor component is in maintenance mode on that host, or the host itself is in maintenance mode?

yusaku · ‎02-09-2017

Hi Clifton, just to be clear... Are you putting the host in maintenance mode or the specific Metrics Monitor on that host in maintenance mode? If the Metrics Monitor on that host is in maintenance mode but the host is not in maintenance mode, it should technically not affect pushing configs for other components on that host. Also, Metrics Monitor is not part of stack upgrade so the ability to do upgrade should not be affected.

yusaku · ‎02-08-2017

1. Ambari Metrics Monitor is installed by default on all cluster nodes if Ambari Metrics is selected. It cannot be deleted from the UI. It doesn't hurt to leave that on there, but if you really don't want it running on that host, you can go to the Host Details page, shut down Metrics Monitor on that host, and put it in Maintenance Mode, so that alerts are not generated and it won't get started accidentally when doing operations at the Ambari Metrics service level. It's possible to delete it via the API but that's not recommended and you might be on your own because how the UI reacts in that situation isn't really tested (it might get added back automatically, etc). If you are willing to take that risk, you can first stop the Metrics Monitor from the UI on that host and issue the following API call: curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://AMBARI_SERVER_HOST:8080/api/v1/clusters/CLUSTERNAME/hosts/HOSTNAME/host_components/METRICS_MONITOR 2. You cannot customize alert thresholds on a per-host basis.

yusaku · ‎02-02-2017

Hi Wataru-san, Gobusatashiteorimasu 🙂 What version of Ambari and HDP are you using? ambarirca database was previously used to store MR job-related info in HDP 1.x. That has been replaced by YARN's App Timeline Service in HDP 2.x. If you are using HDP 2.x, then you don't really need to back that up.

yusaku · ‎01-23-2017

Awesome. If you could "accept" my answer, that would be great. AMS crashing issue might be due to the version of Ambari you are using (2.1.0 is quite old and there have been numerous stability improvements on AMS since then). If it is possible, I highly recommend you upgrade to Ambari 2.4.2.

yusaku · ‎01-23-2017

@Wayne Hoyenga Did the unwanted alerts disappear too?

yusaku · ‎01-23-2017

@Wayne Hoyenga Ok, you just need to issue Stop on that ATS instance on cg-hm09. Please go to Hosts -> cg-hm09 and choose Stop on App Timeline Server from the component list. Then try the delete API call again.

yusaku · ‎01-20-2017

Ok, the ATS instance that you are trying to delete is in one of the states that makes it non-deletable. Can you get me the output of: curl -uadmin:PW -k https://localhost:8443/api/v1/clusters/ROGERGPFS/hosts/cg-hm09.ncsa.illinois.edu/host_components/APP_TIMELINE_SERVER

yusaku · ‎01-20-2017

No worries. If you can provide the stack trace from the ambari-server.log file I should be able to help you further.

yusaku · ‎01-20-2017

🙂 Can you get the corresponding stack trace from the server log? It's at /var/log/ambari-server/ambari-server.log

yusaku · ‎01-20-2017

Thanks for sharing the output. Yes, that's exactly what I meant (REST API call to get the ATS instances registered with Ambari). To delete the bad ATS instance from Ambari, you can issue the following API call: curl -u admin:admin -k -H "X-Requested-By: ambari" -X DELETE https://localhost:8443/api/v1/clusters/ROGERGPFS/hosts/<hostname-with-bad-ATS>/host_components/APP_TIMELINE_SERVER

yusaku · ‎01-20-2017

Hi Wayne. What's the output of /api/v1/clusters/<cluster_name>/host_components?HostRoles/component_name=APP_TIMELINE_SERVER Do you see two ATS instances in the output?

yusaku · ‎01-07-2017

Please refer to http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.18/bk_ambari-installation/content/_download_the_ambari_repo.html

yusaku · ‎01-07-2017

Ambari 2.2.0 did not support HDP 2.4. It was added in Ambari 2.2.1. However, you should use Ambari 2.2.2, as it is more stable.

yusaku · ‎12-28-2016

You should also be able to specify the condition IsActiveMaster=false to have the API respond with non-active HBaseMasters only. Instead of saying "fields=metrics/hbase/master/IsActiveMaster" in the query, you can turn that into a predicate by saying "metrics/hbase/master/IsActiveMaster=false".

yusaku · ‎12-20-2016

Since Grafana was introduced in Ambari 2.2.2, the sandbox from an older version would not have had the port forwarding rule for Grafana UI that listens on port 3000.

yusaku · ‎12-20-2016

It seems like the Grafana daemon is up. Is your Virtualbox set up to port forward 3000? If you do "curl http://localhost:3000" from inside the VM's SSH, what do you see?

yusaku · ‎04-22-2016

Elitsa, There are two ways to register hosts with Ambari: automatically via SSH by supplying a private key to Ambari (as you have done) or manually (by running yum install ambari-agent on the host, modifying /etc/ambari-agent/conf/ambari-agent.ini's "hostname" line to the Ambari's hostname, and running "ambari agent start"). When using the SSH method, Ambari does NOT store the SSH private key that you supplied (it is used once to do passwordless SSH into the server to set up the agent and discarded). So there's no way or need to "change the private key" in Ambari.

yusaku · ‎11-05-2015

You can replace sync_type to specific (from existing), and add names attribute with a comma-delimited list of users/groups. Here's an example: curl -uadmin:admin -H 'X-Requested-By: ambari' -X POST -d '[{"Event": {"specs": [{"principal_type": "users", "sync_type": "specific", "names": "bill,jenny,mike"},{"principal_type":"groups","sync_type":"specific", "names": "group1,group2"}]}}]' http://localhost:8080/api/v1/ldap_sync_events

yusaku · ‎11-05-2015

Try: curl -uadmin:admin -H 'X-Requested-By: ambari' -X POST -d '[{"Event": {"specs": [{"principal_type": "users", "sync_type": "existing"}, {"principal_type": "groups", "sync_type": "existing"}]}}]' http://localhost:8080/api/v1/ldap_sync_events You will get a response like: { "resources" : [ { "href" : "http://localhost:8080/api/v1/ldap_sync_events/13", "Event" : { "id" : 13 } } ] } You can GET on this href to get status of the sync: curl -uadmin:admin http://localhost:8080/api/v1/ldap_sync_events/13 { "href" : "http://localhost:8080/api/v1/ldap_sync_events/13", "Event" : { "id" : 13, "specs" : [ { "sync_type" : "existing", "principal_type" : "users" }, { "sync_type" : "existing", "principal_type" : "groups" } ], "status" : "COMPLETE", "status_detail" : "Completed LDAP sync.", "summary" : { "groups" : { "created" : 0, "removed" : 0, "updated" : 0 }, "memberships" : { "created" : 0, "removed" : 0 }, "users" : { "created" : 0, "removed" : 0, "updated" : 0 } }, "sync_time" : { "end" : 1446751142546, "start" : 1446751142462 } } }

yusaku · ‎10-31-2015

I would be great if someone can play around and come up with useful and practical Grafana dashboards with the Ambari data source. We can publish these so others can import.

yusaku · ‎10-31-2015

Grafana is a popular, open-source graph and dashboard builder ( licensed under Apache License, Version 2.0). Grafana is feature rich; not only does it let users create customizable and shareable dashboards, it also offers templated/scripted dashboards, LDAP integration, multiple data sources, and more. Out of the box, Grafana supports data sources such as Graphite, OpenTSDB, ElasticSearch, InfluxDB, CloudWatch, and etc. Luckily, the data source part is pluggable; it was not too difficult to create an Ambari data source for it: https://github.com/u39kun/ambari-grafana It works for all service metrics currently exposed via Ambari: HDFS, YARN, HBase, Storm, Kafka, Flume, Accumulo, and Ambari Metrics. It supports typeahead of component names and their associated metrics, as well as aggregation (“avg”, “sum”, “min”, and “max” of metrics across all instances of the specified component). Host Metrics are not supported yet, but it shouldn't be too difficult to add. Please visit https://github.com/u39kun/ambari-grafana/blob/master/README.md for detailed and easy-to-follow instructions on how to install and use Grafana with Ambari as a data source. Note: Development of the Ambari data source in Grafana was done against Ambari 2.1.2 + HDP 2.3.

yusaku · ‎10-02-2015

Did adding smokeuser work, @wgonzalez@hortonworks.com?

yusaku · ‎09-29-2015

Sounds like https://hortonworks.jira.com/browse/BUG-41647. Does your Hive JDBC URL contain FQDN? If not, YARN config page won't load in Ambari 2.1.0. This was fixed in 2.1.1.

yusaku · ‎09-29-2015

1. Why not use Blueprint? Or are you trying to add a service to an existing cluster? 2. Do you have cluster-env with smokeuser defined? It looks like ZooKeeper install fails without it. curl -u admin:admin -i -H "X-Requested-By: ambari -X PUT -d '{"Clusters" : {"desired_configs": {"type": "cluster-env","tag": "20150924","properties": {"smokeuser":"ambari-qa"}}}}' http://127.0.0.1:8080/api/v1/clusters/Sandbox should get you thru, but you might want to look at an existing working cluster and define all the standard properties that come in cluster-env.

yusaku · ‎09-29-2015

There's a field called "Ambari Metrics User" under "Advanced ams-env". See the screenshot.

Online	Offline
Last Visited	‎11-08-2017 07:29 PM

Date Registered	‎09-29-2015 12:19 AM
Last Visited	‎11-08-2017 07:29 PM
Total Messages Posted	32
Total Kudos Received	41

Re: App Timeline server duplicated (sort of) after...

Re: Creating Ambari Stacks on a new install

Re: Grafana service started up, Grafana UI not sta...

Re: How do I automate the Ambari LDAP sync?

Re: Error while installing component on a host via...

Re: Alert - Name Node HA and Hive Metastore Proces...

Re: Remove Metrics Monitor or change thresholds fo...

Re: Remove Metrics Monitor or change thresholds fo...

Re: Remove Metrics Monitor or change thresholds fo...

Re: Remove Metrics Monitor or change thresholds fo...

Re: failed to backup ambarirca

Re: App Timeline server duplicated (sort of) after...

Re: App Timeline server duplicated (sort of) after...

Re: App Timeline server duplicated (sort of) after...

Re: App Timeline server duplicated (sort of) after...

Re: App Timeline server duplicated (sort of) after...

Re: App Timeline server duplicated (sort of) after...

Re: App Timeline server duplicated (sort of) after...

Re: App Timeline server duplicated (sort of) after...

Re: Creating Ambari Stacks on a new install

Re: Creating Ambari Stacks on a new install

Re: How to get backup hmaster in Hbase HA mode in ...

Re: Grafana service started up, Grafana UI not sta...

Re: Grafana service started up, Grafana UI not sta...

Re: Change SSH private key after configurations?

Re: How do I automate the Ambari LDAP sync?

Re: How do I automate the Ambari LDAP sync?

Re: Use Grafana with Ambari as a Data Source

Use Grafana with Ambari as a Data Source

Re: Error while installing component on a host via...

Re: I upgraded Ambari to Ambari 2.1.0 and HDP to H...

Re: Error while installing component on a host via...

Re: Where to change AMS account name in Ambari 2.1