question Re: how to find config type by API command in Archives of Support Questions (Read Only)

how to find config type by API command

mike_bronson7 — Fri, 11 Aug 2017 13:46:58 GMT

How to know the configuration type for parameter in ambari cluster by API

examples of configuration type - core-site, hdfs-site, mapred-queue-acls

lets say I want to find the configuration type for the parameter - "mapreduce.map.memory.mb” , in this case configuration type is mapred-site

Re: how to find config type by API command

jsensharma — Fri, 11 Aug 2017 13:51:55 GMT

@uri ben-ari

Something like this we can try using "config.sh" script. (one approach)

# /var/lib/ambari-server/resources/scripts//configs.sh -u admin -p admin -port 8080 get localhost test_cluster hdfs-site

Re: how to find config type by API command

jsensharma — Fri, 11 Aug 2017 13:54:15 GMT

@uri ben-ari

Using Amabri API you can try the following:

curl -iv -u admin:admin -H "X-Requested-By: ambari" -X GET  http://amb25101.example.com:8080/api/v1/clusters/plain_ambari/configurations?type=hdfs-site

Then get the latest version tag from the above call and then use that version in the API call.

curl -iv -u admin:admin -H "X-Requested-By: ambari" -X GET  http://amb25101.example.com:8080/api/v1/clusters/plain_ambari/configurations?type=hdfs-site&tag=version1497013815573

Re: how to find config type by API command

mike_bronson7 — Fri, 11 Aug 2017 13:57:47 GMT

thank you Jay SenSharma your example print all parameters that belong to he configuration type , but we need to know the configuration type for the parameter , I mean lets say we have some parameter how to know under which configuration type parameter is belong ?

Re: how to find config type by API command

mike_bronson7 — Fri, 11 Aug 2017 14:00:49 GMT

just to clear my question , we have parameter but we not know to which configyuration type this parameter is belong

Re: how to find config type by API command

jsensharma — Fri, 11 Aug 2017 14:06:00 GMT

@uri ben-ari

When we make a call to /clusterName API then we should be able to find the right config that has this property.

curl -u admin:admin -H "X-Requested-By: ambari" -X GET  http://amb25101.example.com:8080/api/v1/clusters/plain_ambari

and then we can grep 'mapreduce.map.memory.mb' to find which config has thie entry.

Re: how to find config type by API command

mike_bronson7 — Fri, 11 Aug 2017 14:13:21 GMT

from some reason I get - { "status" : 404, "message" : "The requested resource doesn't exist: Cluster not found, clusterName=plain_ambari" ( when I run this - curl -u admin:admin -H "X-Requested-By: ambari" -X GET http://ambarir02.urs.com:8080/api/v1/clusters/plain_ambari

Re: how to find config type by API command

jsensharma — Fri, 11 Aug 2017 14:17:47 GMT

@uri ben-ari

"plain_cluster" is the Name of my ambari cluster. You will need to replace it with your cluster name. You can find the clustername using the following call.

curl -u admin:admin -H "X-Requested-By: ambari" -X GET  http://$AMBARI_HOST:8080/api/v1/clusters/

Re: how to find config type by API command

mike_bronson7 — Fri, 11 Aug 2017 14:23:18 GMT

ok now I get all mapreduce.map.memory.mb parameters but not the config type ( I used grep to match them ) , still not get the config type for the parameter

Re: how to find config type by API command

mike_bronson7 — Fri, 11 Aug 2017 14:36:29 GMT

the main target is to find the config type because one of the script ( config.sh) arguments is the config type , so when we want to change the parameter value by the script we need the config type , but I not have the config type info , so how to know the config type when we want to change the parameter ?

Re: how to find config type by API command

mike_bronson7 — Fri, 11 Aug 2017 15:59:40 GMT

Jay - any suggestion?

Re: how to find config type by API command

mike_bronson7 — Fri, 11 Aug 2017 17:08:33 GMT

any new suggestion?

Re: how to find config type by API command

jsensharma — Fri, 18 Aug 2017 00:58:39 GMT

@uri ben-ari

There is no reverse mapping ... i mean if you know a parameter then there is no direct way to find which XML file that parameter will go. Usually the admin or the component owner knows which configuration parameter will impact which service and component. And which configuration file (config_type) should have the mapping for that parameter.

The best way is to find more information about the parameter and then we will know where that parameter should get applied.

Re: how to find config type by API command

jsensharma — Fri, 18 Aug 2017 01:01:40 GMT

Example: If i want to add a parameter "hadoop.security.auth_to_local" to some config ... then i will need to know about it.

I found in the following link that it can be applied to "core-site" , So i will need to add it to that config in ambari.

https://hadoop.apache.org/docs/r2.8.0/hadoop-project-dist/hadoop-common/core-default.xml