question Re: ambari cluster + what is the right syntax in order to upload json file in Archives of Support Questions (Read Only)

ambari cluster + what is the right syntax in order to upload json file

mike_bronson7 — Wed, 09 Aug 2017 15:37:17 GMT

hi all

we have ambari cluster Version 2.5.0.3 , while all clients machines are Linux redhat

first I generated the json file to my Linux machine as the following: ( on ambari server machine )

curl -H "X-Requested-By: ambari" -X GET -u admin:admin http://130.14.6.28:8080/api/v1/clusters/HDP01\?format\=blueprint > blueprint.json

then I update the blueprint.json file with some changes about the parameters and their values

finally my target is to upload the new blueprint.json to ambari cluster in order to take affect !

path=/root

curl -H "X-Requested-By: ambari" --data @ -X POST -u admin:admin http://130.14.6.28:8080/api/v1/blueprints/HDP01 -d @$path/blueprint.json

but I get the following errors ( seems because wrong syntax )

Warning: Couldn't read data from file "", this makes an empty POST. { "status" : 400, "message" : "Invalid Request: Malformed Request Body. An exception occurred parsing the request body: Unexpected character ('&' (code 38)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')\n at [Source: java.io.StringReader@4a3484a6; line: 1, column: 3]"

please advice what is wrong in my syntax ? and what is the right syntax in order to upload the new update blueprint.json file

Re: ambari cluster + what is the right syntax in order to upload json file

jsensharma — Wed, 09 Aug 2017 16:05:52 GMT

@uri ben-ari

You should not use the > redirect operator to move the JSON response to a file ... Instead use the Curl "-o /PATH/TO/file.json") to do the same . Please try

Example:

# curl  -u admin:admin -H "X-Requested-By: ambari" -X GET http://130.14.6.28:8080/api/v1/clusters/HDP01?format=blueprint -o /tmp/HDP01_blueprint.json

Still if you find any issue with the JSON data then please attach the edited JSON so that we can check the JSON characters are fine or not?

Re: ambari cluster + what is the right syntax in order to upload json file

mike_bronson7 — Wed, 09 Aug 2017 16:08:08 GMT

ok thx , what about the second part - curl -H "X-Requested-By: ambari" --data @ -X POST -u admin:admin http://130.14.6.28:8080/api/v1/blueprints/HDP01 -d @$path/blueprint.json

Re: ambari cluster + what is the right syntax in order to upload json file

mike_bronson7 — Wed, 09 Aug 2017 16:09:38 GMT

the json data is ok , the problem is about my syntax ( with curl .... )

Re: ambari cluster + what is the right syntax in order to upload json file

jsensharma — Wed, 09 Aug 2017 16:18:17 GMT

@uri ben-ari

Yes, in the POST you have twice "--data" and "-d" both are not needed together. So please try:

# curl -u admin:admin -H "X-Requested-By: ambari" -d @$path/blueprint.json -X POST  http://130.14.6.28:8080/api/v1/blueprints/HDP01

# curl -u admin:admin -H "X-Requested-By: ambari" -X POST  http://130.14.6.28:8080/api/v1/blueprints/HDP01 -d @$path/blueprint.json

Here the "$path/blueprint.json" needs to be replaced with the actual path like -d@/tmp/blueprint.json

Re: ambari cluster + what is the right syntax in order to upload json file

mike_bronson7 — Wed, 09 Aug 2017 16:20:30 GMT

thx for your answer , now I get - { "status" : 409, "message" : "Attempted to create a Blueprint which already exists, blueprint_name=HDP01" }

Re: ambari cluster + what is the right syntax in order to upload json file

jsensharma — Wed, 09 Aug 2017 16:24:15 GMT

@uri ben-ari

Please change the blueprint name to something else inside your blueprint.json file.

If you want to see the rpeviously registered blueorint names then you can use the following kind of API:

curl  -u admin:admin -H "X-Requested-By: ambari" -X GET http://130.14.6.28:8080/api/v1/blueprints

Blueprint name should be unique.

Else you can delete the Old blueprints from your ambari server using the name>

curl  -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://130.14.6.28:8080/api/v1/blueprints/HDP01

Re: ambari cluster + what is the right syntax in order to upload json file

mike_bronson7 — Wed, 09 Aug 2017 16:34:09 GMT

ok I removed the old json file and after I create the new one I get this - { "status" : 400, "message" : "Cluster Topology validation failed. Invalid service component count: [Schema_Registry(actual=3, required=5), MassFlowManager(actual=1, required=5), MassRepo(actual=1, required=5), Airflow(actual=1, required=5)]. To disable topology validation and create the blueprint, add the following to the end of the url: '?validate_topology=false'"

Re: ambari cluster + what is the right syntax in order to upload json file

jsensharma — Wed, 09 Aug 2017 16:38:56 GMT

@uri ben-ari

It means either you are using some services like Nifi/Oozie and few configurations are missing like "Schema_Registry", "MassFlowManager" ... etc. So the blueprint registration is failing.

The other option will be to add the "?validate_topology=false" parametere in the URL to tell ambari to not validate the blueprint so that later you can update it.

# curl -u admin:admin -H "X-Requested-By: ambari" -X POST  http://130.14.6.28:8080/api/v1/blueprints/HDP01?validate_topology=false -d @$path/blueprint.json

Re: ambari cluster + what is the right syntax in order to upload json file

mike_bronson7 — Wed, 09 Aug 2017 16:56:06 GMT

ok now its work but little problem , before I upload the blueprint .json file I change the value - yarn.scheduler.minimum-allocation-mb" , and after I upload the json file and I access to ambari GUI I see the previos value - why ? , second I also restart the ambari-server but still have the old value

Re: ambari cluster + what is the right syntax in order to upload json file

mike_bronson7 — Wed, 09 Aug 2017 17:08:16 GMT

how it can be if we delete the blueprint.json and upload the new one but still ambari GUI show the old values ?

Re: ambari cluster + what is the right syntax in order to upload json file

jsensharma — Thu, 10 Aug 2017 12:08:32 GMT

@uri ben-ari

As your original issue mentioned in this thread is resolved, Then we can mark this thread as "Accepted" (Answered) and continue on the other thread that you opened for the new issue.

Warning: Couldn't read data from file "", this makes an empty POST. { "status" : 400, "message" : "Invalid Request: Malformed Request Body. An exception occurred parsing the request body: Unexpected character ('&' (code 38)): expected a valid value (number, String, array, object, 'true', 'false' or 'null')\n at [Source: java.io.StringReader@4a3484a6; line: 1, column: 3]"

Re: ambari cluster + what is the right syntax in order to upload json file

Shelton — Thu, 10 Aug 2017 16:27:10 GMT

@uri ben-ari @Jay SenSharma

This thread have been going on endlessly, and with duplicates.. I provided you the curl step mentioned above. If an answer provided solved the initial issue please do raise another thread. As jay stated you should mark the appropriate answer as "ACCEPTED" otherwise members will not attend to your questions in the future ,personally I have posted about 4 answers to your same thread .....

Re: ambari cluster + what is the right syntax in order to upload json file

mike_bronson7 — Thu, 10 Aug 2017 18:47:05 GMT

dear Geoffrey Shelton Okot you right , but during all my process I noticed about little issues that need to resolved , I am new in hadoop world , but any way I choose to work with other approach in order to configure the ambari cluster - see this https://cwiki.apache.org/confluence/display/AMBARI/Modify+configurations