Stack Advisor - how to use it?

[#1]

Hi. I have a question regarding Stack Advisor script. I want to tune my cluster - change YARN, Tez and Hive configuration files. I can use hdp-configuration-utils.py script, but it is too simple. I read that there is stack and service advisors which can give me recommendations. My question is - can I use stack advisor script after HDP installation or I should not use it, cause Ambari uses it during HDP installation only? And if I can use it - how can I do this?

[#2]

@Mateusz Grabowski

Below threads might help you

https://cwiki.apache.org/confluence/display/AMBARI/How-To+Define+Stacks+and+Services#How-ToDefineSta...

https://community.hortonworks.com/questions/5836/yarnmr-configuration-hdp-configuration-utils-or-am....

[#3]

I saw both of this sites. But my question is - how I can run stack-advisor.py script? Can I just run simple:

python stack-advisor.py

or I should configure something before? Where I can find a file with recommendations?

[#4 · Accepted solution]

@Mateusz Grabowski,

You can make the required changes in stack_advisor.py under (/var/lib/ambari-server/resources/stacks/HDP/{HDP version}/services/stack_advisor.py

For testing, I have changed a line in ( /var/lib/ambari-server/resources/stacks/HDP/2.5/services/stack_advisor.py.

I have hardcoded the port no in atlas.rest.address to 12233 and restarted the ambari server.

As you can see in the below screenshot, it got reflected in the UI.

All you have to do is make the changes you want in stack_advisor.py , restart ambari-server. We need not run the file manually.

Note : Ambari agents will cache these files. So you should make the same change in (/var/lib/ambari-agent/cache/stacks/HDP/{HDP version}/services/stack_advisor.py) as well.

You can check this link for some more info

Hope this helps 🙂

Thanks,

Aditya

[#5]

You can use the below snippet. But you need to run stack_advisor once using normal flow under ambari server

/var/lib/ambari-server/resources/scripts/stack_advisor.py recommend-configurations /var/run/ambari-server/stack-recommendations/1/hosts.json /var/run/ambari-server/stack-recommendations/1/services.json