01-08-2018 06:38 AM - last edited on 01-08-2018 08:25 AM by cjervis
I want to make my own script to define the rack topology. With CM I have changed the hdfs configuration for
01-08-2018 11:01 AM
01-17-2018 03:58 AM
many thanks for a reply!
If the custom script is used but not shown in cloudera manager, is there any other place where I could see that indeed my script is used rather than the default? I have tried looking in the logs but I do not know exactly where to look at. Do you have any idea what is the best method to verify the script did its job?
Thanks for all your input.
01-18-2018 04:30 PM
02-06-2018 08:00 AM
I notice now my script indeed did run, in the cloudera manager I see the names that I gave using CM (hosts -> assign rack) and in the YARN UI (http://<resourcemanager-IP>:8088/cluster/nodes ) I see the 'default-rack' names.
To make sure my script has run, I have included in my script touch statments that create files with the same name that is printed to the output and I notice my file did run and has created the desired output (I have 4 nodes and the output was rack1, rack2, rack3, rack4). If you have an idea why I can not see the rack names, please let me know.
Thanks for any further feedback!