I try to create a cluster via cloudera manager api in the following way:
1. create a cluster
2. add hosts to the cluster
3. create HDFS / YARN / ZOOKEEPER services using rolegroups
4. create HostTemplates for master and slave nodes.
My problem is that when I create the master HostTemplate there is no JobHistory role listed among YARN roles. Because of it after I assign the templates to the hosts, jobhistory server will be missing.
Can somebody tell me what's the reason of it, please? I use CDH 5.1.2 with cloudera manager.
My other problem is that if I add the JobHistory server manually via the admin console ui and start the cluster, the example mapreduce jobs cannot be executed. I think the reason is that the value of the yarn.nodemanager.aux-services is empty in yarn-site.xml but the appropriate cloudera manager property set to true (mapreduce_aux_service).
Can somebody explain me the reason of it?
Thanks and regards,
Any progress on that matter? In CM version 5.5.1 it is still not possible to add the JobHistory Server to a Host template.
I'm currently using templates to preserve the role assignment of the current cluster before removing all the nodes. Afterwards I'm rebuilding the cluster on a set of new nodes using those templates. Thus, adding the JHS role to a template would be helpful.
btw: Do you have any knowledge ressources regarding cluster migration to new nodes? The documentation only provides sparse information on that matter (relevant paths of HDFS to migrate are missing for instance).