09-24-2014 05:24 PM
I try to create a cluster via cloudera manager api in the following way:
1. create a cluster
2. add hosts to the cluster
3. create HDFS / YARN / ZOOKEEPER services using rolegroups
4. create HostTemplates for master and slave nodes.
My problem is that when I create the master HostTemplate there is no JobHistory role listed among YARN roles. Because of it after I assign the templates to the hosts, jobhistory server will be missing.
Can somebody tell me what's the reason of it, please? I use CDH 5.1.2 with cloudera manager.
My other problem is that if I add the JobHistory server manually via the admin console ui and start the cluster, the example mapreduce jobs cannot be executed. I think the reason is that the value of the yarn.nodemanager.aux-services is empty in yarn-site.xml but the appropriate cloudera manager property set to true (mapreduce_aux_service).
Can somebody explain me the reason of it?
Thanks and regards,
12-16-2015 02:45 AM - edited 12-16-2015 02:46 AM
Any progress on that matter? In CM version 5.5.1 it is still not possible to add the JobHistory Server to a Host template.
12-16-2015 11:38 AM
12-16-2015 02:57 PM
I'm currently using templates to preserve the role assignment of the current cluster before removing all the nodes. Afterwards I'm rebuilding the cluster on a set of new nodes using those templates. Thus, adding the JHS role to a template would be helpful.
btw: Do you have any knowledge ressources regarding cluster migration to new nodes? The documentation only provides sparse information on that matter (relevant paths of HDFS to migrate are missing for instance).