unable to start the history and app time line server after enable the NN high availability

[#1]

Hi Team,

Good Morning,

After enable the NN ha history and app time line services are stopped running and tried to start but no luck.

Below the err i am getting when i try to start history server: I need your help on this please.

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py", line 182, in <module>
    HistoryServer().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py", line 92, in start
    self.configure(env) # FOR SECURITY
  File "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py", line 55, in configure
    yarn(name="historyserver")
  File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk
    return fn(*args, **kwargs)
  File "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/yarn.py", line 72, in yarn
    recursive_chmod=True
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 158, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 121, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 427, in action_create_on_execute
    self.action_delayed("create")
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 424, in action_delayed
    self.get_hdfs_resource_executor().action_delayed(action_name, self)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 261, in action_delayed
    main_resource.resource.security_enabled, main_resource.resource.logoutput)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 129, in __init__
    security_enabled, run_user)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/namenode_ha_utils.py", line 144, in get_property_for_active_namenode
    active_namenodes = get_namenode_states(hdfs_site, security_enabled, run_user)[0]
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/namenode_ha_utils.py", line 57, in get_namenode_states
    return doRetries(hdfs_site, security_enabled, run_user)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/decorator.py", line 48, in wrapper
    return function(*args, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/namenode_ha_utils.py", line 45, in doRetries
    active_namenodes, standby_namenodes, unknown_namenodes = get_namenode_states_noretries(hdfs_site, security_enabled, run_user)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/namenode_ha_utils.py", line 68, in get_namenode_states_noretries
    nn_unique_ids_key = 'dfs.ha.namenodes.' + name_service
TypeError: cannot concatenate 'str' and 'int' objects

[#2]

@Balaji Vemula

From the code: https://github.com/apache/ambari/blob/release-2.2.1/ambari-common/src/main/python/resource_managemen... it looks like you have defined a numeric value for the hdfs properties.

By any chance have you defined a numeric value for "dfs.nameservices" or "dfs.internal.nameservices" in your hdfs-site.xml ?

If yes then please change it to some non numeric value. (Like dfs.nameservices=TestHA or dfs.internal.nameservices

=TestHA)

.