Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

WebHCat server fails on path issue on intial cloudbreak provisioning

Highlighted

WebHCat server fails on path issue on intial cloudbreak provisioning

New Contributor

Exception below encountered at end of new cluster creation with Cloudbreak.

On first manual and subsequent starts of WebHCat server via ambari or command line the exception is not encountered anymore, correct path is being picked up and it works as expected. So I cannot actually reproduce it outside the initial cluster provisioning.

The path below /usr/hdp/2.6.3.0/hive/conf should be /usr/hdp/2.6.3.0-235/hive/conf

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_server.py", line 88, in <module>
    WebHCatServer().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 367, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_server.py", line 42, in start
    self.configure(env) # FOR SECURITY
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 120, in locking_configure
    original_configure(obj, *args, **kw)
  File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_server.py", line 53, in configure
    webhcat()
  File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", line 89, in thunk
    return fn(*args, **kwargs)
  File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat.py", line 92, in webhcat
    group = params.user_group,
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/xml_config.py", line 66, in action_create
    encoding = self.resource.encoding
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 120, in action_create
    raise Fail("Applying %s failed, parent directory %s doesn't exist" % (self.resource, dirname))
resource_management.core.exceptions.Fail: Applying File['/usr/hdp/2.6.3.0/hive/conf/hive-site.xml'] failed, parent directory /usr/hdp/2.6.3.0/hive/conf doesn't exist
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_server.py", line 88, in <module>
    WebHCatServer().execute()

Cloudbreak: 1.16.3

HDP: 2.6.3.0-235

Ambari: 2.6.0.0-267

Thanks for your help and regards

Dominik

1 REPLY 1

Re: WebHCat server fails on path issue on intial cloudbreak provisioning

Expert Contributor

Hi,

We were able to reproduce the issue. It seems that it is caused by a behavioural change in Ambari 2.6.0.0: https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.0.0/bk_ambari-release-notes/content/ambari_reln...

As we learned, instead of setting the repositories directly a VDF file needs to be configured, but VDF files are not handled by the latest Cloudbreak release (1.16.4). As we see Cloudbreak needs to be changed to support the new way of HDP version config. We are working on it.

Attila

Don't have an account?
Coming from Hortonworks? Activate your account here