Support Questions
Find answers, ask questions, and share your expertise

after upgrade to ambari 2.5.0.3 service cannot start

after upgrade to ambari 2.5.0.3 service cannot start

New Contributor

Hi all,

After I upgrade ambari from 2.2.0.0 to 2.5.0.3

the scdf service cannot start/stop from ambari ui

Dose anyone meet it before?

Traceback (most recent call last):

  File "/var/lib/ambari-agent/cache/stacks/HDP/2.2/services/SCDF/package/scripts/scdf_h2.py", line 55, in <module>
    ScdfH2().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 314, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.2/services/SCDF/package/scripts/scdf_h2.py", line 41, in start
    self.configure(env)
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 117, in locking_configure
    original_configure(obj, *args, **kw)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.2/services/SCDF/package/scripts/scdf_h2.py", line 36, in configure
    scdf(name='h2')
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.2/services/SCDF/package/scripts/scdf.py", line 100, in scdf
    group=params.user_group
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 123, in action_create
    content = self._get_content()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 160, in _get_content
    return content()
  File "/usr/lib/python2.6/site-packages/resource_management/core/source.py", line 52, in __call__
    return self.get_content()
  File "/usr/lib/python2.6/site-packages/resource_management/core/source.py", line 144, in get_content
    rendered = self.template.render(self.context)
  File "/usr/lib/python2.6/site-packages/ambari_jinja2/environment.py", line 891, in render
    return self.environment.handle_exception(exc_info, True)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.2/services/SCDF/package/templates/collectors.yml.j2", line 73, in top-level template code
    destination: {{collector_channel}}
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/config_dictionary.py", line 73, in __getattr__
    raise Fail("Configuration parameter '" + self.name + "' was not found in configurations dictionary!")
resource_management.core.exceptions.Fail: Configuration parameter 'metrics.collector.server.port' was not found in configurations dictionary!
2 REPLIES 2

Re: after upgrade to ambari 2.5.0.3 service cannot start

Super Mentor

@Jerry Huang

Looks like your custom service SCDF is dependent on the property "metrics.collector.server.port" which it is expecting to see inside the "scdf-site.xml" so please check if your this file contains any property with name "metrics.collector.server.port"

Reference:

https://github.com/spring-cloud/spring-cloud-dataflow-ambari-rpm/blob/875f4280b3734d8aaa2e043e14c34a...

collector_port = config['configurations']['scdf-site']['metrics.collector.server.port']
https://github.com/spring-cloud/spring-cloud-dataflow-ambari-rpm/blob/master/src/main/resources/serv...
  <property>
    <name>metrics.collector.server.port</name>
    <value>18080</value>
    <display-name>Metrics collector server port</display-name>
    <description>Metrics collector server port</description>
  </property>

.

Re: after upgrade to ambari 2.5.0.3 service cannot start

Super Mentor

@Jerry Huang

Can you please check your "scdf-site" using the following utility to see if it contains the "metrics.collector.server.port" ?

# /var/lib/ambari-server/resources/scripts/configs.sh -u admin -p admin  -port 8080 get ambari1.example.com Sandbox scdf-site > /tmp/scdf-site.json


Syntax: (get Config)

# /var/lib/ambari-server/resources/scripts/configs.sh -u admin -p admin  -port 8080 get $AMBARI_HOST  $CLUSTER_NAME scdf-site > /tmp/scdf-site.json

.


If the "/tmp/scdf-site.json" file has somehow missing property "metrics.collector.server.port" then please try to add it.

# cat /tmp/scdf-site.json

Using config.sh script as well you can push new properties Like following to point to yoru AMS collector PORT.

# /var/lib/ambari-server/resources/scripts/configs.sh -u admin -p admin  -port 8080  set ambari1.example.com  Sandbox scdf-site "metrics.collector.server.port" "6188" 


Syntax: (Set property)

# /var/lib/ambari-server/resources/scripts/configs.sh -u admin -p admin  -port 8080 set $AMBARI_HOST  $CLUSTER_NAME scdf-site "metrics.collector.server.port" "6188"  

.