Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Apache metron quick-dev-platform can't complete install with error

Apache metron quick-dev-platform can't complete install with error

New Contributor

*Sorry for my English.

i am really begginer of metron.

i have to create metron evironment on my Mac.(macOS Sierra 10.12.5(16F73))

First, My info

Metron 0.4.1

fatal: Not a git repository (or any of the parent directories): .git

--

ansible 2.2.2.0

config file =

configured module search path = Default w/o overrides

--

Vagrant 1.8.1

--

Python 2.7.11

--

Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-04T04:39:06+09:00)

Maven home: /usr/local/Cellar/maven/3.5.0/libexec

Java version: 1.8.0_144, vendor: Oracle Corporation

Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_144.jdk/Contents/Home/jre

Default locale: ko_KR, platform encoding: UTF-8

OS name: "mac os x", version: "10.12.5", arch: "x86_64", family: "mac"

--

Docker version 17.06.1-ce, build 874a737

--

node

v6.11.2

--

npm

3.10.10

--

Darwin choebongjaeui-Mac-mini.local 16.6.0 Darwin Kernel Version 16.6.0: Fri Apr 14 16:21:16 PDT 2017; root:xnu-3789.60.24~6/RELEASE_X86_64 x86_64

--

Total System Memory = 16384 MB

Processor Model: Intel(R) Core(TM) i5-4308U CPU

Processor Speed: 2.80GHz

Total Physical Processors: 2

Total cores: 2

Disk information:

/dev/disk2 1.9Ti176Gi1.8Ti 9% 2796818 42921704610% /

============

i tried this guide(https://github.com/apache/metron/tree/master/metron-deployment/vagrant/quick-dev-platform)

but i face error same link(https://issues.apache.org/jira/browse/METRON-872)

1. when i ran the first time

Problem

The "Quick Dev" deployment fails to complete deployment successfully for me. Ambari fails to launch the Enrichment topology with this error.

resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/metron/0.3.1/bin/zk_load_configs.sh --mode PUSH -i /usr/metron/0.3.1/config/zookeeper -z node1:2181' returned 127. /bin/bash: /usr/metron/0.3.1/bin/zk_load_configs.sh: No such file or directory

2.when i the second time (Ambari restart)

stderr: 
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_master.py", line 84, in <module>
    Enrichment().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_master.py", line 80, in restart
    commands.restart_enrichment_topology(env)
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_commands.py", line 179, in restart_enrichment_topology
    self.stop_enrichment_topology()
  File "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_commands.py", line 174, in stop_enrichment_topology
    Execute(stop_cmd)
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 273, in action_run
    tries=self.resource.tries, try_sleep=self.resource.try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
    tries=tries, try_sleep=try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 293, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'storm kill enrichment' returned 1. Running: /usr/jdk64/jdk1.8.0_77/bin/java -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=/usr/hdp/2.5.3.0-37/storm -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/hdp/current/storm-client/lib -Dstorm.conf.file= -cp /usr/hdp/2.5.3.0-37/storm/lib/ring-cors-0.1.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/storm/lib/storm-core-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/minlog-1.3.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/2.5.3.0-37/storm/lib/storm-rename-hack-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/kryo-3.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/asm-5.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/objenesis-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/disruptor-3.3.2.jar:/usr/hdp/2.5.3.0-37/storm/lib/clojure-1.7.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/zookeeper.jar:/usr/hdp/2.5.3.0-37/storm/lib/reflectasm-1.10.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-core-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-api-2.1.jar:/usr/hdp/2.5.3.0-37/storm/extlib-daemon/ranger-plugin-classloader-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/extlib-daemon/ranger-storm-plugin-shim-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/extlib-daemon/ojdbc6.jar:/usr/hdp/current/storm-supervisor/conf:/usr/hdp/2.5.3.0-37/storm/bin org.apache.storm.command.kill_topology enrichment
Exception in thread "main" NotAliveException(msg:enrichment is not alive)
	at org.apache.storm.generated.Nimbus$killTopologyWithOpts_result$killTopologyWithOpts_resultStandardScheme.read(Nimbus.java:10748)
	at org.apache.storm.generated.Nimbus$killTopologyWithOpts_result$killTopologyWithOpts_resultStandardScheme.read(Nimbus.java:10734)
	at org.apache.storm.generated.Nimbus$killTopologyWithOpts_result.read(Nimbus.java:10676)
	at org.apache.storm.thrift.TServiceClient.receiveBase(TServiceClient.java:86)
	at org.apache.storm.generated.Nimbus$Client.recv_killTopologyWithOpts(Nimbus.java:383)
	at org.apache.storm.generated.Nimbus$Client.killTopologyWithOpts(Nimbus.java:369)
	at org.apache.storm.command.kill_topology$_main.doInvoke(kill_topology.clj:27)
	at clojure.lang.RestFn.applyTo(RestFn.java:137)
	at org.apache.storm.command.kill_topology.main(Unknown Source)


3.when i the xth time (Ambari all stop & all starrt)

resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/hdp/current/kafka-broker/bin/kafka-topics.sh                                 --zookeeper node1:2181                                 --create                                 --topic enrichments                                 --partitions 1                                 --replication-factor 1                                 --config retention.bytes=10737418240' returned 1. Error while executing topic command : Topic "enrichments" already exists.
[2017-08-31 13:19:52,449] ERROR kafka.common.TopicExistsException: Topic "enrichments" already exists.
	at kafka.admin.AdminUtils$.createOrUpdateTopicPartitionAssignmentPathInZK(AdminUtils.scala:420)
	at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:404)
	at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:110)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:61)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)
 (kafka.admin.TopicCommand$)

========================================

Ambari on Chrome(node1:8080) Image

========================================

What should i do??

Please help me.

Thank you So much.

4 REPLIES 4

Re: Apache metron quick-dev-platform can't complete install with error

Expert Contributor

hi @choi Bongjae,

I don't know the guide that you gollow but if you follow this guide (pretty simple)

https://docs.hortonworks.com/HDPDocuments/HCP1/HCP-1.2.2/bk_installation/content/install_using_ambar...

Normally you should not have any issue to install hdp + metron install (only few command and click :) )

Re: Apache metron quick-dev-platform can't complete install with error

New Contributor

i can't see for mac install. Can i follow ububtu guide?

Re: Apache metron quick-dev-platform can't complete install with error

Rising Star

"Quick Dev" is not actively maintained currently. Please use the "Full Dev" environment in metron-deployment/vagrant/full-dev-environment.

Re: Apache metron quick-dev-platform can't complete install with error

New Contributor

Thank you for reply.

I am trying full dev install my mac.

Terminal stopped loading

"TASK [ambari_config : Deploy cluster with Ambari; http://node1:8080]**********"

It takes too long to load, and I do not know if it is normal. An hour and a half from the start of the installation

Please advice