Created 08-31-2017 01:37 PM
*Sorry for my English.
i am really begginer of metron.
i have to create metron evironment on my Mac.(macOS Sierra 10.12.5(16F73))
First, My info
Metron 0.4.1
fatal: Not a git repository (or any of the parent directories): .git
--
ansible 2.2.2.0
config file =
configured module search path = Default w/o overrides
--
Vagrant 1.8.1
--
Python 2.7.11
--
Apache Maven 3.5.0 (ff8f5e7444045639af65f6095c62210b5713f426; 2017-04-04T04:39:06+09:00)
Maven home: /usr/local/Cellar/maven/3.5.0/libexec
Java version: 1.8.0_144, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_144.jdk/Contents/Home/jre
Default locale: ko_KR, platform encoding: UTF-8
OS name: "mac os x", version: "10.12.5", arch: "x86_64", family: "mac"
--
Docker version 17.06.1-ce, build 874a737
--
node
v6.11.2
--
npm
3.10.10
--
Darwin choebongjaeui-Mac-mini.local 16.6.0 Darwin Kernel Version 16.6.0: Fri Apr 14 16:21:16 PDT 2017; root:xnu-3789.60.24~6/RELEASE_X86_64 x86_64
--
Total System Memory = 16384 MB
Processor Model: Intel(R) Core(TM) i5-4308U CPU
Processor Speed: 2.80GHz
Total Physical Processors: 2
Total cores: 2
Disk information:
/dev/disk2 1.9Ti176Gi1.8Ti 9% 2796818 42921704610% /
============
i tried this guide(https://github.com/apache/metron/tree/master/metron-deployment/vagrant/quick-dev-platform)
but i face error same link(https://issues.apache.org/jira/browse/METRON-872)
1. when i ran the first time
The "Quick Dev" deployment fails to complete deployment successfully for me. Ambari fails to launch the Enrichment topology with this error.
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/metron/0.3.1/bin/zk_load_configs.sh --mode PUSH -i /usr/metron/0.3.1/config/zookeeper -z node1:2181' returned 127. /bin/bash: /usr/metron/0.3.1/bin/zk_load_configs.sh: No such file or directory
2.when i the second time (Ambari restart)
stderr: Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_master.py", line 84, in <module> Enrichment().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute method(env) File "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_master.py", line 80, in restart commands.restart_enrichment_topology(env) File "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_commands.py", line 179, in restart_enrichment_topology self.stop_enrichment_topology() File "/var/lib/ambari-agent/cache/common-services/METRON/0.3.1/package/scripts/enrichment_commands.py", line 174, in stop_enrichment_topology Execute(stop_cmd) File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 273, in action_run tries=self.resource.tries, try_sleep=self.resource.try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner result = function(command, **kwargs) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call tries=tries, try_sleep=try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 293, in _call raise ExecutionFailed(err_msg, code, out, err) resource_management.core.exceptions.ExecutionFailed: Execution of 'storm kill enrichment' returned 1. Running: /usr/jdk64/jdk1.8.0_77/bin/java -client -Ddaemon.name= -Dstorm.options= -Dstorm.home=/usr/hdp/2.5.3.0-37/storm -Dstorm.log.dir=/var/log/storm -Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib:/usr/hdp/current/storm-client/lib -Dstorm.conf.file= -cp /usr/hdp/2.5.3.0-37/storm/lib/ring-cors-0.1.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/slf4j-api-1.7.7.jar:/usr/hdp/2.5.3.0-37/storm/lib/storm-core-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/minlog-1.3.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-over-slf4j-1.6.6.jar:/usr/hdp/2.5.3.0-37/storm/lib/storm-rename-hack-1.0.1.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/lib/kryo-3.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/asm-5.0.3.jar:/usr/hdp/2.5.3.0-37/storm/lib/objenesis-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/disruptor-3.3.2.jar:/usr/hdp/2.5.3.0-37/storm/lib/clojure-1.7.0.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-slf4j-impl-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/zookeeper.jar:/usr/hdp/2.5.3.0-37/storm/lib/reflectasm-1.10.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-core-2.1.jar:/usr/hdp/2.5.3.0-37/storm/lib/servlet-api-2.5.jar:/usr/hdp/2.5.3.0-37/storm/lib/log4j-api-2.1.jar:/usr/hdp/2.5.3.0-37/storm/extlib-daemon/ranger-plugin-classloader-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/extlib-daemon/ranger-storm-plugin-shim-0.6.0.2.5.3.0-37.jar:/usr/hdp/2.5.3.0-37/storm/extlib-daemon/ojdbc6.jar:/usr/hdp/current/storm-supervisor/conf:/usr/hdp/2.5.3.0-37/storm/bin org.apache.storm.command.kill_topology enrichment Exception in thread "main" NotAliveException(msg:enrichment is not alive) at org.apache.storm.generated.Nimbus$killTopologyWithOpts_result$killTopologyWithOpts_resultStandardScheme.read(Nimbus.java:10748) at org.apache.storm.generated.Nimbus$killTopologyWithOpts_result$killTopologyWithOpts_resultStandardScheme.read(Nimbus.java:10734) at org.apache.storm.generated.Nimbus$killTopologyWithOpts_result.read(Nimbus.java:10676) at org.apache.storm.thrift.TServiceClient.receiveBase(TServiceClient.java:86) at org.apache.storm.generated.Nimbus$Client.recv_killTopologyWithOpts(Nimbus.java:383) at org.apache.storm.generated.Nimbus$Client.killTopologyWithOpts(Nimbus.java:369) at org.apache.storm.command.kill_topology$_main.doInvoke(kill_topology.clj:27) at clojure.lang.RestFn.applyTo(RestFn.java:137) at org.apache.storm.command.kill_topology.main(Unknown Source)
3.when i the xth time (Ambari all stop & all starrt)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/hdp/current/kafka-broker/bin/kafka-topics.sh --zookeeper node1:2181 --create --topic enrichments --partitions 1 --replication-factor 1 --config retention.bytes=10737418240' returned 1. Error while executing topic command : Topic "enrichments" already exists. [2017-08-31 13:19:52,449] ERROR kafka.common.TopicExistsException: Topic "enrichments" already exists. at kafka.admin.AdminUtils$.createOrUpdateTopicPartitionAssignmentPathInZK(AdminUtils.scala:420) at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:404) at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:110) at kafka.admin.TopicCommand$.main(TopicCommand.scala:61) at kafka.admin.TopicCommand.main(TopicCommand.scala) (kafka.admin.TopicCommand$)
========================================
Ambari on Chrome(node1:8080) Image
========================================
What should i do??
Please help me.
Thank you So much.
Created 08-31-2017 02:19 PM
hi @choi Bongjae,
I don't know the guide that you gollow but if you follow this guide (pretty simple)
Normally you should not have any issue to install hdp + metron install (only few command and click 🙂 )
Created 09-01-2017 04:52 AM
i can't see for mac install. Can i follow ububtu guide?
Created 08-31-2017 06:30 PM
"Quick Dev" is not actively maintained currently. Please use the "Full Dev" environment in metron-deployment/vagrant/full-dev-environment.
Created 09-01-2017 02:45 AM
Thank you for reply.
I am trying full dev install my mac.
Terminal stopped loading
"TASK [ambari_config : Deploy cluster with Ambari; http://node1:8080]**********"
It takes too long to load, and I do not know if it is normal. An hour and a half from the start of the installation
Please advice