Apache Metron UI installation Steps in Ubuntu

[#1]

We have followed the below link step to install Metron 0.3.x and 0.4.1 in Ubuntu 14, we have tried the couple of samples and it is working.

https://community.hortonworks.com/articles/88843/manually-installing-apache-metron-on-ubuntu-1404.ht...

But there is no clear instruction to start Metron mangement, alerts and REST api for ubuntu.

When we start metron alert UI,

./start_alerts_ui

We have converted the RPM to DEB using alien command but it is not installing.

Like steps provided for CentOS to access Metron UI, if there is direction for Ubuntu then will be helpful.

./metron-rest start is asking for password but don't know about it.

Please help me on this.

Thanks,

Uvaraj

[#2]

I can start Metron REST, Management and Alerts UI in Ubuntu 14.

Now the problem is Metron Management UI start parser topology not working, it trigger rest API call to start the topology

I have updated all the required properties in rest_application.yml except PARSER_TOPOLOGY_OPTIONS

Example: -k $METRON_KAFKA -z $METRON_ZK -s dummy

In that -k and -z I can mention it but parser dummy should be dynamic and I dont know how to specify that.

Please help me on this

Error:

Nov 25, 2017 12:23:49 PM org.apache.catalina.core.StandardWrapperValve invoke SEVERE: Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception [Request processing failed; nested exception is java.lang.IllegalArgumentException: Could not resolve placeholder 'PARSER_TOPOLOGY_OPTIONS' in string value "${PARSER_TOPOLOGY_OPTIONS}"] with root cause java.lang.IllegalArgumentException: Could not resolve placeholder 'PARSER_TOPOLOGY_OPTIONS' in string value "${PARSER_TOPOLOGY_OPTIONS}" at org.springframework.util.PropertyPlaceholderHelper.parseStringValue(PropertyPlaceholderHelper.java:174) at org.springframework.util.PropertyPlaceholderHelper.replacePlaceholders(PropertyPlaceholderHelper.java:126) at org.springframework.core.env.AbstractPropertyResolver.doResolvePlaceholders(AbstractPropertyResolver.java:219) at org.springframework.core.env.AbstractPropertyResolver.resolveRequiredPlaceholders(AbstractPropertyResolver.java:193) at org.springframework.core.env.AbstractPropertyResolver.resolveNestedPlaceholders(AbstractPropertyResolver.java:210) at org.springframework.core.env.PropertySourcesPropertyResolver.getProperty(PropertySourcesPropertyResolver.java:83) at org.springframework.core.env.PropertySourcesPropertyResolver.getProperty(PropertySourcesPropertyResolver.java:61) at org.springframework.core.env.AbstractEnvironment.getProperty(AbstractEnvironment.java:530) at org.apache.metron.rest.service.impl.StormCLIWrapper.getParserStartCommand(StormCLIWrapper.java:124) at org.apache.metron.rest.service.impl.StormCLIWrapper.startParserTopology(StormCLIWrapper.java:54)

Thanks,

Uvaraj.S

[#3]

The following settings in rest-application.yaml fixed the issue,

parser:

script.path: /usr/metron/0.4.1/bin/start_parser_topology.sh

topology.options:

enrichment:

script.path: /usr/metron/0.4.1/bin/start_enrichment_topology.sh

indexing:

script.path: /usr/metron/0.4.1/bin/start_elasticsearch_topology.sh

[#4]

Any reason you're not using Ambari to install and manage Metron? I think you could avoid these issues if you did. I believe Ubuntu is supported.

[#5]

@rmerriman

Couple of Reasons,

1. Installing manually helps us to understand Metron internals better and uses of different configurations and scripts involved in it.

2. We have tried using Ambari mpack but in Ubuntu it is not working due to python scripts are using rpm and yum packages to execute commands and few commands are not supported in Ubuntu.

All the installation documents are provided for CentOS except the below one,

https://community.hortonworks.com/articles/88843/manually-installing-apache-metron-on-ubuntu-1404.ht...

FYI attached screenshots shows one more issue while installing Elasticsearch which is available in the mpack,

mpack-issue.png

[#6]

I would pursue installation through Ambari, you will have a much easier time. Try the suggestion from @asubramanian and if you still run into issues, let us know and we'll help you through it and/or fix bugs if necessary.

[#7]

@Uvaraj Seerangan, can you try with Ambari 2.6 on your Ubuntu? There was a fix that went into Ambari 2.6 which should resolve the install issue with Elasticsearch.

[#8]

Here are the Ambari 2.6.0.0 repositories:

https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.0.0/bk_ambari-installation/content/ambari_repos...