Apache metron rest service are failed after start

nahidupa — Sat, 04 Nov 2017 22:05:26 GMT

I'm trying to install Metron 0.4.1 with HDP 2.5 bare-metal install on Centos 7 with MariaDB for Metron REST following this document here

All services are up and running except apache metron rest are failed after start with following log. I google with log cannot fine any help yet. here is the log. Any clue help is appreciated.

Error starting ApplicationContext. To display the auto-configuration report re-run your application with 'debug' enabled. 17/11/04 14:22:39 ERROR boot.SpringApplication: Application startup failed org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'updateServiceImpl' defined in URL [jar:file:/usr/metron/0.4.1/lib/metron-rest-0.4.1.jar!/org/apache/metron/rest/service/impl/UpdateServiceImpl.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'indexDao' defined in class path resource [org/apache/metron/rest/config/IndexConfig.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.metron.indexing.dao.IndexDao]: Factory method 'indexDao' threw exception; nested exception is java.lang.RuntimeException: java.net.UnknownHostException: http: unknown error at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:189) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1148) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1051) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:751) at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:861) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:541) at org.springframework.boot.context.embedded.EmbeddedWebApplicationContext.refresh(EmbeddedWebApplicationContext.java:122) at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:761) at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:371) at org.springframework.boot.SpringApplication.run(SpringApplication.java:315) at org.springframework.boot.SpringApplication.run(SpringApplication.java:1186) at org.springframework.boot.SpringApplication.run(SpringApplication.java:1175) at org.apache.metron.rest.MetronRestApplication.main(MetronRestApplication.java:27) Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'indexDao' defined in class path resource [org/apache/metron/rest/config/IndexConfig.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.metron.indexing.dao.IndexDao]: Factory method 'indexDao' threw exception; nested exception is java.lang.RuntimeException: java.net.UnknownHostException: http: unknown error at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:599) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1128) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1023) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:207) at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1128) at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1056) at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:835) at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741) ... 19 more Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.metron.indexing.dao.IndexDao]: Factory method 'indexDao' threw exception; nested exception is java.lang.RuntimeException: java.net.UnknownHostException: http: unknown error at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:189) at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:588) ... 32 more Caused by: java.lang.RuntimeException: java.net.UnknownHostException: http: unknown error at org.apache.metron.elasticsearch.utils.ElasticsearchUtils.getClient(ElasticsearchUtils.java:74) at org.apache.metron.elasticsearch.dao.ElasticsearchDao.init(ElasticsearchDao.java:181) at org.apache.metron.indexing.dao.IndexDaoFactory.create(IndexDaoFactory.java:38) at org.apache.metron.rest.config.IndexConfig.indexDao(IndexConfig.java:72) at org.apache.metron.rest.config.IndexConfig$EnhancerBySpringCGLIB$bbe5d891.CGLIB$indexDao$0(<generated>) at org.apache.metron.rest.config.IndexConfig$EnhancerBySpringCGLIB$bbe5d891$FastClassBySpringCGLIB$aa005056.invoke(<generated>) at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228) at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:356) at org.apache.metron.rest.config.IndexConfig$EnhancerBySpringCGLIB$bbe5d891.indexDao(<generated>) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:162) ... 33 more Caused by: java.net.UnknownHostException: http: unknown error at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method) at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928) at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323) at java.net.InetAddress.getAllByName0(InetAddress.java:1276) at java.net.InetAddress.getAllByName(InetAddress.java:1192) at java.net.InetAddress.getAllByName(InetAddress.java:1126) at java.net.InetAddress.getByName(InetAddress.java:1076) at org.apache.metron.elasticsearch.utils.ElasticsearchUtils.getClient(ElasticsearchUtils.java:70)

Re: Apache metron rest service are failed after start

jsensharma — Sat, 04 Nov 2017 22:10:11 GMT

@nahidul kibria

As you are getting the following error on Metron 0.4.1 hence based on the error stack trace i am suspecting that you mighe not have set the the "es.ip" and "es.port" properties properly inside your "global configurations"

33 more Caused by: java.net.UnknownHostException: http: unknown error 
    at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method) 
    at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928) 
    at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323) 
    at java.net.InetAddress.getAllByName0(InetAddress.java:1276) 
    at java.net.InetAddress.getAllByName(InetAddress.java:1192) 
    at java.net.InetAddress.getAllByName(InetAddress.java:1126) 
    at java.net.InetAddress.getByName(InetAddress.java:1076) 
    at org.apache.metron.elasticsearch.utils.ElasticsearchUtils.getClient(ElasticsearchUtils.java:70) <br>

Please see the code where it is failing to understand the issue.

https://github.com/apache/metron/blob/apache-metron-0.4.1-release/metron-platform/metron-elasticsearch/src/main/java/org/apache/metron/elasticsearch/utils/ElasticsearchUtils.java#L70

https://metron.apache.org/current-book/metron-platform/metron-common/index.html#Global_Configuration

Re: Apache metron rest service are failed after start

nahidupa — Sat, 04 Nov 2017 23:38:03 GMT

Global config now set

{ "es.clustername": "metron", "es.ip": "localhost", "ex.port":"9300", "es.date.format": "yyyy.MM.dd.HH", "parser.error.topic": "indexing", "update.hbase.table": "metron_update", "update.hbase.cf": "t" }

However same error log. @Jay Kumar SenSharma . Thanks for quick response.

Re: Apache metron rest service are failed after start

jsensharma — Sat, 04 Nov 2017 23:43:57 GMT

@nahidul kibria

Just wondering if there is a typo in "ex.port" (should it be "es.port")

{ "es.clustername": "metron", "es.ip": "localhost", "ex.port":"9300",

Re: Apache metron rest service are failed after start

nahidupa — Sat, 04 Nov 2017 23:52:34 GMT

My bad make that correct.

./zk_load_configs.sh -z node1:2181 -m DUMP |grep es.port "es.port":"9300",

"es.port":"9300",

How can i flash log quickly to see cat /var/log/metron/metron-rest.log. It's failing but not log coming yet. I'm using ambari-server.

@Jay Kumar SenSharma

Re: Apache metron rest service are failed after start

nahidupa — Sun, 05 Nov 2017 00:07:58 GMT

Thanks @Jay Kumar SenSharma it is working now. Restarted all metron services. Many thanks.

question Re: Apache metron rest service are failed after start in Support Questions

Apache metron rest service are failed after start

Re: Apache metron rest service are failed after start

Re: Apache metron rest service are failed after start

Re: Apache metron rest service are failed after start

Re: Apache metron rest service are failed after start

Re: Apache metron rest service are failed after start