Apache Atlas 503 Error

[#1]

Hi

I am not using HDP. I built and installed apache atlas using the following link Atlas Installation. When I start Atlas using the atlas_start.py script the web UI gives the 503 error. I have checked the logs which are as follows:

2017-07-18 21:03:27,477 WARN  - [main:] ~ Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.context.event.internalEventListenerProcessor': BeanPostProcessor before instantiation of bean failed; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'graphTransactionAdvisor' defined in URL [jar:file:/home/arsalan/atlas/distro/target/apache-atlas-0.9-incubating-SNAPSHOT-bin/apache-atlas-0.9-incubating-SNAPSHOT/server/webapp/atlas/WEB-INF/lib/atlas-repository-0.9-incubating-SNAPSHOT.jar!/org/apache/atlas/GraphTransactionAdvisor.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'graphTransactionInterceptor' defined in URL [jar:file:/home/arsalan/atlas/distro/target/apache-atlas-0.9-incubating-SNAPSHOT-bin/apache-atlas-0.9-incubating-SNAPSHOT/server/webapp/atlas/WEB-INF/lib/atlas-repository-0.9-incubating-SNAPSHOT.jar!/org/apache/atlas/GraphTransactionInterceptor.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'get' defined in org.apache.atlas.repository.graph.AtlasGraphProvider: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.atlas.repository.graphdb.AtlasGraph]: Factory method 'get' threw exception; nested exception is com.thinkaurelius.titan.core.TitanException: Could not open global configuration (AbstractApplicationContext:550)
2017-07-18 21:03:27,478 ERROR - [main:] ~ Context initialization failed (ContextLoader:350)
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.context.event.internalEventListenerProcessor': BeanPostProcessor before instantiation of bean failed; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'graphTransactionAdvisor' defined in URL [jar:file:/home/arsalan/atlas/distro/target/apache-atlas-0.9-incubating-SNAPSHOT-bin/apache-atlas-0.9-incubating-SNAPSHOT/server/webapp/atlas/WEB-INF/lib/atlas-repository-0.9-incubating-SNAPSHOT.jar!/org/apache/atlas/GraphTransactionAdvisor.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'graphTransactionInterceptor' defined in URL [jar:file:/home/arsalan/atlas/distro/target/apache-atlas-0.9-incubating-SNAPSHOT-bin/apache-atlas-0.9-incubating-SNAPSHOT/server/webapp/atlas/WEB-INF/lib/atlas-repository-0.9-incubating-SNAPSHOT.jar!/org/apache/atlas/GraphTransactionInterceptor.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'get' defined in org.apache.atlas.repository.graph.AtlasGraphProvider: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.atlas.repository.graphdb.AtlasGraph]: Factory method 'get' threw exception; nested exception is com.thinkaurelius.titan.core.TitanException: Could not open global configuration
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:479)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:761)
	at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:866)
	at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:542)
	at org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:443)
	at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:325)
	at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:107)
	at org.apache.atlas.web.setup.KerberosAwareListener.contextInitialized(KerberosAwareListener.java:31)
	at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800)
	at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444)
	at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)
	at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294)
	at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
	at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
	at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
	at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
	at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
	at org.eclipse.jetty.server.Server.start(Server.java:387)
	at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
	at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
	at org.eclipse.jetty.server.Server.doStart(Server.java:354)
	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
	at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:95)
	at org.apache.atlas.Atlas.main(Atlas.java:118)

Application logs:

########################################################################################
                               Atlas Server (STARTUP)


	project.name:	apache-atlas
	project.description:	Metadata Management and Data Governance Platform over Hadoop
	build.user:	arsalan
	build.epoch:	1500400082909
	project.version:	0.9-incubating-SNAPSHOT
	build.version:	0.9-incubating-SNAPSHOT-r377fe19f023a4036f9fa1503dec6ea698fdb214b
	vc.revision:	377fe19f023a4036f9fa1503dec6ea698fdb214b
	vc.source.url:	scm:git:git://git.apache.org/incubator-atlas.git/atlas-webapp
######################################################################################## (Atlas:185)
2017-07-18 21:31:08,525 INFO  - [main:] ~ >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> (Atlas:186)
2017-07-18 21:31:08,525 INFO  - [main:] ~ Server starting with TLS ? false on port 21000 (Atlas:187)
2017-07-18 21:31:08,525 INFO  - [main:] ~ <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< (Atlas:188)
2017-07-18 21:31:13,670 INFO  - [main:] ~ No authentication method configured.  Defaulting to simple authentication (LoginProcessor:102)
2017-07-18 21:31:13,767 INFO  - [main:] ~ Logged in user root (auth:SIMPLE) (LoginProcessor:77)
2017-07-18 21:31:14,320 INFO  - [main:] ~ Not running setup per configuration atlas.server.run.setup.on.start. (SetupSteps$SetupRequired:189)
2017-07-18 21:31:14,936 INFO  - [main:] ~ Instantiated HBase compatibility layer supporting runtime HBase version 1.1.2: com.thinkaurelius.titan.diskstorage.hbase.HBaseCompat1_1 (HBaseCompatLoader:69)
2017-07-18 21:31:14,962 INFO  - [main:] ~ Copied host list from root.storage.hostname to hbase.zookeeper.quorum: localhost (HBaseStoreManager:320)
2017-07-18 21:31:15,045 WARN  - [main-SendThread(localhost:2181):] ~ Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2017-07-18 21:31:15,151 WARN  - [main:] ~ Possibly transient ZooKeeper, quorum=localhost:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid (RecoverableZooKeeper:275)
2017-07-18 21:31:16,149 WARN  - [main-SendThread(localhost:2181):] ~ Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2017-07-18 21:31:16,250 WARN  - [main:] ~ Possibly transient ZooKeeper, quorum=localhost:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid (RecoverableZooKeeper:275)

Any suggestions how to resolve this issue?

Thanks

[#2]

@Arsalan Siddiqi

From the exceptions it appears that the Atlas is having difficulty connecting to Kafka.

From the web UI exception, it appears to be a build problem.

Can you please confirm which profile have you used for build is it berlekeyDB & elasticSearch or is it hbase & solr.

[#3]

@Ashutosh Mestry i used hbase & solr

[#4]

Can you share some details on how you built/started atlas ? What env are you working on ?

[#5]

@anaik

i am running atlas on Ubuntu 16.4.... i followed the instructions on the following link:

http://atlas.apache.org/InstallationSteps.html

[#6]

Can check if Zookeeper is alive and accepting connections ?

I usually check using this command, assuming that the host is localhost and the Zookeeper port is 2181

telnet localhost 2181

[#7]

@anaik

@Ashutosh Mestry

i checked and zookeeper is running and accepting connections. Attached is the log file:atlas20170812-204645.txt

I am unable to proceed. Kindly help

[#8]

@Arsalan Siddiqi

The root cause of the NullPointerException on the Zookeeper:

Caused by: java.lang.NullPointerException
	at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.getMetaReplicaNodes(ZooKeeperWatcher.java:395)
	at org.apache.hadoop.hbase.zookeeper.MetaTableLocator.blockUntilAvailable(MetaTableLocator.java:553)
	at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getMetaRegionLocation(ZooKeeperRegistry.java:61)

.

It usually happens when the Zookeeper Parent is not defined properly. (i mean empty).

Please double check your Zookeeper URL.

Please check your "hbase-site.xml" location if it is present in the classpath and has correct ZK url. The ZK URL should include the children of hbase znode.

[#9]

@Arsalan Siddiqi

Please check if your "hbase-site.xml" file is present in the Atlas Classpath (conf) dir and the following properties inside your hbase-site.xml are correctly set.

hbase.zookeeper.quorum=zoo1,zoo2,zoo3
zookeeper.znode.parent=/what/ever<br>

.

If the "zookeeper.znode.parent" is not correctly set then it can cause "NullPointerException"

Following link described the details: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.6/bk_command-line-installation/content/config...

.

[#10]

@Jay SenSharma I am not running atlas on HDP. I had a look into the conf dir. I have a hbase folder there. It has a hbase.site.xml template. i renamed the file. the file has the following contents:

<configuration>
  <property>
    <name>hbase.rootdir</name>
    <value>${url_prefix}${atlas_data}/hbase-root</value>
  </property>
  <property>
    <name>hbase.zookeeper.property.dataDir</name>
    <value>${atlas_data}/hbase-zookeeper-data</value>
  </property>
  <property>
    <name>hbase.master.info.port</name>
    <value>61510</value>
  </property>
  <property>
    <name>hbase.regionserver.info.port</name>
    <value>61530</value>
  </property>
  <property>
    <name>hbase.master.port</name>
    <value>61500</value>
  </property>
  <property>
    <name>hbase.regionserver.port</name>
    <value>61520</value>
  </property>	
<property>
<name>zookeeper.znode.parent</name>
<value>/hbase-unsecure</value>
</property>
	
</configuration>


<br>

I restarted atlas but I get the same exception. Also I have installed zookeeper and it is running on port 2181. Also i am running things locally on my laptop. using default configurations in application properties:

atlas-application.txt