How to resolve crash while loading data in Apache atlas using quick_start.py script?

[#1]

Hello,

I am setting apache atlas on EC2. When I tried command " bin/quick_start.py" it ask for username/password.

I provide admin/admin. It took a while and than gives this crashlog.

apache-atlas-0.9-incubating-SNAPSHOT$ bin/quick_start.py

Enter username for atlas :-

sam

Enter password for atlas :-

123

=========Crash Log================

Exception in thread "main" java.lang.IllegalArgumentException: None of the passed URLs are active org.apache.atlas.AtlasServerEnsemble@40ef3420

at org.apache.atlas.AtlasBaseClient.determineActiveServiceURL(AtlasBaseClient.java:207)

at org.apache.atlas.AtlasBaseClient.initializeState(AtlasBaseClient.java:152)

at org.apache.atlas.AtlasBaseClient.initializeState(AtlasBaseClient.java:140)

at org.apache.atlas.AtlasBaseClient.<init>(AtlasBaseClient.java:96)

at org.apache.atlas.AtlasClientV2.<init>(AtlasClientV2.java:105)

at org.apache.atlas.examples.QuickStartV2.<init>(QuickStartV2.java:179)

at org.apache.atlas.examples.QuickStartV2.runQuickstart(QuickStartV2.java:141)

at org.apache.atlas.examples.QuickStartV2.main(QuickStartV2.java:132)

Caused by: org.apache.atlas.AtlasServiceException: Metadata service API GET : api/atlas/admin/status failed

at org.apache.atlas.AtlasBaseClient.selectActiveServerAddress(AtlasBaseClient.java:228)

at org.apache.atlas.AtlasBaseClient.determineActiveServiceURL(AtlasBaseClient.java:204)

... 7 more

Caused by: java.lang.RuntimeException: Could not find any active instance

... 9 more

No sample data added to Apache Atlas Server.

Please guide If any one has any idea about it.

[#2]

@Nixon Rodrigues

apache-atlas-0.9-incubating-SNAPSHOT$ bin/quick_start.py http://localhost:21000

Enter username for atlas :-

sam

Enter password for atlas :-

123

Creating sample types:

Exception in thread "main" com.sun.jersey.api.client.ClientHandlerException: java.net.SocketException: Unexpected end of file from server

at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155)

at com.sun.jersey.api.client.filter.HTTPBasicAuthFilter.handle(HTTPBasicAuthFilter.java:105)

at com.sun.jersey.api.client.Client.handle(Client.java:652)

at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682)

at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)

at com.sun.jersey.api.client.WebResource$Builder.method(WebResource.java:634)

at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:300)

at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:287)

at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:429)

at org.apache.atlas.AtlasClientV2.createAtlasTypeDefs(AtlasClientV2.java:217)

at org.apache.atlas.examples.QuickStartV2.createTypes(QuickStartV2.java:191)

at org.apache.atlas.examples.QuickStartV2.runQuickstart(QuickStartV2.java:147)

at org.apache.atlas.examples.QuickStartV2.main(QuickStartV2.java:132)

Caused by: java.net.SocketException: Unexpected end of file from server

at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:792)

at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:647)

at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:789)

at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:647)

at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1569)

at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)

at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)

at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253)

at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153)

... 12 more

No sample data added to Apache Atlas Server.

[#3]

@Naseem Rafique

Seems your Atlas server is down. do followings steps.

restart atlas and same time tail the atlas-application.logs

please attacht your atlas-application.logs

[#4]

@Nixon Rodrigues

Following is the log file.

logs.txt

[#5]

@Naseem Rafique your hbase is down, it has not started well. please restart Atlas and check

com.thinkaurelius.titan.diskstorage.hbase.HBaseCompat1_1 (HBaseCompatLoader:69)\

2017-03-24 11:23:16,997 INFO  - [main:] ~ Copied host list from root.storage.hostname to hbase.zookeeper.quorum: localhost (HBaseStoreManager:320)\
2017-03-24 11:23:17,159 WARN  - [main:] ~ FAILED o.e.j.w.WebAppContext@fcb4004\{/,file:/home/ubuntu/atlas-code/distro/target/apache-atlas-0.9-incubating-SNAPSHOT/server/webapp/atlas/,STARTING\}\{/home/ubuntu/atlas-code/distro/target/apache-atlas-0.9-incubating-SNAPSHOT/server/webapp/atlas\}: java.lang.ExceptionInInitializerError (AbstractLifeCycle:212)\
java.lang.ExceptionInInitializerError\
	at java.lang.Class.forName0(Native Method)\
	at java.lang.Class.forName(Class.java:264)\
	at org.apache.atlas.ApplicationProperties.getClass(ApplicationProperties.java:120)\
	at org.apache.atlas.util.AtlasRepositoryConfiguration.getDeleteHandlerImpl(AtlasRepositoryConfiguration.java:103)\
	at org.apache.atlas.RepositoryMetadataModule.configure(RepositoryMetadataModule.java:109)\
	at com.google.inject.AbstractModule.configure(AbstractModule.java:62)\
	at com.google.inject.spi.Elements$RecordingBinder.install(Elements.java:340)\
	at com.google.inject.spi.Elements.getElements(Elements.java:110)\
	at com.google.inject.internal.InjectorShell$Builder.build(InjectorShell.java:138)\
	at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:104)\
	at com.google.inject.Guice.createInjector(Guice.java:99)\
	at com.google.inject.Guice.createInjector(Guice.java:84)\
	at org.apache.atlas.web.listeners.GuiceServletConfig.getInjector(GuiceServletConfig.java:77)\
	at com.google.inject.servlet.GuiceServletContextListener.contextInitialized(GuiceServletContextListener.java:47)\
	at org.apache.atlas.web.listeners.GuiceServletConfig.contextInitialized(GuiceServletConfig.java:142)\
	at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800)\
	at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444)\
	at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)\
	at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294)\
	at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)\
	at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)\
	at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)\
	at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)\
	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)\
	at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)\
	at org.eclipse.jetty.server.Server.start(Server.java:387)\
	at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)\
	at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)\
	at org.eclipse.jetty.server.Server.doStart(Server.java:354)\
	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)\
	at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:95)\
	at org.apache.atlas.Atlas.main(Atlas.java:118)\
Caused by: java.lang.RuntimeException: java.lang.NullPointerException\
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:208)\
	at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:320)\
	at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:295)\
	at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:160)\
	at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:155)\
	at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:821)\
	at org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:602)\
	at org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:366)\
	at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:303)\
	at com.thinkaurelius.titan.diskstorage.hbase.HBaseAdmin1_0.tableExists(HBaseAdmin1_0.java:78)\
	at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.ensureTableExists(HBaseStoreManager.java:714)\
	at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.ensureColumnFamilyExists(HBaseStoreManager.java:792)\
	at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.openDatabase(HBaseStoreManager.java:474)\
	at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.openDatabase(HBaseStoreManager.java:455)\
	at com.thinkaurelius.titan.diskstorage.Backend.getStandaloneGlobalConfiguration(Backend.java:387)\
	at com.thinkaurelius.titan.graphdb.configuration.GraphDatabaseConfiguration.<init>(GraphDatabaseConfiguration.java:1277)\
	at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:93)\
	at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:73)\
	at org.apache.atlas.repository.graphdb.titan0.Titan0GraphDatabase.getGraphInstance(Titan0GraphDatabase.java:115)\
	at org.apache.atlas.repository.graphdb.titan0.Titan0GraphDatabase.getGraph(Titan0GraphDatabase.java:171)\
	at org.apache.atlas.repository.graph.AtlasGraphProvider.getGraphInstance(AtlasGraphProvider.java:38)\
	at org.apache.atlas.repository.graph.GraphHelper.getInstance(GraphHelper.java:114)\
	at org.apache

[#6]

@Nixon Rodrigues

I have stopped and started the server many times but same problem. What can be possible reasons that hbase is not initiated? Is it packaging issue? What is the structure of apache-atlas-0.9-incubating-SNAPSHOT directory after installation?

I have installed zookeeper on the same machine as atlas is installed on.

Thanks.

[#7]

@Naseem Rafique

I think you are using embedded-hbase-solr option in that case external zookeeper is not needed. please stop external zookeeper and try.

[#8]

@Nixon Rodrigues

Yes you are right, I am using embedded-hbase-solr option. and I have stopped external zookeeper and restart the atlas server. This time logs are different. It keep trying to connect zookeeper and than through an exception after every 4 tries, have a look at the log file atached herewith.

Do I need to change some configurations in applicatoin.properties file?

logs1.txt

[#9]

@Naseem Rafique

After checking the log1.txt i feels that your hbase is still not up & running, try to make it up and create few tables and then try with Atlas.

OR

Workaround, Use berkeley-elasticsearch profile instead embBededhbase solr.

http://atlas.incubator.apache.org/InstallationSteps.html

You need rebuild atlas with below profile

mvn clean package -Pdist,berkeley-elasticsearch

[#10]

@Nixon Rodrigues

Thanks for following up. Can you tell me that do i need to install standalone Solr instance while using embeded-hbas-solr packaging.

[#11]

@Naseem Rafique

For embeded-hbase-solr option you dont require any setup of solr or hbase, it already package in distro and managed by atlas in start up script

can you export this env variable and then start then Atlas (atlas_start.py)

export MANAGE_LOCAL_SOLR=True 

export MANAGE_LOCAL_HBASE=True