question Re: How to resolve crash while loading data in Apache atlas using quick_start.py script? in Support Questions

How to resolve crash while loading data in Apache atlas using quick_start.py script?

naseem_rafique — Fri, 24 Mar 2017 17:02:44 GMT

Hello,

I am setting apache atlas on EC2. When I tried command " bin/quick_start.py" it ask for username/password.

I provide admin/admin. It took a while and than gives this crashlog.

apache-atlas-0.9-incubating-SNAPSHOT$ bin/quick_start.py

Enter username for atlas :-

sam

Enter password for atlas :-

123

=========Crash Log================

Exception in thread "main" java.lang.IllegalArgumentException: None of the passed URLs are active org.apache.atlas.AtlasServerEnsemble@40ef3420

at org.apache.atlas.AtlasBaseClient.determineActiveServiceURL(AtlasBaseClient.java:207)

at org.apache.atlas.AtlasBaseClient.initializeState(AtlasBaseClient.java:152)

at org.apache.atlas.AtlasBaseClient.initializeState(AtlasBaseClient.java:140)

at org.apache.atlas.AtlasBaseClient.<init>(AtlasBaseClient.java:96)

at org.apache.atlas.AtlasClientV2.<init>(AtlasClientV2.java:105)

at org.apache.atlas.examples.QuickStartV2.<init>(QuickStartV2.java:179)

at org.apache.atlas.examples.QuickStartV2.runQuickstart(QuickStartV2.java:141)

at org.apache.atlas.examples.QuickStartV2.main(QuickStartV2.java:132)

Caused by: org.apache.atlas.AtlasServiceException: Metadata service API GET : api/atlas/admin/status failed

at org.apache.atlas.AtlasBaseClient.selectActiveServerAddress(AtlasBaseClient.java:228)

at org.apache.atlas.AtlasBaseClient.determineActiveServiceURL(AtlasBaseClient.java:204)

... 7 more

Caused by: java.lang.RuntimeException: Could not find any active instance

... 9 more

No sample data added to Apache Atlas Server.

Please guide If any one has any idea about it.

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

apathan — Fri, 24 Mar 2017 17:06:26 GMT

@Naseem Rafique

Exception in thread "main" java.lang.IllegalArgumentException: None of the passed URLs are active org.apache.atlas.AtlasServerEnsemble@40ef3420

This exception says that, the atlas url that is picked up from <ATLAS_HOME>/conf/atlas-application.properties is not active and it cant post the metadata to Atlas,

Please check the config mentioned above and make sure it is pointing to Atlas instance which is up and running.

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

naseem_rafique — Fri, 24 Mar 2017 17:12:40 GMT

@Ayub Khan

I have tested that server is running by using following command:

curl -v http://localhost:21000/api/atlas/admin/version

Following is the result:

* Trying 127.0.0.1...

* Connected to localhost (127.0.0.1) port 21000 (#0)

> GET /api/atlas/admin/version HTTP/1.1

> Host: localhost:21000

> User-Agent: curl/7.47.0

> Accept: */*

* Empty reply from server

* Connection #0 to host localhost left intact

curl: (52) Empty reply from server

what else I need to test in order to make sure that my server and all of its components are running fine.

Thanks,

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

apathan — Fri, 24 Mar 2017 17:14:51 GMT

@Naseem Rafique

Server is not running.. empty response from server.

* Empty reply from server
* Connection #0 to host localhost left intact
curl: (52) Empty reply from server

Check the atlas application logs, why it is not running. you can find them under <ATLAS_HOME>/logs/application.log

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

naseem_rafique — Fri, 24 Mar 2017 17:15:58 GMT

@Ayub Khan

Following is my properties file. atlas-applicationproperties.txt

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

nixonrodrigues — Fri, 24 Mar 2017 17:24:01 GMT

@Naseem Rafique

seems you have setup Atlas in HA.

apache-atlas-0.9-incubating-SNAPSHOT$ bin/quick_start.py <http/https>://<atlas-fqdn>:<atlas port>

can you run quickstart with above format.

nixon

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

nixonrodrigues — Fri, 24 Mar 2017 17:36:44 GMT

try http://localhost:21000/login.jsp and check logs in logs/atlas-application.log

This logs can tell more about the problem

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

naseem_rafique — Fri, 24 Mar 2017 17:50:19 GMT

@Nixon Rodrigues

which end point do i need to provide here in following format? in guide it is mentioned as optional.

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

nixonrodrigues — Fri, 24 Mar 2017 18:04:25 GMT

@Naseem Rafique

apache-atlas-0.9-incubating-SNAPSHOT$ bin/quick_start.py http://localhost:21000

also check logs in logs/atlas-application.log

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

naseem_rafique — Fri, 24 Mar 2017 18:13:45 GMT

@Nixon Rodrigues

apache-atlas-0.9-incubating-SNAPSHOT$ bin/quick_start.py http://localhost:21000

Enter username for atlas :-

sam

Enter password for atlas :-

123

Creating sample types:

Exception in thread "main" com.sun.jersey.api.client.ClientHandlerException: java.net.SocketException: Unexpected end of file from server

at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155)

at com.sun.jersey.api.client.filter.HTTPBasicAuthFilter.handle(HTTPBasicAuthFilter.java:105)

at com.sun.jersey.api.client.Client.handle(Client.java:652)

at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682)

at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)

at com.sun.jersey.api.client.WebResource$Builder.method(WebResource.java:634)

at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:300)

at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:287)

at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:429)

at org.apache.atlas.AtlasClientV2.createAtlasTypeDefs(AtlasClientV2.java:217)

at org.apache.atlas.examples.QuickStartV2.createTypes(QuickStartV2.java:191)

at org.apache.atlas.examples.QuickStartV2.runQuickstart(QuickStartV2.java:147)

at org.apache.atlas.examples.QuickStartV2.main(QuickStartV2.java:132)

Caused by: java.net.SocketException: Unexpected end of file from server

at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:792)

at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:647)

at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:789)

at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:647)

at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1569)

at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)

at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480)

at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253)

at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153)

... 12 more

No sample data added to Apache Atlas Server.

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

naseem_rafique — Fri, 24 Mar 2017 18:14:20 GMT

Tried the following.

apache-atlas-0.9-incubating-SNAPSHOT$ curl -v http://localhost:21000/login.jsp

* Trying 127.0.0.1...

* Connected to localhost (127.0.0.1) port 21000 (#0)

> GET /login.jsp HTTP/1.1

> Host: localhost:21000

> User-Agent: curl/7.47.0

> Accept: */*

* Empty reply from server

* Connection #0 to host localhost left intact

curl: (52) Empty reply from server

Can you check my applicatio.properties attached in the comments.

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

nixonrodrigues — Fri, 24 Mar 2017 18:18:16 GMT

@Naseem Rafique

Seems your Atlas server is down. do followings steps.

restart atlas and same time tail the atlas-application.logs

please attacht your atlas-application.logs

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

naseem_rafique — Fri, 24 Mar 2017 18:29:52 GMT

@Nixon Rodrigues

Following is the log file.

logs.txt

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

nixonrodrigues — Fri, 24 Mar 2017 18:53:58 GMT

@Naseem Rafique your hbase is down, it has not started well. please restart Atlas and check

com.thinkaurelius.titan.diskstorage.hbase.HBaseCompat1_1 (HBaseCompatLoader:69)\

2017-03-24 11:23:16,997 INFO  - [main:] ~ Copied host list from root.storage.hostname to hbase.zookeeper.quorum: localhost (HBaseStoreManager:320)\
2017-03-24 11:23:17,159 WARN  - [main:] ~ FAILED o.e.j.w.WebAppContext@fcb4004\{/,file:/home/ubuntu/atlas-code/distro/target/apache-atlas-0.9-incubating-SNAPSHOT/server/webapp/atlas/,STARTING\}\{/home/ubuntu/atlas-code/distro/target/apache-atlas-0.9-incubating-SNAPSHOT/server/webapp/atlas\}: java.lang.ExceptionInInitializerError (AbstractLifeCycle:212)\
java.lang.ExceptionInInitializerError\
	at java.lang.Class.forName0(Native Method)\
	at java.lang.Class.forName(Class.java:264)\
	at org.apache.atlas.ApplicationProperties.getClass(ApplicationProperties.java:120)\
	at org.apache.atlas.util.AtlasRepositoryConfiguration.getDeleteHandlerImpl(AtlasRepositoryConfiguration.java:103)\
	at org.apache.atlas.RepositoryMetadataModule.configure(RepositoryMetadataModule.java:109)\
	at com.google.inject.AbstractModule.configure(AbstractModule.java:62)\
	at com.google.inject.spi.Elements$RecordingBinder.install(Elements.java:340)\
	at com.google.inject.spi.Elements.getElements(Elements.java:110)\
	at com.google.inject.internal.InjectorShell$Builder.build(InjectorShell.java:138)\
	at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:104)\
	at com.google.inject.Guice.createInjector(Guice.java:99)\
	at com.google.inject.Guice.createInjector(Guice.java:84)\
	at org.apache.atlas.web.listeners.GuiceServletConfig.getInjector(GuiceServletConfig.java:77)\
	at com.google.inject.servlet.GuiceServletContextListener.contextInitialized(GuiceServletContextListener.java:47)\
	at org.apache.atlas.web.listeners.GuiceServletConfig.contextInitialized(GuiceServletConfig.java:142)\
	at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800)\
	at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444)\
	at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)\
	at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294)\
	at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)\
	at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)\
	at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)\
	at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)\
	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)\
	at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)\
	at org.eclipse.jetty.server.Server.start(Server.java:387)\
	at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)\
	at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)\
	at org.eclipse.jetty.server.Server.doStart(Server.java:354)\
	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)\
	at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:95)\
	at org.apache.atlas.Atlas.main(Atlas.java:118)\
Caused by: java.lang.RuntimeException: java.lang.NullPointerException\
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:208)\
	at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:320)\
	at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:295)\
	at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:160)\
	at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:155)\
	at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:821)\
	at org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:602)\
	at org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:366)\
	at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:303)\
	at com.thinkaurelius.titan.diskstorage.hbase.HBaseAdmin1_0.tableExists(HBaseAdmin1_0.java:78)\
	at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.ensureTableExists(HBaseStoreManager.java:714)\
	at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.ensureColumnFamilyExists(HBaseStoreManager.java:792)\
	at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.openDatabase(HBaseStoreManager.java:474)\
	at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager.openDatabase(HBaseStoreManager.java:455)\
	at com.thinkaurelius.titan.diskstorage.Backend.getStandaloneGlobalConfiguration(Backend.java:387)\
	at com.thinkaurelius.titan.graphdb.configuration.GraphDatabaseConfiguration.<init>(GraphDatabaseConfiguration.java:1277)\
	at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:93)\
	at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:73)\
	at org.apache.atlas.repository.graphdb.titan0.Titan0GraphDatabase.getGraphInstance(Titan0GraphDatabase.java:115)\
	at org.apache.atlas.repository.graphdb.titan0.Titan0GraphDatabase.getGraph(Titan0GraphDatabase.java:171)\
	at org.apache.atlas.repository.graph.AtlasGraphProvider.getGraphInstance(AtlasGraphProvider.java:38)\
	at org.apache.atlas.repository.graph.GraphHelper.getInstance(GraphHelper.java:114)\
	at org.apache

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

naseem_rafique — Fri, 24 Mar 2017 19:25:39 GMT

@Nixon Rodrigues

I have stopped and started the server many times but same problem. What can be possible reasons that hbase is not initiated? Is it packaging issue? What is the structure of apache-atlas-0.9-incubating-SNAPSHOT directory after installation?

I have installed zookeeper on the same machine as atlas is installed on.

Thanks.

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

nixonrodrigues — Fri, 24 Mar 2017 19:32:56 GMT

@Naseem Rafique

I think you are using embedded-hbase-solr option in that case external zookeeper is not needed. please stop external zookeeper and try.

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

naseem_rafique — Fri, 24 Mar 2017 19:48:27 GMT

@Nixon Rodrigues

Yes you are right, I am using embedded-hbase-solr option. and I have stopped external zookeeper and restart the atlas server. This time logs are different. It keep trying to connect zookeeper and than through an exception after every 4 tries, have a look at the log file atached herewith.

Do I need to change some configurations in applicatoin.properties file?

logs1.txt

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

nixonrodrigues — Sun, 26 Mar 2017 13:11:50 GMT

@Naseem Rafique

After checking the log1.txt i feels that your hbase is still not up & running, try to make it up and create few tables and then try with Atlas.

Workaround, Use berkeley-elasticsearch profile instead embBededhbase solr.

http://atlas.incubator.apache.org/InstallationSteps.html

You need rebuild atlas with below profile

mvn clean package -Pdist,berkeley-elasticsearch

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

naseem_rafique — Mon, 27 Mar 2017 14:20:02 GMT

@Nixon Rodrigues

Thanks for following up. Can you tell me that do i need to install standalone Solr instance while using embeded-hbas-solr packaging.

Re: How to resolve crash while loading data in Apache atlas using quick_start.py script?

nixonrodrigues — Mon, 27 Mar 2017 14:29:01 GMT

@Naseem Rafique

For embeded-hbase-solr option you dont require any setup of solr or hbase, it already package in distro and managed by atlas in start up script

can you export this env variable and then start then Atlas (atlas_start.py)

export MANAGE_LOCAL_SOLR=True

export MANAGE_LOCAL_HBASE=True