question Re: Apache Atlas Started but with Errors and Warnings in Support Questions

Apache Atlas Started but with Errors and Warnings

b_arshad — Mon, 19 Aug 2019 09:04:54 GMT

I have followed the following link to build and install Apache Atlas

Link: http://atlas.incubator.apache.org/InstallationSteps.html

And selected to install the embedded-hbase-solr profile, but when I started Atlas after installation it is showing me the following errors and warning.

I have also tried to see which version is running curl -v http://localhost:21000/api/atlas/admin/version but it is giving the following:

* Hostname was NOT found in DNS cache * Trying 127.0.0.1... * connect to 127.0.0.1 port 21000 failed: Connection refused * Failed to connect to localhost port 21000: Connection refused * Closing connection 0 curl: (7) Failed to connect to localhost port 21000: Connection refused

Kindly let me know how shall I proceed to ensure Altas is working in the correct order. Any help will be highly appreciated. Thanking you in anticipation.

Kind Regards

Re: Apache Atlas Started but with Errors and Warnings

rjain1 — Tue, 17 Jan 2017 21:28:41 GMT

@Bilal ArshadCan you please confirm that atlas is running and bind to the correct port, also share the /var/log/atlas/application.log

- netstat -tulnp | grep -i 21000

- ps -ef | grep -i atlas

Re: Apache Atlas Started but with Errors and Warnings

b_arshad — Mon, 19 Aug 2019 09:04:46 GMT

@Rishi I am not sure if it is running properly since I just got the notification : 'Apache Atlas Server started!!!'.

After that I tried to verify using the following command: curl -v http://localhost:21000/api/atlas/admin/version and it gave showed that connection was refused (* Hostname was NOT found in DNS cache * Trying 127.0.0.1... * connect to 127.0.0.1 port 21000 failed: Connection refused * Failed to connect to localhost port 21000: Connection refused * Closing connection 0 curl: (7) Failed to connect to localhost port 21000: Connection refused)

I tried to run the commands in your reply and that gives me the following (screenshot attached)

Thank you!

Re: Apache Atlas Started but with Errors and Warnings

anaik — Wed, 18 Jan 2017 03:10:46 GMT

I think you have to build the server using "mvn clean install -Pdist,<your hbase profile name>", once this is done you need to navigate to the distro/target/ folder and then run the atlas_start.py from there.

HTH

Re: Apache Atlas Started but with Errors and Warnings

anaik — Wed, 18 Jan 2017 03:31:13 GMT

* -Pdist,embedded-hbase-solr

Re: Apache Atlas Started but with Errors and Warnings

b_arshad — Mon, 19 Aug 2019 09:04:38 GMT

@anaik I tried to build the server but it fails on web-application as you can see below:

Re: Apache Atlas Started but with Errors and Warnings

anaik — Tue, 24 Jan 2017 02:28:42 GMT

@Bilal Arshad Looks like there are some IT failures on the master branch. Can you add -DskipITs as well to the maven command ?

Re: Apache Atlas Started but with Errors and Warnings

b_arshad — Tue, 24 Jan 2017 06:22:15 GMT

@anaik

adding the command -DskipITs still gives me the error saying 'too many unapproved licenses'!

Re: Apache Atlas Started but with Errors and Warnings

anaik — Tue, 24 Jan 2017 07:15:17 GMT

That's weird. Maybe there are some unnecessary files there in the directory. Either do a git clean on that or run mvn clean install -DskipTests -Pdist,berkeley-elasticsearch -Drat.numUnapprovedLicenses=100

HTH.

Re: Apache Atlas Started but with Errors and Warnings

b_arshad — Tue, 24 Jan 2017 21:09:41 GMT

@anaik

when I run the command 'mvn clean install -Pdist,embedded-hbase-solr -DskipITs' it is still pointing to the same error saying 'Failed to execute goal org.apache.maven.plugns:maven-surefire-plugin:2.18.1:test (default-test) on project atlas-notification: There are test failures'

Re: Apache Atlas Started but with Errors and Warnings

b_arshad — Mon, 19 Aug 2019 09:04:25 GMT

This is the exact message I am getting:

Re: Apache Atlas Started but with Errors and Warnings

anaik — Wed, 25 Jan 2017 01:30:45 GMT

Can you dump the maven logs here ? Need more context on what might be failing. The same command seems to be working fine for me.

[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Atlas Server Build Tools .................... SUCCESS [  0.612 s]
[INFO] apache-atlas ....................................... SUCCESS [  5.822 s]
[INFO] Apache Atlas Integration ........................... SUCCESS [ 29.446 s]
[INFO] Apache Atlas Common ................................ SUCCESS [  8.293 s]
[INFO] Apache Atlas Typesystem ............................ SUCCESS [ 50.725 s]
[INFO] Apache Atlas Client ................................ SUCCESS [  8.318 s]
[INFO] Apache Atlas Server API ............................ SUCCESS [  4.615 s]
[INFO] Apache Atlas Notification .......................... SUCCESS [ 24.134 s]
[INFO] Apache Atlas Graph Database Projects ............... SUCCESS [  0.337 s]
[INFO] Apache Atlas Graph Database API .................... SUCCESS [  3.059 s]
[INFO] Graph Database Common Code ......................... SUCCESS [  3.140 s]
[INFO] Shaded version of Apache hbase client .............. SUCCESS [  5.861 s]
[INFO] Apache Atlas Titan 0.5.4 Graph DB Impl ............. SUCCESS [01:30 min]
[INFO] Apache Atlas Graph Database Implementation Dependencies SUCCESS [  0.444 s]
[INFO] Shaded version of Apache hbase server .............. SUCCESS [ 13.323 s]

Re: Apache Atlas Started but with Errors and Warnings

b_arshad — Wed, 25 Jan 2017 01:44:04 GMT

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (default-test) on project atlas-notification: There are test failures. [ERROR] [ERROR] Please refer to /home/hduser/atlas/notification/target/surefire-reports for the individual test results. [ERROR] -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.18.1:test (default-test) on project atlas-notification: There are test failures. Please refer to /home/hduser/atlas/notification/target/surefire-reports for the individual test results. at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:317) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:152) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:555) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214) at org.apache.maven.cli.MavenCli.main(MavenCli.java:158) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures. Please refer to /home/hduser/atlas/notification/target/surefire-reports for the individual test results. at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:82) at org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:254) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:854) at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:722) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:106) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208) ... 19 more [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command

[ERROR] mvn <goals> -rf :atlas-notification

Re: Apache Atlas Started but with Errors and Warnings

b_arshad — Mon, 19 Aug 2019 09:04:17 GMT

@anaik Thank you for the suggestions, the following command seems to work and provided a successful build 'mvn clean install -Pdist,embedded-hbase-solr -DskipITs -DskipTests -Drat.numUnapprovedLicenses=100'.

However after the build when I navigate to target folder and try running the atlas_start.py, it says 'Apache Atlas Server Started!!!'

When I try the following to verify if the server is up and running: 'curl -v http://localhost:21000/api/atlas/admin/version'

It gives me the following:

Re: Apache Atlas Started but with Errors and Warnings

anaik — Thu, 26 Jan 2017 03:34:09 GMT

Ok awesome, atleast the server came up. Try the following commands

curl -sivk -u admin:admin http://localhost:21000/api/atlas/admin/version

curl -sivk http://localhost:21000/api/atlas/admin/status

Re: Apache Atlas Started but with Errors and Warnings

b_arshad — Thu, 26 Jan 2017 19:04:55 GMT

@anaik both the commands are giving the same response as the screenshot above!

The only thing different is the 'Authorization: Basic ****************=' line after the GET /api/atlas/admin/version HTTP/1.1

Re: Apache Atlas Started but with Errors and Warnings

nixonrodrigues — Thu, 26 Jan 2017 21:59:16 GMT

@Bilal Arshad

Please checks application.log,its in logs directory.

Post the log errors here for investigation

Re: Apache Atlas Started but with Errors and Warnings

b_arshad — Mon, 19 Aug 2019 09:04:09 GMT

@Rishi 'netstat -tulnp | grep -i 21000' command gives the following result:

Re: Apache Atlas Started but with Errors and Warnings

b_arshad — Thu, 26 Jan 2017 23:55:58 GMT

017-01-26 00:00:00,351 WARN  - [main-SendThread(localhost:2181):] ~ Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2017-01-26 00:00:01,453 WARN  - [main-SendThread(localhost:2181):] ~ Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2017-01-26 00:00:02,554 WARN  - [main-SendThread(localhost:2181):] ~ Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2017-01-26 00:00:03,656 WARN  - [main-SendThread(localhost:2181):] ~ Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2017-01-26 00:00:04,757 WARN  - [main-SendThread(localhost:2181):] ~ Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)

at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)

Re: Apache Atlas Started but with Errors and Warnings

b_arshad — Thu, 26 Jan 2017 23:57:47 GMT

@Nixon Rodrigues the contents of the log file are too big to be posted here so I have just posted the beginning of the file for reference.