Member since
10-31-2016
62
Posts
3
Kudos Received
0
Solutions
05-04-2017
09:18 AM
@mqureshi thank you for the reply. Do you happen to know any guide where the inner working of Atlas (related to indexing) is explained in detail? If yes, would you be kind enough to point me to it please? Thanking you in anticipation. Kind Regards Bilal
... View more
04-12-2017
12:59 PM
I am using the following guide (link: http://atlas.incubator.apache.org/InstallationSteps.html) for building and installing Atlas. In the guide the user needs to create three collections in Solr, vertex_index, edge_index and fulltext_index. I would like to know what is the purpose of these and how do they work in order to index? Also, how does indexing work in Atlas? Thanking you in anticipation.
... View more
Labels:
- Labels:
-
Apache Atlas
-
Apache Solr
04-10-2017
06:35 PM
@mqureshi Thank you for the reply. I am using the following (link: http://atlas.apache.org/InstallationSteps.html) for Atlas installation. I can view the schema.xml under the conf folder within the atlas installation. How can we add indexes in Solr based on our data stored in Atlas? Is there a mechanism to do so, or like the schema.xml it is hidden from users?
... View more
04-10-2017
11:02 AM
The documentation (link: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-governance/content/ch_hdp_data_governance_overview.html) says that the Index Store is configured to use SOLR. How is SOLR indexing in Atlas? Any help will be highly appreciated! Thanking you in anticipation!
... View more
Labels:
- Labels:
-
Apache Atlas
-
Apache Solr
03-28-2017
02:25 PM
I am using the REST API to query metadata ingested into Atlas. I then need to visualise the results from this query in the form of a graph. Any suggestions what plugin or tool can work well with Atlas? P.S this needs to be done in addition to the lineage support already provided by Atlas. The native lineage support provided by Atlas gives users the ability to track data lineage, but for my work we need to show the connections between elements visually in the form of a graph. Any help will be highly appreciated!
... View more
Labels:
- Labels:
-
Apache Atlas
03-24-2017
04:02 PM
@Graham Martin there is nothing wrong with the Atlas UI. I want to display the data in my Atlas in a graph based visualisation, not just the lineage. That is why I require a method a visualise data ingested into Atlas. I hope I can help you to understand the issue.
... View more
03-24-2017
01:00 PM
I need to visualise data already ingested into Apache Atlas. Do I need plugins such as 'KeyLines' or 'Rexter' to visualise data present in Titan Storage (Atlas). Or is there a simpler way for example using d3 libraries? Any help will be highly appreciated!
... View more
Labels:
- Labels:
-
Apache Atlas
02-27-2017
12:37 PM
@Ayub Khan The atlas.20170227-122728.err contains the following error, I am running atlas from the hduser account so I am surprised why is it saying permission denied: log4j:ERROR setFile(null,true) call failed.
java.io.FileNotFoundException: /home/hduser/atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT/logs/application.log (Permission denied)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:221)
at java.io.FileOutputStream.<init>(FileOutputStream.java:142)
at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
at org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:223)
at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
at org.apache.log4j.xml.DOMConfigurator.parseAppender(DOMConfigurator.java:295)
at org.apache.log4j.xml.DOMConfigurator.findAppenderByName(DOMConfigurator.java:176)
at org.apache.log4j.xml.DOMConfigurator.findAppenderByReference(DOMConfigurator.java:191)
at org.apache.log4j.xml.DOMConfigurator.parseChildrenOfLoggerElement(DOMConfigurator.java:523)
at org.apache.log4j.xml.DOMConfigurator.parseCategory(DOMConfigurator.java:436)
at org.apache.log4j.xml.DOMConfigurator.parse(DOMConfigurator.java:1004)
at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:872)
at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:778)
at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)
at org.slf4j.impl.Log4jLoggerFactory.<init>(Log4jLoggerFactory.java:66)
at org.slf4j.impl.StaticLoggerBinder.<init>(StaticLoggerBinder.java:72)
at org.slf4j.impl.StaticLoggerBinder.<clinit>(StaticLoggerBinder.java:45)
at org.slf4j.LoggerFactory.bind(LoggerFactory.java:150)
at org.slf4j.LoggerFactory.performInitialization(LoggerFactory.java:124)
at org.slf4j.LoggerFactory.getILoggerFactory(LoggerFactory.java:412)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:357)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:383)
at org.apache.atlas.Atlas.<clinit>(Atlas.java:43)
log4j:ERROR Either File or DatePattern options are not set for appender [FILE].
The quick_start.log is showing the following: 017-02-23 10:04:38,562 INFO - [main:] ~ Looking for atlas-application.properties in classpath (ApplicationProperties:73)
2017-02-23 10:04:38,565 INFO - [main:] ~ Loading atlas-application.properties from file:/home/hduser/atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT/conf$
2017-02-23 10:04:43,505 INFO - [main:] ~ Client has only one service URL, will use that for all actions: http://localhost:21000 (AtlasBaseClient:198)
2017-02-23 10:04:43,719 INFO - [main:] ~ Client has only one service URL, will use that for all actions: http://localhost:21000 (AtlasBaseClient:198)
2017-02-23 10:04:43,811 INFO - [main:] ~ Client has only one service URL, will use that for all actions: http://localhost:21000 (AtlasBaseClient:198)
2017-02-23 10:04:43,921 INFO - [main:] ~ Client has only one service URL, will use that for all actions: http://localhost:21000 (AtlasBaseClient:198)
2017-02-23 10:04:44,076 ERROR - [main:] ~ Got a service unavailable when calling: http://localhost:21000/api/atlas/v2/types/typedefs/, will retry.. (AtlasBaseClient:320)
2017-02-23 10:04:49,079 ERROR - [main:] ~ Got a service unavailable when calling: http://localhost:21000/api/atlas/v2/types/typedefs/, will retry.. (AtlasBaseClient:320)
2017-02-23 10:04:54,086 ERROR - [main:] ~ Got a service unavailable when calling: http://localhost:21000/api/atlas/v2/types/typedefs/, will retry.. (AtlasBaseClient:320)
2017-02-23 10:04:59,091 ERROR - [main:] ~ Got a service unavailable when calling: http://localhost:21000/api/atlas/v2/types/typedefs/, will retry.. (AtlasBaseClient:320)
... View more
02-23-2017
05:41 PM
@Ayub Khan Application.log contains the following: java.lang.RuntimeException: cannot use dir /usr/lib/jvm/java-7-openjdk-amd64/jre/lib/ext/libatk-wrapper.so
at org.reflections.vfs.SystemDir.<init>(SystemDir.java:20)
at org.reflections.vfs.Vfs$DefaultUrlTypes$3.createDir(Vfs.java:237)
at org.reflections.vfs.Vfs.fromURL(Vfs.java:99)
at org.reflections.vfs.Vfs.fromURL(Vfs.java:91)
at org.reflections.Reflections.scan(Reflections.java:231)
at org.reflections.Reflections.scan(Reflections.java:204)
at org.reflections.Reflections.<init>(Reflections.java:129)
2017-02-23 09:24:24,583 WARN - [main:] ~ could not create Vfs.Dir from url. ignoring the exception and continuing (Reflections:208)
org.reflections.ReflectionsException: could not create Vfs.Dir from url, no matching UrlType was found [file:/usr/lib/jvm/java-7-openjdk-amd64/jre/lib/ext/libatk-wrapper.so]
either use fromURL(final URL url, final List<UrlType> urlTypes) or use the static setDefaultURLTypes(final List<UrlType> urlTypes) or addDefaultURLTypes(UrlType urlType) with your specialized UrlType.
at org.reflections.vfs.Vfs.fromURL(Vfs.java:109)
at org.reflections.vfs.Vfs.fromURL(Vfs.java:91)
at org.reflections.Reflections.scan(Reflections.java:231)
at org.reflections.Reflections.scan(Reflections.java:204)
at org.reflections.Reflections.<init>(Reflections.java:129)
... View more
02-23-2017
10:06 AM
@Ayub Khan Running bin/quick_start.py resulted in the following output: Enter username for atlas :-
admin
Enter password for atlas :-
admin
Creating sample types:
Exception in thread "main" org.apache.atlas.AtlasServiceException: Metadata service API org.apache.atlas.AtlasBaseClient$APIInfo@30432a9e failed with status 503 (Service Unavailable) Response Body (<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 503 </title>
</head>
<body>
<h2>HTTP ERROR: 503</h2>
<p>Problem accessing /api/atlas/v2/types/typedefs/. Reason:
<pre> Service Unavailable</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
</body>
</html>
)
at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:327)
at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:419)
at org.apache.atlas.AtlasTypedefClientV2.createAtlasTypeDefs(AtlasTypedefClientV2.java:147)
at org.apache.atlas.examples.QuickStartV2.createTypes(QuickStartV2.java:206)
at org.apache.atlas.examples.QuickStartV2.runQuickstart(QuickStartV2.java:153)
at org.apache.atlas.examples.QuickStartV2.main(QuickStartV2.java:138)
No sample data added to Apache Atlas Server.
... View more
02-23-2017
09:48 AM
@Ayub Khan I followed the steps as suggested above and managed to get the following results: hduser@ubuntu:~/atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT$ bin/atlas_start.py
configured for local hbase.
hbase started.
configured for local solr.
solr started.
setting up solr collections...
Apache Atlas Server started!!!
However I am not able to access the dashboard. I tried running the command: curl -v http://localhost:21000/api/atlas/admin/version
And it gave me the following output: hduser@ubuntu:~/atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT$ curl -v http://localhost:21000/api/atlas/admin/version
* Hostname was NOT found in DNS cache
* Trying 127.0.0.1...
* Connected to localhost (127.0.0.1) port 21000 (#0)
> GET /api/atlas/admin/version HTTP/1.1
> User-Agent: curl/7.35.0
> Host: localhost:21000
> Accept: */*
>
< HTTP/1.1 503 Service Unavailable
< Date: Thu, 23 Feb 2017 09:43:12 GMT
< Cache-Control: must-revalidate,no-cache,no-store
< Content-Type: text/html; charset=ISO-8859-1
< Content-Length: 311
* Server Jetty(9.2.12.v20150709) is not blacklisted
< Server: Jetty(9.2.12.v20150709)
<
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 503 </title>
</head>
<body>
<h2>HTTP ERROR: 503</h2>
<p>Problem accessing /api/atlas/admin/version. Reason:
<pre> Service Unavailable</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
</body>
</html>
* Connection #0 to host localhost left intact
Not sure what this means! :S The atlas-20170223-094455.err file contains the following: log4j:ERROR setFile(null,true) call failed.
java.io.FileNotFoundException: /home/hduser/atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT/logs/application.log (Permission denied)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:221)
at java.io.FileOutputStream.<init>(FileOutputStream.java:142)
at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
at org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:223)
at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
at org.apache.log4j.xml.DOMConfigurator.parseAppender(DOMConfigurator.java:295)
at org.apache.log4j.xml.DOMConfigurator.findAppenderByName(DOMConfigurator.java:176)
at org.apache.log4j.xml.DOMConfigurator.findAppenderByReference(DOMConfigurator.java:191)
at org.apache.log4j.xml.DOMConfigurator.parseChildrenOfLoggerElement(DOMConfigurator.java:523)
at org.apache.log4j.xml.DOMConfigurator.parseCategory(DOMConfigurator.java:436)
at org.apache.log4j.xml.DOMConfigurator.parse(DOMConfigurator.java:1004)
at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:872)
at org.apache.log4j.xml.DOMConfigurator.doConfigure(DOMConfigurator.java:778)
at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
at org.apache.log4j.LogManager.<clinit>(LogManager.java:127)
at org.slf4j.impl.Log4jLoggerFactory.<init>(Log4jLoggerFactory.java:66)
at org.slf4j.impl.StaticLoggerBinder.<init>(StaticLoggerBinder.java:72)
at org.slf4j.impl.StaticLoggerBinder.<clinit>(StaticLoggerBinder.java:45)
at org.slf4j.LoggerFactory.bind(LoggerFactory.java:150)
at org.slf4j.LoggerFactory.performInitialization(LoggerFactory.java:124)
at org.slf4j.LoggerFactory.getILoggerFactory(LoggerFactory.java:412)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:357)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:383)
at org.apache.atlas.Atlas.<clinit>(Atlas.java:43)
log4j:ERROR Either File or DatePattern options are not set for appender [FILE].
... View more
02-22-2017
04:28 PM
@Ayub Khan Also I just happened to look at the atlas.20170222-161714.err file and following are the contents. I presume that the address Atlas needs is already in use? If this is the case how do I free it? Exception in thread "main" MultiException[java.lang.ExceptionInInitializerError, java.net.BindException: Address already in use]
at org.eclipse.jetty.server.Server.doStart(Server.java:329)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:92)
at org.apache.atlas.Atlas.main(Atlas.java:118)
java.lang.ExceptionInInitializerError
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:195)
at org.apache.atlas.ApplicationProperties.getClass(ApplicationProperties.java:120)
at org.apache.atlas.util.AtlasRepositoryConfiguration.getDeleteHandlerImpl(AtlasRepositoryConfiguration.java:102)
at org.apache.atlas.RepositoryMetadataModule.configure(RepositoryMetadataModule.java:109)
at com.google.inject.AbstractModule.configure(AbstractModule.java:62)
at com.google.inject.spi.Elements$RecordingBinder.install(Elements.java:340)
at com.google.inject.spi.Elements.getElements(Elements.java:110)
at com.google.inject.internal.InjectorShell$Builder.build(InjectorShell.java:138)
at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:104)
at com.google.inject.Guice.createInjector(Guice.java:99)
at com.google.inject.Guice.createInjector(Guice.java:84)
at org.apache.atlas.web.listeners.GuiceServletConfig.getInjector(GuiceServletConfig.java:77)
at com.google.inject.servlet.GuiceServletContextListener.contextInitialized(GuiceServletContextListener.java:47)
at org.apache.atlas.web.listeners.GuiceServletConfig.contextInitialized(GuiceServletConfig.java:142)
at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800)
at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444)
at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294)
at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at org.eclipse.jetty.server.Server.start(Server.java:387)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.Server.doStart(Server.java:354)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:92)
at org.apache.atlas.Atlas.main(Atlas.java:118)
Caused by: java.lang.IllegalArgumentException: Could not instantiate implementation: com.thinkaurelius.titan.diskstorage.solr.Solr5Index
at com.thinkaurelius.titan.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:55)
at com.thinkaurelius.titan.diskstorage.Backend.getImplementationClass(Backend.java:421)
at com.thinkaurelius.titan.diskstorage.Backend.getIndexes(Backend.java:408)
at com.thinkaurelius.titan.diskstorage.Backend.<init>(Backend.java:139)
at com.thinkaurelius.titan.graphdb.configuration.GraphDatabaseConfiguration.getBackend(GraphDatabaseConfiguration.java:1748)
at com.thinkaurelius.titan.graphdb.database.StandardTitanGraph.<init>(StandardTitanGraph.java:110)
at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:93)
at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:73)
at org.apache.atlas.repository.graphdb.titan0.Titan0GraphDatabase.getGraphInstance(Titan0GraphDatabase.java:115)
at org.apache.atlas.repository.graphdb.titan0.Titan0GraphDatabase.getGraph(Titan0GraphDatabase.java:171)
at org.apache.atlas.repository.graph.AtlasGraphProvider.getGraphInstance(AtlasGraphProvider.java:38)
at org.apache.atlas.repository.graph.GraphHelper.getInstance(GraphHelper.java:113)
at org.apache.atlas.repository.graph.DeleteHandler.<clinit>(DeleteHandler.java:54)
... 32 more
... View more
02-22-2017
04:16 PM
@Nixon Rodrigues Running the above command is yielding the output attached, not sure what to take from it though!
... View more
02-22-2017
04:08 PM
@Ayub Khan Application.log states the following: 2017-02-22 16:02:14,716 WARN - [pool-1-thread-5:] ~ HttpConnection@1d3946db{FILLING} (HttpConnection:277)
java.lang.IllegalStateException: s=DISPATCHED i=true a=null
at org.eclipse.jetty.server.HttpChannelState.handling(HttpChannelState.java:232)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:282)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2017-02-22 16:02:17,506 WARN - [pool-1-thread-8:] ~ HttpConnection@a0fc6a6{FILLING} (HttpConnection:277)
java.lang.IllegalStateException: s=DISPATCHED i=true a=null
at org.eclipse.jetty.server.HttpChannelState.handling(HttpChannelState.java:232)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:282)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Not sure how to fix it?
... View more
02-21-2017
04:18 PM
@Ayub Khan I got the following upon running the command: netstat -planet | grep 21000 hduser@ubuntu:~/atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT$ netstat -planet | grep 21000
(Not all processes could be identified, non-owned process info
will not be shown, you would have to be root to see it all.)
tcp 0 0 0.0.0.0:21000 0.0.0.0:* LISTEN 1001 259958 15739/java
tcp 0 0 127.0.0.1:21000 127.0.0.1:54856 TIME_WAIT 0 0 -
... View more
02-20-2017
04:54 PM
@Ayub Khan I have the following version of java on the system currently: java version "1.7.0_121"
OpenJDK Runtime Environment (IcedTea 2.6.8) (7u121-2.6.8-1ubuntu0.14.04.3)
OpenJDK 64-Bit Server VM (build 24.121-b00, mixed mode)
... View more
02-20-2017
04:31 PM
1 Kudo
I am trying to populate data from mysql to view in Atlas via Sqoop. I tried the following link: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-access/content/using_sqoop_to_move_data_into_hive.html I ran the following command: sqoop import --connect jdbc:mysql://localhost:3306/saliva --table saliva_test and it resulted in the following error: 17/02/20 16:13:39 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
17/02/20 16:13:39 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
17/02/20 16:13:39 INFO tool.CodeGenTool: Beginning code generation
Exception in thread "main" java.lang.UnsupportedClassVersionError: com/mysql/jdbc/Driver : Unsupported major.minor version 52.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:803)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:442)
at java.net.URLClassLoader.access$100(URLClassLoader.java:64)
at java.net.URLClassLoader$1.run(URLClassLoader.java:354)
at java.net.URLClassLoader$1.run(URLClassLoader.java:348)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:347)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:195)
at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:854)
at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:744)
at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:767)
at org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery(SqlManager.java:270)
at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:241)
at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:227)
at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:295)
at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1833)
at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1645)
at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:107)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
Can you kindly suggest how to fix the issue? Thanking you in anticipation.
... View more
Labels:
- Labels:
-
Apache Atlas
-
Apache Sqoop
02-20-2017
10:21 AM
@Ayub Khan When I try checking its status with the command mentioned above I am getting the following: * Hostname was NOT found in DNS cache
* Trying 127.0.0.1...
* Connected to localhost (127.0.0.1) port 21000 (#0)
> GET /api/atlas/admin/version HTTP/1.1
> User-Agent: curl/7.35.0
> Host: localhost:21000
> Accept: */*
>
* Empty reply from server
* Connection #0 to host localhost left intact
curl: (52) Empty reply from server
Trying to load quick start model is giving me the same exception as above.
... View more
02-19-2017
02:03 PM
I have installed an embedded hbase and solr installation of Atlas and when I tried to run bin/quick_start.py I am getting the following error: Creating sample types:
Exception in thread "main" com.sun.jersey.api.client.ClientHandlerException: java.net.SocketException: Connection reset
at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155)
at com.sun.jersey.api.client.filter.HTTPBasicAuthFilter.handle(HTTPBasicAuthFilter.java:105)
at com.sun.jersey.api.client.Client.handle(Client.java:652)
at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682)
at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)
at com.sun.jersey.api.client.WebResource$Builder.method(WebResource.java:634)
at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:297)
at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:287)
at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:430)
at org.apache.atlas.AtlasTypedefClientV2.createAtlasTypeDefs(AtlasTypedefClientV2.java:171)
at org.apache.atlas.examples.QuickStartV2.createTypes(QuickStartV2.java:196)
at org.apache.atlas.examples.QuickStartV2.runQuickstart(QuickStartV2.java:143)
at org.apache.atlas.examples.QuickStartV2.main(QuickStartV2.java:128)
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:197)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:690)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:633)
at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:661)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1371)
at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468)
at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253)
at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153)
... 12 more
No sample data added to Apache Atlas Server.
I am using the username and password 'admin'. Can you kindly suggest what might be going wrong? Thanking you in anticipation. @Ayub Khan any suggestions since you are my first point of contact for Atlas.
... View more
Labels:
- Labels:
-
Apache Atlas
-
Apache HBase
-
Apache Solr
02-16-2017
07:46 PM
@Ned Shawa I tried to follow the example above to import a csv file named drivers. hbase(main):001:0> hbase org.apache.hadoop.hbase.mapreduce.ImportTsv -Dimporttsv.separator=, –Dimporttsv.columns=”HBASE_ROW_KEY,driver_id,driver_name,certified,wage_plan” drivers /home/bilal/drivers.csv
SyntaxError: (hbase):1: syntax error, unexpected ','
hbase org.apache.hadoop.hbase.mapreduce.ImportTsv -Dimporttsv.separator=,
^
I am getting the following SyntaxError unexpected ','. Would you be kind enough to suggest the solution? Thanking you in anticipation.
... View more
02-16-2017
03:03 PM
@Ayub Khan any suggestions Sir?
... View more
02-16-2017
02:59 PM
I am trying to install Apache Atlas with external Hbase and Solr using the following link: http://atlas.incubator.apache.org/InstallationSteps.html When i tried installing solr, it worked fine when i start the solr using the command: solr/bin/solr start -c -z localhost:2181 -p 8983 In order to create collections I entered the following command: solr/bin/solr create -c vertex_index -d /home/atlas/incubator-atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT/solr/server/solr/configsets/basic_configs/conf -shards 1 -replicationFactor 1 but got the following issue: Specified configuration directory /home/atlas/incubator-atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT/solr/server/solr/configsets/basic_configs/conf not found! When I tried to access the above mentioned folder it did contain the configuration file, not sure why the system is issuing the error. Any help would be highly appreciated. Note: /home/atlas/incubator-atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT/solr/server/solr/configsets/basic_configs/conf contains the following files: currency.xml lang protwords.txt _rest_managed.json schema.xml solrconfig.xml stopwords.txt synonyms.txt
... View more
Labels:
- Labels:
-
Apache Atlas
-
Apache Solr
02-13-2017
08:21 PM
Thank you @Ayub Khan, I am using an embedded hbase-solr configuration of Atlas so I presume I need to set the configurations manually.
... View more
02-13-2017
07:55 PM
@anaik thank you for the response. Would you be kind enough to provide a step by step guide on how to import metadata from mySQL database to Atlas if possible?
... View more
02-13-2017
11:04 AM
@Vadim Vaks would you be kind enough to provide the implementation details for the above? Thanking you in anticipation.
... View more
02-13-2017
11:00 AM
I am a complete newbie to Apache Atlas and HBase. Need to display/browse metadata from a sample HBase table using Apache Atlas, any ideas where to begin with? I have an embedded hbase and solr installation of Apache Atlas on a VM. Any suggestions would be highly appreciated! Kind Regards
... View more
Labels:
- Labels:
-
Apache Atlas
-
Apache HBase
02-08-2017
11:24 AM
The command mentioned above is showing the correct version, so thank you so much! 🙂
... View more
02-08-2017
11:23 AM
Yes it did work and added the sample data and entities to the server! Thank you so much for the suggestions! Using username admin and password admin did work! 🙂
... View more
02-08-2017
11:17 AM
Also when I try to run the following command curl -v <a href="http://localhost:21000/api/atlas/admin/version">http://localhost:21000/api/atlas/admin/version</a> to check that the server is running and its version it is giving me the following error: * Hostname was NOT found in DNS cache * Trying 127.0.0.1... * Connected to localhost (127.0.0.1) port 21000 (#0) > GET /api/atlas/admin/version HTTP/1.1 > User-Agent: curl/7.35.0 > Host: localhost:21000 > Accept: */* > < HTTP/1.1 401 Full authentication is required to access this resource < Date: Wed, 08 Feb 2017 11:14:58 GMT
< Set-Cookie: ATLASSESSIONID=154eke7lzmtrf1vhnfhxd5ivml;Path=/;HttpOnly < X-Frame-Options: DENY < WWW-Authenticate: Basic realm="atlas.com"
< Content-Type: text/html; charset=ISO-8859-1 < Cache-Control: must-revalidate,no-cache,no-store
< Content-Length: 399
* Server Jetty(9.2.12.v20150709) is not blacklisted < Server: Jetty(9.2.12.v20150709) < <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/> <title>Error 401 Full authentication is required to access this resource</title> </head> <body><h2>HTTP ERROR 401</h2> <p>Problem accessing /api/atlas/admin/version. Reason: <pre> Full authentication is required to access this resource</pre></p><hr><i><small>Powered by Jetty://</small></i><hr/> </body> </html> * Connection #0 to host localhost left intact
... View more
02-08-2017
11:09 AM
I am following the tutorial: http://atlas.incubator.apache.org/InstallationSteps.html for installing an embedded hbase and solr configuration for atlas. I have built and installed as the steps suggest in the tutorial above and when I start the server using command bin/atlas-start.py I get the following: hduser@ubuntu:~/atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT$ bin/atlas_start.py configured for local hbase. hbase started. configured for local solr. solr started.
setting up solr collections... Apache Atlas Server started!!! When I try to run the command bin/quick_start.py to add sample model and data I am getting the following error: hduser@ubuntu:~/atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT$ bin/quick_start.py Enter username for atlas :-
bilal Enter password for atlas :-
bilal Creating sample types: Exception in thread "main" org.apache.atlas.AtlasServiceException: Metadata service API org.apache.atlas.AtlasBaseClient$APIInfo@35612e7c failed with status 401 (Unauthorized) Response Body (<html> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/>
<title>Error 401 Username not found.bilal</title> </head> <body><h2>HTTP ERROR 401</h2> <p>Problem accessing /api/atlas/v2/types/typedefs/. Reason: <pre> Username not found.bilal</pre></p><hr><i><small>Powered by Jetty://</small></i><hr/> </body> </html> ) at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:327)
at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:419)
at org.apache.atlas.AtlasTypedefClientV2.createAtlasTypeDefs(AtlasTypedefClientV2.java:147)
at org.apache.atlas.examples.QuickStartV2.createTypes(QuickStartV2.java:206)
at org.apache.atlas.examples.QuickStartV2.runQuickstart(QuickStartV2.java:153)
at org.apache.atlas.examples.QuickStartV2.main(QuickStartV2.java:138) No sample data added to Apache Atlas Server. Can anyone kindly suggest what is the way around? Any help will be highly appreciated! Kindly find the logs here: atlas-logs-exception-in-main-thread.txt
... View more
Labels:
- Labels:
-
Apache Atlas