Member since
10-17-2016
93
Posts
10
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
5002 | 09-28-2017 04:38 PM | |
7465 | 08-24-2017 06:12 PM | |
1934 | 07-03-2017 12:20 PM |
08-12-2017
06:54 PM
@anaik @Ashutosh Mestry i checked and zookeeper is running and accepting connections. Attached is the log file:atlas20170812-204645.txt I am unable to proceed. Kindly help
... View more
08-11-2017
06:13 PM
@Hitesh Rajpurohit try: wget https://github.com/hortonworks/data-tutorials/blob/archive-hdp-2.5/tutorials/hdp/hdp-2.5/cross-component-lineage-with-apache-atlas-across-apache-sqoop-hive-kafka-storm/assets/crosscomponent_scripts.zip?raw=true
... View more
08-08-2017
07:58 AM
Thanks! that fixed it. i had to change the hostname in the file. now it works!
... View more
08-08-2017
07:05 AM
Hi I have installed HDF 3.0 on windows 7. I want to connect to the Vm via the browser (WEB SHELL CLIENT). But when i try to login to the sandbox i get the following error: ssh: Could not resolve hostname sandbox.hortonworks.com: Name or service not known I see it tries to look for the hostname: sandbox.hortonwoks.com, however the sandbox name in case of HDF is : sandbox-hdf.hortonworks.com. I have added this host name in windows/sys32/hosts file. Is there a setting where I need to make this change to make shell in a box work? How can I configure "shell in a box" to look for the correct hostname. Thanks
... View more
Labels:
- Labels:
-
Cloudera DataFlow (CDF)
08-02-2017
07:50 AM
@anaik i am running atlas on Ubuntu 16.4.... i followed the instructions on the following link: http://atlas.apache.org/InstallationSteps.html
... View more
07-28-2017
08:18 AM
Hi I am not using HDP. I built and installed apache atlas using the following link Atlas Installation. When I start Atlas using the atlas_start.py script the web UI gives the 503 error. I have checked the logs which are as follows: 2017-07-18 21:03:27,477 WARN - [main:] ~ Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.context.event.internalEventListenerProcessor': BeanPostProcessor before instantiation of bean failed; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'graphTransactionAdvisor' defined in URL [jar:file:/home/arsalan/atlas/distro/target/apache-atlas-0.9-incubating-SNAPSHOT-bin/apache-atlas-0.9-incubating-SNAPSHOT/server/webapp/atlas/WEB-INF/lib/atlas-repository-0.9-incubating-SNAPSHOT.jar!/org/apache/atlas/GraphTransactionAdvisor.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'graphTransactionInterceptor' defined in URL [jar:file:/home/arsalan/atlas/distro/target/apache-atlas-0.9-incubating-SNAPSHOT-bin/apache-atlas-0.9-incubating-SNAPSHOT/server/webapp/atlas/WEB-INF/lib/atlas-repository-0.9-incubating-SNAPSHOT.jar!/org/apache/atlas/GraphTransactionInterceptor.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'get' defined in org.apache.atlas.repository.graph.AtlasGraphProvider: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.atlas.repository.graphdb.AtlasGraph]: Factory method 'get' threw exception; nested exception is com.thinkaurelius.titan.core.TitanException: Could not open global configuration (AbstractApplicationContext:550)
2017-07-18 21:03:27,478 ERROR - [main:] ~ Context initialization failed (ContextLoader:350)
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.context.event.internalEventListenerProcessor': BeanPostProcessor before instantiation of bean failed; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'graphTransactionAdvisor' defined in URL [jar:file:/home/arsalan/atlas/distro/target/apache-atlas-0.9-incubating-SNAPSHOT-bin/apache-atlas-0.9-incubating-SNAPSHOT/server/webapp/atlas/WEB-INF/lib/atlas-repository-0.9-incubating-SNAPSHOT.jar!/org/apache/atlas/GraphTransactionAdvisor.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'graphTransactionInterceptor' defined in URL [jar:file:/home/arsalan/atlas/distro/target/apache-atlas-0.9-incubating-SNAPSHOT-bin/apache-atlas-0.9-incubating-SNAPSHOT/server/webapp/atlas/WEB-INF/lib/atlas-repository-0.9-incubating-SNAPSHOT.jar!/org/apache/atlas/GraphTransactionInterceptor.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'get' defined in org.apache.atlas.repository.graph.AtlasGraphProvider: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.atlas.repository.graphdb.AtlasGraph]: Factory method 'get' threw exception; nested exception is com.thinkaurelius.titan.core.TitanException: Could not open global configuration
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:479)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:761)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:866)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:542)
at org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:443)
at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:325)
at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:107)
at org.apache.atlas.web.setup.KerberosAwareListener.contextInitialized(KerberosAwareListener.java:31)
at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:800)
at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:444)
at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:791)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:294)
at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1349)
at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1342)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:741)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:505)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:132)
at org.eclipse.jetty.server.Server.start(Server.java:387)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:114)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
at org.eclipse.jetty.server.Server.doStart(Server.java:354)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:95)
at org.apache.atlas.Atlas.main(Atlas.java:118)
Application logs: ########################################################################################
Atlas Server (STARTUP)
project.name: apache-atlas
project.description: Metadata Management and Data Governance Platform over Hadoop
build.user: arsalan
build.epoch: 1500400082909
project.version: 0.9-incubating-SNAPSHOT
build.version: 0.9-incubating-SNAPSHOT-r377fe19f023a4036f9fa1503dec6ea698fdb214b
vc.revision: 377fe19f023a4036f9fa1503dec6ea698fdb214b
vc.source.url: scm:git:git://git.apache.org/incubator-atlas.git/atlas-webapp
######################################################################################## (Atlas:185)
2017-07-18 21:31:08,525 INFO - [main:] ~ >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> (Atlas:186)
2017-07-18 21:31:08,525 INFO - [main:] ~ Server starting with TLS ? false on port 21000 (Atlas:187)
2017-07-18 21:31:08,525 INFO - [main:] ~ <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< (Atlas:188)
2017-07-18 21:31:13,670 INFO - [main:] ~ No authentication method configured. Defaulting to simple authentication (LoginProcessor:102)
2017-07-18 21:31:13,767 INFO - [main:] ~ Logged in user root (auth:SIMPLE) (LoginProcessor:77)
2017-07-18 21:31:14,320 INFO - [main:] ~ Not running setup per configuration atlas.server.run.setup.on.start. (SetupSteps$SetupRequired:189)
2017-07-18 21:31:14,936 INFO - [main:] ~ Instantiated HBase compatibility layer supporting runtime HBase version 1.1.2: com.thinkaurelius.titan.diskstorage.hbase.HBaseCompat1_1 (HBaseCompatLoader:69)
2017-07-18 21:31:14,962 INFO - [main:] ~ Copied host list from root.storage.hostname to hbase.zookeeper.quorum: localhost (HBaseStoreManager:320)
2017-07-18 21:31:15,045 WARN - [main-SendThread(localhost:2181):] ~ Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2017-07-18 21:31:15,151 WARN - [main:] ~ Possibly transient ZooKeeper, quorum=localhost:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid (RecoverableZooKeeper:275)
2017-07-18 21:31:16,149 WARN - [main-SendThread(localhost:2181):] ~ Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (ClientCnxn$SendThread:1102)
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
2017-07-18 21:31:16,250 WARN - [main:] ~ Possibly transient ZooKeeper, quorum=localhost:2181, exception=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid (RecoverableZooKeeper:275)
Any suggestions how to resolve this issue? Thanks
... View more
Labels:
- Labels:
-
Apache Atlas
07-23-2017
04:13 PM
@Ashutosh Mestry thanks for the instant reply. I will look into the links you have shared. is there any guide on how to run this tutorial and some explanation ? All I get from the page is to run the script and it will set up the metadata information. I guess in HDP it is located under '/usr/hdp/current/atlas-server/bin/quick_start.py'. I did load the data and it is visible in Atlas. Is there any explaination for the example
... View more
07-23-2017
02:51 PM
Hi I want to learn Atlas and then finally have a system (Spark) export meta data information to Atlas (including lineage). I have downloaded HDP 2.6. I tried to follow the Cross Component Lineage tutorial. Unfortunately the download link in 3.2 in the tutorial does not work anymore. Also the directory and scripts in section 4.1 do not exist anymore. Can anyone help me on how to get started with Atlas and the things I should have a look into to be able to import metadata information from Spark into Atlas. Would I need to modify atlas in any way or it would be more of defining entities in Atlas. Thankyou
... View more
Labels:
- Labels:
-
Apache Atlas
07-23-2017
01:18 PM
@Eyad Garelnabi https://hortonworks.com/hadoop-tutorial/cross-component-lineage-apache-atlas/ Also I am using HDP 2.6. i think the directory in 4.1 is no longer there
... View more