Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Apache atlas data lineage issue

avatar
New Contributor

Hi,

I'm implementing apache atlas with Apache nifi.. I'm facing problem to show the data lineage on the apache atlas..

Getting this into the log:

2018-08-16 12:00:38,787 INFO - [pool-1-thread-7 - 1fca4338-774c-4ab2-892d-df52a8d99c5d:] ~ GraphTransaction intercept for org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1.getByUniqueAttributes (GraphTransactionAdvisor$1:41)


2018-08-16 12:00:38,893 ERROR - [pool-1-thread-7 - 1fca4338-774c-4ab2-892d-df52a8d99c5d:] ~ graph rollback due to exception AtlasBaseException:Instance __AtlasUserProfile with unique attribute {name=admin} does not exist (GraphTransactionInterceptor:73)

Kindly help.

3 REPLIES 3

avatar
Rising Star
@Naveen Nain

As per the description, it seems that you are trying you configure Nifi Atlas Integration and you have given the User name as Admin in the nifi configs which does not seems to be present in the Atlas.

So, could you please check are you able to login into Atlas UI using the username and password mentioned in the nifi configs.

For more info you may refer to -- https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.2/bk_installing-hdf-and-hdp/content/nifi-atla...

avatar
Explorer

@Ronak bansal

We are using HDP-2.6.5.0 and Ambari-2.6.2.0, Atlas-0.8.0

We are getting below error while running import-hive.sh script.

root@hn:/var/log/atlas# tail -f application.log
2018-12-10 04:50:06,783 ERROR - [pool-2-thread-7 - d35c5859-a93e-40ce-94ff-5c12e45f2880:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.dim_awood@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:07,100 ERROR - [pool-2-thread-7 - 0b130511-ed2a-4434-95ad-692b0babf348:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.dim_type2@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:07,431 ERROR - [pool-2-thread-7 - fbf49dd4-12fd-4ff1-bdf7-d69187ead26c:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.dim_type2_new@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:07,826 ERROR - [pool-2-thread-7 - 1041077f-a6cf-4b24-8669-d84d88155d82:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.type2@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:08,056 ERROR - [pool-2-thread-9 - ce6d8709-db1a-458e-8cfb-4d1ccbb28ca6:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.type2_cdc@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:08,332 ERROR - [pool-2-thread-7 - 1757d3a0-4562-4c9b-bf1b-526cd34b2c05:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.type2_current@C03} does not exist (GraphTransactionInterceptor:73)

In Atlas we are able to see External tables linage but not for Managed and Virtual Views tables.

Could you please let me why we are getting this error. Can we see linage for Managed and Virtual view tables?

Thanks,

Owez

avatar
Master Collaborator

same issue,help please

Caused by: java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.atlas.catalog.VertexWrapper                                         
        at org.apache.atlas.catalog.query.BaseQueryExpression.evaluate(BaseQueryExpression.java:52)                                                        
        at org.apache.atlas.catalog.query.BaseQueryExpression$1.compute(BaseQueryExpression.java:71)                                                       
        at org.apache.atlas.catalog.query.BaseQueryExpression$1.compute(BaseQueryExpression.java:68)                                                       
        at com.tinkerpop.pipes.filter.FilterFunctionPipe.processNextStart(FilterFunctionPipe.java:24)                                                      
        at com.tinkerpop.pipes.AbstractPipe.hasNext(AbstractPipe.java:98)                                                                                  
        at com.tinkerpop.pipes.util.Pipeline.hasNext(Pipeline.java:105)                                                                                    
        at com.tinkerpop.pipes.filter.BackFilterPipe.processNextStart(BackFilterPipe.java:33)                                                              
        at com.tinkerpop.pipes.AbstractPipe.next(AbstractPipe.java:89)                                                                                     
        at com.tinkerpop.pipes.util.Pipeline.next(Pipeline.java:115)                                                                                       
        at com.tinkerpop.pipes.util.PipeHelper.fillCollection(PipeHelper.java:52)                                                                          
        at com.tinkerpop.gremlin.java.GremlinPipeline.toList(GremlinPipeline.java:1564)                                                                    
        at org.apache.atlas.catalog.query.BaseQuery.executeQuery(BaseQuery.java:106)                                                                       
        at org.apache.atlas.catalog.query.BaseQuery.execute(BaseQuery.java:67)                                                                             
        at org.apache.atlas.catalog.TaxonomyResourceProvider.doGetResources(TaxonomyResourceProvider.java:163)                                             
        at org.apache.atlas.catalog.TaxonomyResourceProvider.getResources(TaxonomyResourceProvider.java:75)                                                
        at org.apache.atlas.web.resources.BaseService.getResources(BaseService.java:66)                                                                    
        ... 89 more                                                                                                                                        
2019-01-15 16:58:34,818 INFO  - [pool-2-thread-10 - ba8dd7bd-2d8a-4401-9f73-a33bef04b1a0:] ~ LuceneQuery: hierarchy__slash__path:__slash__ (QueryFactory:98
)                                                                                                                                                          
2019-01-15 16:58:34,841 ERROR - [pool-2-thread-8 - 5366fbbb-e72a-497d-9bc6-07c358e3576f:] ~ graph rollback due to exception AtlasBaseException:Instance __A 

tlasUserProfile with unique attribute {name=admin} does not exist (GraphTransactionInterceptor:73)