Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Apache atlas data lineage issue

Apache atlas data lineage issue

New Contributor

Hi,

I'm implementing apache atlas with Apache nifi.. I'm facing problem to show the data lineage on the apache atlas..

Getting this into the log:

2018-08-16 12:00:38,787 INFO - [pool-1-thread-7 - 1fca4338-774c-4ab2-892d-df52a8d99c5d:] ~ GraphTransaction intercept for org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1.getByUniqueAttributes (GraphTransactionAdvisor$1:41)


2018-08-16 12:00:38,893 ERROR - [pool-1-thread-7 - 1fca4338-774c-4ab2-892d-df52a8d99c5d:] ~ graph rollback due to exception AtlasBaseException:Instance __AtlasUserProfile with unique attribute {name=admin} does not exist (GraphTransactionInterceptor:73)

Kindly help.

3 REPLIES 3

Re: Apache atlas data lineage issue

New Contributor
@Naveen Nain

As per the description, it seems that you are trying you configure Nifi Atlas Integration and you have given the User name as Admin in the nifi configs which does not seems to be present in the Atlas.

So, could you please check are you able to login into Atlas UI using the username and password mentioned in the nifi configs.

For more info you may refer to -- https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.2/bk_installing-hdf-and-hdp/content/nifi-atla...

Highlighted

Re: Apache atlas data lineage issue

New Contributor

@Ronak bansal

We are using HDP-2.6.5.0 and Ambari-2.6.2.0, Atlas-0.8.0

We are getting below error while running import-hive.sh script.

root@hn:/var/log/atlas# tail -f application.log
2018-12-10 04:50:06,783 ERROR - [pool-2-thread-7 - d35c5859-a93e-40ce-94ff-5c12e45f2880:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.dim_awood@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:07,100 ERROR - [pool-2-thread-7 - 0b130511-ed2a-4434-95ad-692b0babf348:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.dim_type2@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:07,431 ERROR - [pool-2-thread-7 - fbf49dd4-12fd-4ff1-bdf7-d69187ead26c:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.dim_type2_new@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:07,826 ERROR - [pool-2-thread-7 - 1041077f-a6cf-4b24-8669-d84d88155d82:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.type2@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:08,056 ERROR - [pool-2-thread-9 - ce6d8709-db1a-458e-8cfb-4d1ccbb28ca6:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.type2_cdc@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:08,332 ERROR - [pool-2-thread-7 - 1757d3a0-4562-4c9b-bf1b-526cd34b2c05:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.type2_current@C03} does not exist (GraphTransactionInterceptor:73)

In Atlas we are able to see External tables linage but not for Managed and Virtual Views tables.

Could you please let me why we are getting this error. Can we see linage for Managed and Virtual view tables?

Thanks,

Owez

Re: Apache atlas data lineage issue

Super Collaborator

same issue,help please

Caused by: java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.atlas.catalog.VertexWrapper                                         
        at org.apache.atlas.catalog.query.BaseQueryExpression.evaluate(BaseQueryExpression.java:52)                                                        
        at org.apache.atlas.catalog.query.BaseQueryExpression$1.compute(BaseQueryExpression.java:71)                                                       
        at org.apache.atlas.catalog.query.BaseQueryExpression$1.compute(BaseQueryExpression.java:68)                                                       
        at com.tinkerpop.pipes.filter.FilterFunctionPipe.processNextStart(FilterFunctionPipe.java:24)                                                      
        at com.tinkerpop.pipes.AbstractPipe.hasNext(AbstractPipe.java:98)                                                                                  
        at com.tinkerpop.pipes.util.Pipeline.hasNext(Pipeline.java:105)                                                                                    
        at com.tinkerpop.pipes.filter.BackFilterPipe.processNextStart(BackFilterPipe.java:33)                                                              
        at com.tinkerpop.pipes.AbstractPipe.next(AbstractPipe.java:89)                                                                                     
        at com.tinkerpop.pipes.util.Pipeline.next(Pipeline.java:115)                                                                                       
        at com.tinkerpop.pipes.util.PipeHelper.fillCollection(PipeHelper.java:52)                                                                          
        at com.tinkerpop.gremlin.java.GremlinPipeline.toList(GremlinPipeline.java:1564)                                                                    
        at org.apache.atlas.catalog.query.BaseQuery.executeQuery(BaseQuery.java:106)                                                                       
        at org.apache.atlas.catalog.query.BaseQuery.execute(BaseQuery.java:67)                                                                             
        at org.apache.atlas.catalog.TaxonomyResourceProvider.doGetResources(TaxonomyResourceProvider.java:163)                                             
        at org.apache.atlas.catalog.TaxonomyResourceProvider.getResources(TaxonomyResourceProvider.java:75)                                                
        at org.apache.atlas.web.resources.BaseService.getResources(BaseService.java:66)                                                                    
        ... 89 more                                                                                                                                        
2019-01-15 16:58:34,818 INFO  - [pool-2-thread-10 - ba8dd7bd-2d8a-4401-9f73-a33bef04b1a0:] ~ LuceneQuery: hierarchy__slash__path:__slash__ (QueryFactory:98
)                                                                                                                                                          
2019-01-15 16:58:34,841 ERROR - [pool-2-thread-8 - 5366fbbb-e72a-497d-9bc6-07c358e3576f:] ~ graph rollback due to exception AtlasBaseException:Instance __A 

tlasUserProfile with unique attribute {name=admin} does not exist (GraphTransactionInterceptor:73)