Apache atlas data lineage issue

[#1]

Hi,

I'm implementing apache atlas with Apache nifi.. I'm facing problem to show the data lineage on the apache atlas..

Getting this into the log:

2018-08-16 12:00:38,787 INFO - [pool-1-thread-7 - 1fca4338-774c-4ab2-892d-df52a8d99c5d:] ~ GraphTransaction intercept for org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1.getByUniqueAttributes (GraphTransactionAdvisor$1:41)

2018-08-16 12:00:38,893 ERROR - [pool-1-thread-7 - 1fca4338-774c-4ab2-892d-df52a8d99c5d:] ~ graph rollback due to exception AtlasBaseException:Instance __AtlasUserProfile with unique attribute {name=admin} does not exist (GraphTransactionInterceptor:73)

Kindly help.

[#2]

@Naveen Nain

As per the description, it seems that you are trying you configure Nifi Atlas Integration and you have given the User name as Admin in the nifi configs which does not seems to be present in the Atlas.

So, could you please check are you able to login into Atlas UI using the username and password mentioned in the nifi configs.

For more info you may refer to -- https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.2/bk_installing-hdf-and-hdp/content/nifi-atla...

[#3]

@Ronak bansal

We are using HDP-2.6.5.0 and Ambari-2.6.2.0, Atlas-0.8.0

We are getting below error while running import-hive.sh script.

root@hn:/var/log/atlas# tail -f application.log
2018-12-10 04:50:06,783 ERROR - [pool-2-thread-7 - d35c5859-a93e-40ce-94ff-5c12e45f2880:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.dim_awood@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:07,100 ERROR - [pool-2-thread-7 - 0b130511-ed2a-4434-95ad-692b0babf348:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.dim_type2@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:07,431 ERROR - [pool-2-thread-7 - fbf49dd4-12fd-4ff1-bdf7-d69187ead26c:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.dim_type2_new@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:07,826 ERROR - [pool-2-thread-7 - 1041077f-a6cf-4b24-8669-d84d88155d82:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.type2@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:08,056 ERROR - [pool-2-thread-9 - ce6d8709-db1a-458e-8cfb-4d1ccbb28ca6:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.type2_cdc@C03} does not exist (GraphTransactionInterceptor:73)
2018-12-10 04:50:08,332 ERROR - [pool-2-thread-7 - 1757d3a0-4562-4c9b-bf1b-526cd34b2c05:] ~ graph rollback due to exception AtlasBaseException:Instance hive_table with unique attribute {qualifiedName=work.type2_current@C03} does not exist (GraphTransactionInterceptor:73)

In Atlas we are able to see External tables linage but not for Managed and Virtual Views tables.

Could you please let me why we are getting this error. Can we see linage for Managed and Virtual view tables?

Thanks,

Owez

[#4]

same issue,help please

Caused by: java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.atlas.catalog.VertexWrapper                                         
        at org.apache.atlas.catalog.query.BaseQueryExpression.evaluate(BaseQueryExpression.java:52)                                                        
        at org.apache.atlas.catalog.query.BaseQueryExpression$1.compute(BaseQueryExpression.java:71)                                                       
        at org.apache.atlas.catalog.query.BaseQueryExpression$1.compute(BaseQueryExpression.java:68)                                                       
        at com.tinkerpop.pipes.filter.FilterFunctionPipe.processNextStart(FilterFunctionPipe.java:24)                                                      
        at com.tinkerpop.pipes.AbstractPipe.hasNext(AbstractPipe.java:98)                                                                                  
        at com.tinkerpop.pipes.util.Pipeline.hasNext(Pipeline.java:105)                                                                                    
        at com.tinkerpop.pipes.filter.BackFilterPipe.processNextStart(BackFilterPipe.java:33)                                                              
        at com.tinkerpop.pipes.AbstractPipe.next(AbstractPipe.java:89)                                                                                     
        at com.tinkerpop.pipes.util.Pipeline.next(Pipeline.java:115)                                                                                       
        at com.tinkerpop.pipes.util.PipeHelper.fillCollection(PipeHelper.java:52)                                                                          
        at com.tinkerpop.gremlin.java.GremlinPipeline.toList(GremlinPipeline.java:1564)                                                                    
        at org.apache.atlas.catalog.query.BaseQuery.executeQuery(BaseQuery.java:106)                                                                       
        at org.apache.atlas.catalog.query.BaseQuery.execute(BaseQuery.java:67)                                                                             
        at org.apache.atlas.catalog.TaxonomyResourceProvider.doGetResources(TaxonomyResourceProvider.java:163)                                             
        at org.apache.atlas.catalog.TaxonomyResourceProvider.getResources(TaxonomyResourceProvider.java:75)                                                
        at org.apache.atlas.web.resources.BaseService.getResources(BaseService.java:66)                                                                    
        ... 89 more                                                                                                                                        
2019-01-15 16:58:34,818 INFO  - [pool-2-thread-10 - ba8dd7bd-2d8a-4401-9f73-a33bef04b1a0:] ~ LuceneQuery: hierarchy__slash__path:__slash__ (QueryFactory:98
)                                                                                                                                                          
2019-01-15 16:58:34,841 ERROR - [pool-2-thread-8 - 5366fbbb-e72a-497d-9bc6-07c358e3576f:] ~ graph rollback due to exception AtlasBaseException:Instance __A 

tlasUserProfile with unique attribute {name=admin} does not exist (GraphTransactionInterceptor:73)