About muja_owez

muja_owez · ‎03-06-2019

Hi Team, We have found the solution. it was not related to Atlas. Issue was user limit. Recently increase in HDFS data causes more processing at jobs level. Current Hiveserver2 thread count was not sufficient to handle these increased amount of processing. This causes thread creation error for Hive service as shown below: Caused by: java.lang.OutOfMemoryError: unable to create new native thread at java.lang.Thread.start0(Native Method) at java.lang.Thread.start(Thread.java:717) After stopping Atlas service also we were getting same error. To resolve this error, we have increased thread creation capacity of Hive service by increasing value of 'hive_user_nproc_limit' parameter for hive user. Increased in HDFS data might be an coincidence with addition of Atlas service. Regards, Owez Mujawar

ssainath · ‎01-07-2019

@Owez Mujawar Could you run kafka console consumer on topic ATLAS_HOOK and ATLAS_ENTITIES when you create a table and check if the messages are flowing to the topic ?

muja_owez · ‎12-05-2018

@Arshadullah Khan Thanks for the suggestion issue got resolved. Downloaded and Copied jar to /usr/hdp/current/atlas-server/hook/hive/atlas-hive-plugin-impl and issue got resolved after running import-hive.sh script. Now we are able to see Hive_db and Hive_tables in Atlas Web UI. Thanks & regards, Owez

muja_owez · ‎12-03-2018

@Sarath Subramanian now i am able publish a sample message to ATLAS_ENTITIES. Resolution: Deleted the older Atlas_entities and created a new one. Thanks for the help. Regards, Owez Mujawar

pacosoplas · ‎01-15-2019

same issue,help please Caused by: java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.atlas.catalog.VertexWrapper at org.apache.atlas.catalog.query.BaseQueryExpression.evaluate(BaseQueryExpression.java:52) at org.apache.atlas.catalog.query.BaseQueryExpression$1.compute(BaseQueryExpression.java:71) at org.apache.atlas.catalog.query.BaseQueryExpression$1.compute(BaseQueryExpression.java:68) at com.tinkerpop.pipes.filter.FilterFunctionPipe.processNextStart(FilterFunctionPipe.java:24) at com.tinkerpop.pipes.AbstractPipe.hasNext(AbstractPipe.java:98) at com.tinkerpop.pipes.util.Pipeline.hasNext(Pipeline.java:105) at com.tinkerpop.pipes.filter.BackFilterPipe.processNextStart(BackFilterPipe.java:33) at com.tinkerpop.pipes.AbstractPipe.next(AbstractPipe.java:89) at com.tinkerpop.pipes.util.Pipeline.next(Pipeline.java:115) at com.tinkerpop.pipes.util.PipeHelper.fillCollection(PipeHelper.java:52) at com.tinkerpop.gremlin.java.GremlinPipeline.toList(GremlinPipeline.java:1564) at org.apache.atlas.catalog.query.BaseQuery.executeQuery(BaseQuery.java:106) at org.apache.atlas.catalog.query.BaseQuery.execute(BaseQuery.java:67) at org.apache.atlas.catalog.TaxonomyResourceProvider.doGetResources(TaxonomyResourceProvider.java:163) at org.apache.atlas.catalog.TaxonomyResourceProvider.getResources(TaxonomyResourceProvider.java:75) at org.apache.atlas.web.resources.BaseService.getResources(BaseService.java:66) ... 89 more 2019-01-15 16:58:34,818 INFO - [pool-2-thread-10 - ba8dd7bd-2d8a-4401-9f73-a33bef04b1a0:] ~ LuceneQuery: hierarchy__slash__path:__slash__ (QueryFactory:98 ) 2019-01-15 16:58:34,841 ERROR - [pool-2-thread-8 - 5366fbbb-e72a-497d-9bc6-07c358e3576f:] ~ graph rollback due to exception AtlasBaseException:Instance __A tlasUserProfile with unique attribute {name=admin} does not exist (GraphTransactionInterceptor:73)

Online	Offline
Last Visited	‎03-29-2019 05:29 AM

Member Since	‎08-28-2017 07:19 AM
Last Visited	‎03-29-2019 05:29 AM
Posts	26

Cloudera Community

Re: Connections to hiveserver hanging

Re: Unable to Create entity in Atlas

Re: Connections to hiveserver hanging

Re: Lineage is not visible for Hive Table in Atlas

Re: Issue while running import-hive.sh script

Re: Unable to Create entity in Atlas

Re: Apache atlas data lineage issue