Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Atlas hive import script (import_hive.sh) is failing

Solved Go to solution
Highlighted

Atlas hive import script (import_hive.sh) is failing

Rising Star

This is a kerberized cluster on HDP 2.6.1

import_hive.sh is failing with the errors as below

2017-09-21 10:38:53,105 ERROR - [pool-2-thread-10 - f15b1a2e-6904-49bb-8ed5-b832632d4339:atlas:POST/api/atlas/entities/bedf80dd-deb1-42a9-81cc-40336a3d4546] ~ Unable to update entity by GUID bedf80dd-deb1-42a9-81cc-40336a3d4546 {  "jsonClass":"org.apache.atlas.typesystem.json.InstanceSerialization$_Reference",  "id":{    "jsonClass":"org.apache.atlas.typesystem.json.InstanceSerialization$_Id",    "id":"bedf80dd-deb1-42a9-81cc-40336a3d4546",    "version":0,    "typeName":"hive_db",    "state":"ACTIVE"  },  "typeName":"hive_db",  "values":{    "name":"default",    "location":"hdfs://CLUSTERNAME/apps/hive/warehouse",
Using Hive configuration directory [/etc/hive/conf]Log file for import is /usr/hdp/current/atlas-server/logs/import-hive.logException in thread "main" org.apache.atlas.hook.AtlasHookException: HiveMetaStoreBridge.main() failed.        at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:650)Caused by: org.apache.atlas.AtlasServiceException: Metadata service API org.apache.atlas.AtlasBaseClient$APIInfo@69c6161d failed with status 500 (Internal Server Error) Response Body ({"error":"Failed to notify for change PARTIAL_UPDATE"})        at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:337)        at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:287)        at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:429)        at org.apache.atlas.AtlasClient.callAPIWithBodyAndParams(AtlasClient.java:1006)        at org.apache.atlas.AtlasClient.updateEntity(AtlasClient.java:583)       at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.updateInstance(HiveMetaStoreBridge.java:526)        at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.registerDatabase(HiveMetaStoreBridge.java:175)        at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importDatabases(HiveMetaStoreBridge.java:140)        at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importHiveMetadata(HiveMetaStoreBridge.java:134)        at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:647)Failed to import Hive Data Model!!!
1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Atlas hive import script (import_hive.sh) is failing

Rising Star

Deleting the kafka topics for atlas and restart of atlas fixed the issue.

View solution in original post

2 REPLIES 2

Re: Atlas hive import script (import_hive.sh) is failing

Rising Star

@Yogeshprabhu Can you share the logs from atlas server too (application.log) ? Looks like Atlas is not able to post to ATLAS_ENTITIES topic (outgoing notification).

Highlighted

Re: Atlas hive import script (import_hive.sh) is failing

Rising Star

Deleting the kafka topics for atlas and restart of atlas fixed the issue.

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here