Created 03-10-2016 08:55 PM
Just tried out HDP 2.3.2 Sandbox, my Hive query fails when Atlas service is down. If I want to enable Hive Plugin on Ranger, will Ambari install Atlas automatically? Is there any dependency btw these two components?
Created 03-10-2016 09:05 PM
Ambari will only install Atlas if you select during install (UI install wizard) or if you are using blueprints, you explicitly declare that Atlas should be installed. Ranger does not have a dependency on Atlas.
As for the Hive query that is failing, in HDP 2.3x, Atlas is required to be running in order for the Hive post execution hook for Atlas to fire properly since it is using a REST API to propagate the metadata. This limitation is being addressed by introducing a messaging layer which decouples Atlas from Hive such that the state of the Atlas process does not affect the execution of Hive queries.
Created 03-10-2016 09:05 PM
Ambari will only install Atlas if you select during install (UI install wizard) or if you are using blueprints, you explicitly declare that Atlas should be installed. Ranger does not have a dependency on Atlas.
As for the Hive query that is failing, in HDP 2.3x, Atlas is required to be running in order for the Hive post execution hook for Atlas to fire properly since it is using a REST API to propagate the metadata. This limitation is being addressed by introducing a messaging layer which decouples Atlas from Hive such that the state of the Atlas process does not affect the execution of Hive queries.
Created 03-15-2016 02:36 AM
Thanks. Well said.