I want to deploy a cluster with Atlas and all required components.
I used a cluster creation template with the below blueprint. Before doing so I looked through the HDP 2.5 component dependencies. For example Atlas is at https://github.com/apache/ambari/blob/branch-2.5/ambari-server/src/main/resources/common-services/ATLAS/0.7.0.2.5/metainfo.xml . After deploying, component start for one host fails at Atlas Metadata Server:
resource_management.core.exceptions.Fail: Execution of 'source /etc/atlas/conf/atlas-env.sh ; /usr/hdp/current/atlas-server/bin/atlas_start.py' returned 255. Exception: ('Could not find hbase-site.xml in %s. Please set env var HBASE_CONF_DIR to the hbase client conf dir', '/etc/hbase/conf')
Traceback (most recent call last):
File "/usr/hdp/current/atlas-server/bin/atlas_start.py", line 150, in <module>
returncode = main()
File "/usr/hdp/current/atlas-server/bin/atlas_start.py", line 93, in main
raise Exception("Could not find hbase-site.xml in %s. Please set env var HBASE_CONF_DIR to the hbase client conf dir", hbase_conf_dir)
Exception: ('Could not find hbase-site.xml in %s. Please set env var HBASE_CONF_DIR to the hbase client conf dir', '/etc/hbase/conf') Is this simply a bug that HBase isn't included in the list of required components for Atlas, or is there some other configuration problem?
Here's the blueprint. I enable kerberos in the cluster creation template. The blueprint has a few configurations required for OneFS integration when Kerberized:
{
"Blueprints" : {
"stack_name" : "HDP",
"stack_version" : "2.5"
},
"host_groups" : [
{
"name" : "onefs_group",
"components" : [
{"name" : "NAMENODE"},
{"name" : "SECONDARY_NAMENODE"},
{"name" : "DATANODE"},
{"name" : "METRICS_MONITOR"}
],
"cardinality" : "1"
},
{
"name" : "master_group",
"components" : [
{"name" : "APP_TIMELINE_SERVER"},
{"name" : "ATLAS_SERVER"},
{"name" : "HISTORYSERVER"},
{"name" : "HIVE_METASTORE"},
{"name" : "HIVE_SERVER"},
{"name" : "INFRA_SOLR"},
{"name" : "METRICS_COLLECTOR"},
{"name" : "RESOURCEMANAGER"},
{"name" : "WEBHCAT_SERVER"},
{"name" : "ATLAS_CLIENT"},
{"name" : "HCAT"},
{"name" : "HDFS_CLIENT"},
{"name" : "HIVE_CLIENT"},
{"name" : "INFRA_SOLR_CLIENT"},
{"name" : "KAFKA_BROKER"},
{"name" : "MAPREDUCE2_CLIENT"},
{"name" : "METRICS_MONITOR"},
{"name" : "NODEMANAGER"},
{"name" : "PIG"},
{"name" : "TEZ_CLIENT"},
{"name" : "YARN_CLIENT"},
{"name" : "ZOOKEEPER_CLIENT"},
{"name" : "ZOOKEEPER_SERVER"}
],
"cardinality" : "1"
},
{
"name" : "slave_group",
"components" : [
{"name" : "ATLAS_CLIENT"},
{"name" : "HCAT"},
{"name" : "HDFS_CLIENT"},
{"name" : "HIVE_CLIENT"},
{"name" : "KAFKA_BROKER"},
{"name" : "INFRA_SOLR_CLIENT"},
{"name" : "MAPREDUCE2_CLIENT"},
{"name" : "METRICS_MONITOR"},
{"name" : "MYSQL_SERVER"},
{"name" : "NODEMANAGER"},
{"name" : "PIG"},
{"name" : "TEZ_CLIENT"},
{"name" : "YARN_CLIENT"},
{"name" : "ZOOKEEPER_CLIENT"},
{"name" : "ZOOKEEPER_SERVER"}
],
"cardinality" : "2"
... View more
