Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How do I create config group through Ambari Blueprint

How do I create config group through Ambari Blueprint

I did refer to this post and added config in the host_group section of Register Blueprint API as below, however that did not help.

  {
      "name": "host_group_1",
      "cardinality": "1",
      "components": [
        {
          "name": "NODEMANAGER"
        },
        {
          "name": "YARN_CLIENT"
        },
        {
          "name": "HDFS_CLIENT"
        },
        {
          "name": "ZKFC"
        },
        {
          "name": "FALCON_CLIENT"
        },
        {
          "name": "METRICS_MONITOR"
        },
        {
          "name": "NAMENODE"
        },
        {
          "name": "TEZ_CLIENT"
        },
        {
          "name": "ZOOKEEPER_CLIENT"
        },
        {
          "name": "HCAT"
        },
        {
          "name": "PIG"
        },
        {
          "name": "MAPREDUCE2_CLIENT"
        },
        {
          "name": "OOZIE_CLIENT"
        },
        {
          "name": "DATANODE"
        },
        {
          "name": "JOURNALNODE"
        },
        {
          "name": "HIVE_CLIENT"
        },
        {
          "name": "METRICS_GRAFANA"
        },
        {
          "name": "SUPERVISOR"
        },
        {
          "name": "LOGSEARCH_LOGFEEDER"
        },
        {
          "name": "INFRA_SOLR_CLIENT"
        },
        {
          "name": "HBASE_REGIONSERVER"
        },
        {
          "name": "HBASE_CLIENT"
        },
        {
          "name": "HIVE_SERVER"
        },
        {
          "name": "HIVE_METASTORE"
        },
        {
          "name": "KAFKA_BROKER"
        },
        {
          "name": "HBASE_MASTER"
        }
      ],
      "configurations": {
        "hive-site": {
          "properties_attributes": {},
          "properties": {
            "hive.compactor.initiator.on": "false"
          }
        }
      }
    }
4 REPLIES 4

Re: How do I create config group through Ambari Blueprint

Mentor

@Santhosh B Gowda the article suggests to create a separate host_group for each config group you're trying to create, i.e. host_group_1, host_group_2, etc. Perhaps you'd like to state the problem statement so we could help you better. The example in the wiki to create a multi-node cluster with two host_groups is what I think you're asking, no? In this case host groups are master and slaves.

The blueprint ("multi-node-hdfs-yarn") below defines with two host groups (a "master" and the "slaves") which hosts the various Service components (masters, slaves and clients).

{
  "host_groups" : [
    {
      "name" : "master",
      "components" : [
        {
          "name" : "NAMENODE"
        },
        {
          "name" : "SECONDARY_NAMENODE"
        },       
        {
          "name" : "RESOURCEMANAGER"
        },
        {
          "name" : "HISTORYSERVER"
        },
        {
          "name" : "ZOOKEEPER_SERVER"
        }
      ],
      "cardinality" : "1"
    },
    {
      "name" : "slaves",
      "components" : [
        {
          "name" : "DATANODE"
        },
        {
          "name" : "HDFS_CLIENT"
        },
        {
          "name" : "NODEMANAGER"
        },
        {
          "name" : "YARN_CLIENT"
        },
        {
          "name" : "MAPREDUCE2_CLIENT"
        },
        {
          "name" : "ZOOKEEPER_CLIENT"
        }
      ],
      "cardinality" : "1+"
    }
  ],
  "Blueprints" : {
    "blueprint_name" : "multi-node-hdfs-yarn",
    "stack_name" : "HDP",
    "stack_version" : "2.4"
  }
}

Re: How do I create config group through Ambari Blueprint

payload.txt

@Artem Ervits Thank you for your reply.

Hive has a property "hive.compactor.initiator.on" that needs to be set on exactly 1 Hive Metastore in HA setup. I believe the only way to achieve this would be through Config Group feature of Ambari.

I did try by providing configuration at host group level for host_group_1. Attached is the json for reference, however this does not seem to work as expected.

Re: How do I create config group through Ambari Blueprint

looks like this is not possible through blueprint. Blueprint does not provide an option to specify the config group name itself.

https://cwiki.apache.org/confluence/display/AMBARI/Blueprints

Re: How do I create config group through Ambari Blueprint

New Contributor

@Santhosh B Gowda If in case you're still looking for the solution, this is supported in Ambari blueprints but looks like the payload JSON structure seems slightly incorrect. The configurations is an array object and the payload should look something like this :

payload.json

Hopefully this helps. Kindly let me know if you found it useful.