question Re: Provisioning Edge Node for HDP using Cloudbreak Deployment on Azure in Archives of Support Questions (Read Only)

Provisioning Edge Node for HDP using Cloudbreak Deployment on Azure

munnyrahul — Sat, 07 Jan 2017 02:41:19 GMT

I am planning to create 4 node cluster on Azure using Cloudbreak Automated Deployment. I wanted to create 1 Name Node, 2 Data Nodes and 1 Edge Node.

I wanted to know how to create Edge Node in Cluster using Cloudbreak(Ambari Blueprints)?

Re: Provisioning Edge Node for HDP using Cloudbreak Deployment on Azure

akanto — Sat, 07 Jan 2017 03:42:17 GMT

Edge node is nothing more just a properly configured hostgroup with e.g. client libraries and/or with perimeter security components like Knox. What is in the hostgroup is transparent for Cloudbreak, I have copied an example here:

...

 {
      "name": "host_group_edge",
      "configurations": [],
      "components": [
        {
          "name": "ZOOKEEPER_CLIENT"
        },
        {
          "name": "PIG"
        },
        {
          "name": "OOZIE_CLIENT"
        },
        {
          "name": "HBASE_CLIENT"
        },
        {
          "name": "HCAT"
        },
        {
          "name": "KNOX_GATEWAY"
        },
        {
          "name": "METRICS_MONITOR"
        },
        {
          "name": "FALCON_CLIENT"
        },
        {
          "name": "TEZ_CLIENT"
        },
        {
          "name": "SLIDER"
        },
        {
          "name": "SQOOP"
        },
        {
          "name": "HDFS_CLIENT"
        },
        {
          "name": "HIVE_CLIENT"
        },
        {
          "name": "YARN_CLIENT"
        },
        {
          "name": "METRICS_COLLECTOR"
        },
        {
          "name": "MAPREDUCE2_CLIENT"
        }
      ],
      "cardinality": "1"
    }
...

If you would like you create your own blueprint, then probably the easiest way is to use a default blueprint delivered together with Cloudbreak (e.g. hdp-small-default blueprint) and delete those hostgroups and components what you don't need.

Re: Provisioning Edge Node for HDP using Cloudbreak Deployment on Azure

munnyrahul — Sat, 07 Jan 2017 21:21:30 GMT

Hi Attila,

Thanks for the answer.

Just another question -- Suppose i have set up a cluster with HDP stack as 2.3. But now i want to upgrade the HDP stack of that particular cluster to 2.5? Can we do it using cloudbreak? And how do we add services like Apache Atlas, Ranger, Falcon if required to already running cluster using Cloudbreak automated deployment?

Thanks

Rahul