Member since
09-21-2017
7
Posts
1
Kudos Received
0
Solutions
10-11-2017
07:53 PM
Hi there, We are looking to use ephemeral hadoop cluster/infrastructure approach for one of our applications. Assuming the application runs at 6am/6pm and it runs for around 30min each time. We want to bring up the infrastructure with a particular blueprint for the application then let the application run end-to-end and then bring it down until the next run 12 hours later. Does cloudbreak provide this feature and if so can someone help us with where is a resource/documentation for it? Or we need to have a small cluster running all the time with minimum nodes and scale up/down depending on application schedule with time based autoscaling? Thanks.!
... View more
Labels:
09-22-2017
10:58 PM
1 Kudo
Hi there, We are unable to add phoenix application to slave nodes in our presently running cluster which was spun up using Cloudbreak. We were of the opinion that if we add HBase as a service then Phoenix would be available for addition later when we need it. Would like to know if we have missed something. I am attaching the blueprint as well : {
"host_groups": [
{
"name": "host_group_master_1",
"configurations": [],
"components": [
{
"name": "HBASE_MASTER"
},
{
"name": "ZOOKEEPER_SERVER"
},
{
"name": "NAMENODE"
},
{
"name": "HDFS_CLIENT"
},
{
"name": "ZOOKEEPER_CLIENT"
},
{
"name": "METRICS_MONITOR"
},
{
"name": "HBASE_CLIENT"
}
],
"cardinality": "1"
},
{
"name": "host_group_master_2",
"configurations": [],
"components": [
{
"name": "HBASE_MASTER"
},
{
"name": "ZOOKEEPER_SERVER"
},
{
"name": "PIG"
},
{
"name": "ZOOKEEPER_CLIENT"
},
{
"name": "METRICS_MONITOR"
},
{
"name": "HDFS_CLIENT"
},
{
"name": "HBASE_CLIENT"
},
{
"name": "SECONDARY_NAMENODE"
}
],
"cardinality": "1"
},
{
"name": "host_group_master_3",
"configurations": [],
"components": [
{
"name": "ZOOKEEPER_SERVER"
},
{
"name": "HBASE_CLIENT"
},
{
"name": "HDFS_CLIENT"
},
{
"name": "METRICS_MONITOR"
},
{
"name": "METRICS_COLLECTOR"
}
],
"cardinality": "1"
},
{
"name": "host_group_client_1",
"configurations": [],
"components": [
{
"name": "ZOOKEEPER_CLIENT"
},
{
"name": "PIG"
},
{
"name": "HBASE_CLIENT"
},
{
"name": "METRICS_MONITOR"
},
{
"name": "SQOOP"
},
{
"name": "HDFS_CLIENT"
},
{
"name": "METRICS_MONITOR"
}
],
"cardinality": "1"
},
{
"name": "host_group_slave_1",
"configurations": [],
"components": [
{
"name": "HBASE_REGIONSERVER"
},
{
"name": "METRICS_MONITOR"
},
{
"name": "ZOOKEEPER_CLIENT"
},
{
"name": "HBASE_CLIENT"
},
{
"name": "DATANODE"
},
{
"name": "HDFS_CLIENT"
}
],
"cardinality": "4"
}
],
"Blueprints": {
"blueprint_name": "hbase-sec-nn",
"stack_name": "HDP",
"stack_version": "2.6"
}
} Thank you.!!
... View more
Labels: