Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Howto configure HBase Params for AWS Cluster Configuration

avatar
Contributor

I can successfully create a cluster using the Cloudera provided template and nodes following the AWS template profile. 

 

Am seeking to script how to configure parameters such as

 

hbase.regionserver.msginterval

hbase.hstore.blockingStoreFiles

hbase.snapshot.enabled...

 

I presume that these will go in the post creation script... how?

1 ACCEPTED SOLUTION

avatar
Super Collaborator

Hello there,

 

Director uses Cloudera Manager's API under the hood to configure services. The selection of parameters supported for HBase can be found here.

 

http://www.cloudera.com/documentation/enterprise/properties/5-8-x/topics/cm_props_cdh580_hbase.html

 

You can include the parameters you need in service or role configurations specified through Director, either in the UI or in a configuration file. Use the name in the "API" column of the page linked above to name each property. For example, to specify the region server message interval, include the "hbase_regionserver_msginterval" configuration property in the role configuration for region servers. A configuration file would specify it like this, perhaps in an "workers" instance group.

 

roles {

  ...

  HBASE: [REGIONSERVER]

  ...

}

configs {

  HBASE {

    REGIONSERVER {

      hbase_regionserver_msginterval: 10

    }

  }

}

 

Take a look at the sample configuration files shipped with Director for a complete example.

 

https://www.cloudera.com/documentation/director/latest/topics/director_cluster_config.html

 

General documentation about setting these kinds of configuration properties is here:

 

https://www.cloudera.com/documentation/director/latest/topics/director_setting_cm_configs.html

View solution in original post

1 REPLY 1

avatar
Super Collaborator

Hello there,

 

Director uses Cloudera Manager's API under the hood to configure services. The selection of parameters supported for HBase can be found here.

 

http://www.cloudera.com/documentation/enterprise/properties/5-8-x/topics/cm_props_cdh580_hbase.html

 

You can include the parameters you need in service or role configurations specified through Director, either in the UI or in a configuration file. Use the name in the "API" column of the page linked above to name each property. For example, to specify the region server message interval, include the "hbase_regionserver_msginterval" configuration property in the role configuration for region servers. A configuration file would specify it like this, perhaps in an "workers" instance group.

 

roles {

  ...

  HBASE: [REGIONSERVER]

  ...

}

configs {

  HBASE {

    REGIONSERVER {

      hbase_regionserver_msginterval: 10

    }

  }

}

 

Take a look at the sample configuration files shipped with Director for a complete example.

 

https://www.cloudera.com/documentation/director/latest/topics/director_cluster_config.html

 

General documentation about setting these kinds of configuration properties is here:

 

https://www.cloudera.com/documentation/director/latest/topics/director_setting_cm_configs.html