Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Howto configure HBase Params for AWS Cluster Configuration

avatar
Contributor

I can successfully create a cluster using the Cloudera provided template and nodes following the AWS template profile. 

 

Am seeking to script how to configure parameters such as

 

hbase.regionserver.msginterval

hbase.hstore.blockingStoreFiles

hbase.snapshot.enabled...

 

I presume that these will go in the post creation script... how?

1 ACCEPTED SOLUTION

avatar
Super Collaborator

Hello there,

 

Director uses Cloudera Manager's API under the hood to configure services. The selection of parameters supported for HBase can be found here.

 

http://www.cloudera.com/documentation/enterprise/properties/5-8-x/topics/cm_props_cdh580_hbase.html

 

You can include the parameters you need in service or role configurations specified through Director, either in the UI or in a configuration file. Use the name in the "API" column of the page linked above to name each property. For example, to specify the region server message interval, include the "hbase_regionserver_msginterval" configuration property in the role configuration for region servers. A configuration file would specify it like this, perhaps in an "workers" instance group.

 

roles {

  ...

  HBASE: [REGIONSERVER]

  ...

}

configs {

  HBASE {

    REGIONSERVER {

      hbase_regionserver_msginterval: 10

    }

  }

}

 

Take a look at the sample configuration files shipped with Director for a complete example.

 

https://www.cloudera.com/documentation/director/latest/topics/director_cluster_config.html

 

General documentation about setting these kinds of configuration properties is here:

 

https://www.cloudera.com/documentation/director/latest/topics/director_setting_cm_configs.html

View solution in original post

1 REPLY 1

avatar
Super Collaborator

Hello there,

 

Director uses Cloudera Manager's API under the hood to configure services. The selection of parameters supported for HBase can be found here.

 

http://www.cloudera.com/documentation/enterprise/properties/5-8-x/topics/cm_props_cdh580_hbase.html

 

You can include the parameters you need in service or role configurations specified through Director, either in the UI or in a configuration file. Use the name in the "API" column of the page linked above to name each property. For example, to specify the region server message interval, include the "hbase_regionserver_msginterval" configuration property in the role configuration for region servers. A configuration file would specify it like this, perhaps in an "workers" instance group.

 

roles {

  ...

  HBASE: [REGIONSERVER]

  ...

}

configs {

  HBASE {

    REGIONSERVER {

      hbase_regionserver_msginterval: 10

    }

  }

}

 

Take a look at the sample configuration files shipped with Director for a complete example.

 

https://www.cloudera.com/documentation/director/latest/topics/director_cluster_config.html

 

General documentation about setting these kinds of configuration properties is here:

 

https://www.cloudera.com/documentation/director/latest/topics/director_setting_cm_configs.html