About Biplab14

Biplab14 · ‎09-28-2024

When you create an operational database with HDFS storage type in an AWS environment, the Operational Database on HDFS clusters now also supports m6i and m7i instances for the applicable nodes. The Operational Database clusters with HDFS storage type are upgraded to enhance the operational database's performance and usability. The following are the new custom instance types supported by the Operational Database. AWS, HEAVY, HDFS: Worker: m6i.4xlarge, m7i.4xlarge Master: m6i.8xlarge, m7i.8xlarge Compute/edge/leader: m6i.2xlarge, m7i.2xlarge Gateway: r6i.8xlarge, r7i.8xlarge AWS, LIGHT, HDFS: Worker: m6i.4xlarge, m7i.4xlarge Compute/edge/leader/gateway: m6i.2xlarge, m7i.2xlarge Master: m6i.4xlarge, m7i.4xlarge This is available starting in COD v1.45 and you do not need to upgrade to a higher version of COD to benefit from this feature. Try the Cloudera Operational Database for free with Test Drive (no cloud account or setup is needed).

Biplab14 · ‎09-28-2024

The Cloudera Operational Database CDP CLI adds a new option --custom-instance-types to the create-database command. Using this option, you can define custom instance types; however, the instance types must be included in the allowlist by the Operational Database. Currently, the allowlist is not accessible, however, the following are the new custom instance types supported by the Operational Database. AWS, HEAVY, HDFS: Worker: m6i.4xlarge, m7i.4xlarge Master: m6i.8xlarge, m7i.8xlarge Compute/edge/leader: m6i.2xlarge, m7i.2xlarge Gateway: r6i.8xlarge, r7i.8xlarge AWS, LIGHT, HDFS: Worker: m6i.4xlarge, m7i.4xlarge Compute/edge/leader/gateway: m6i.2xlarge, m7i.2xlarge Master: m6i.4xlarge, m7i.4xlarge The following is a sample output of the create-database command highlighting the usage of the --custom-instance-types option. cdp opdb create-database --environment-name cod_env --database-name cod_db --custom-instance-types masterType=m7i.4xlarge,workerType=m7i.4xlarge,leaderType=m7i.2xlarge,gatewayType=m7i.2xlarge --storage-type=HDFS --scale-type LIGHT The --storage-type option is now optional. If you do not define the --storage-type option, the Operational Database considers the default storage type. The default storage type is blob storage. If the ephemeral storage is enabled, the Operational Database considers the storage type CLOUD_WITH_EPHEMERAL; otherwise, CLOUD is considered. For more information, see CDP CLI documentation. This is available starting in COD v1.45 and you do not need to upgrade to a higher version of COD to benefit from this feature. Try the Cloudera Operational Database for free with Test Drive (no cloud account or setup is needed).

Biplab14 · ‎05-10-2024

In CDP CLI, while creating an operational database, you can specify the encryption key to encrypt the volume for instance groups using the --volume-encryptions (array) option. You can select this option only in AWS environments. Following is a sample command. opdb create-database --environment-name <environment-name> --database-name <database-name> --disable-external-db --scale-type MICRO --attached-storage-for-workers '{"volumeCount":1,"volumeType":"SSD","volumeSize":100}' --endpoint-url http://localhost:8988 \ --volume-encryptions '[ { "encryptionKey": "<aws-key-arn>", "instanceGroup": "GATEWAY" } ]' Shorthand syntax: encryptionKey=string,instanceGroup=string ... (separate items with spaces) JSON syntax: [ { "encryptionKey": "string", "instanceGroup": "WORKER"|"LEADER"|"MASTER"|"GATEWAY"|"STRONGMETA"|"EDGE" } ... ] For more information, see CDP CLI documentation. This is available starting in COD v1.41 and you do not need to upgrade to a higher version of COD to benefit from this feature. Try the Cloudera Operational Database for free with Test Drive (no cloud account or setup is needed).

Biplab14 · ‎05-10-2024

When you create and deploy an operational database in an Azure environment, by default, COD clusters now use Standard_D8s_v3 instance type instead of Standard_D8_v3. The instance type is upgraded to support encryption at the host level. If you want to retain the Standard_D8_v3 instance type, you must have the COD_USE_DV3_INSTANCE_TYPE entitlement on your account. This is available starting in COD v1.41 and you do not need to upgrade to a higher version of COD to benefit from this feature. Try the Cloudera Operational Database for free with Test Drive (no cloud account or setup is needed).

Biplab14 · ‎05-10-2024

In CDP CLI, while creating an operational database, you can set the default root volume size with the --root-volume-size (integer) option in GiB for all the instances in the cluster. Following is a sample command. cdp opdb create-database --environment-name test-env --database-name test-db --root-volume-size 300 For more information, see CDP CLI documentation. This is available starting in COD v1.41 and you do not need to upgrade to a higher version of COD to benefit from this feature. Try the Cloudera Operational Database for free with Test Drive (no cloud account or setup is needed).

Biplab14 · ‎05-10-2024

When you create an operational database with HDFS storage type, the COD clusters now use 16 core instances on AWS, Azure, and GCP environments for worker nodes. The COD clusters with HDFS storage type are upgraded to enhance the performance and usability of the COD. The new worker instances for HDFS storage type are as follows: AWS: m5.4xlarge Azure: Standard_D16_v3 GCP: n2-standard-16 This is available starting in COD v1.41 and you do not need to upgrade to a higher version of COD to benefit from this feature. Try the Cloudera Operational Database for free with Test Drive (no cloud account or setup is needed).

Biplab14 · ‎04-01-2024

When you create an operational database using the COD UI, the new Create Database option provides enhancements to the database creation workflow. In addition to the enhanced look and feel for better usability, the workflow also provides two additional steps called, Settings and Review. In the Settings step, you can view the default settings for your database and can also modify them. In the Review step, you can view, and finalize your changes, and also obtain a complete CLI command, in case you want to create the database using CDP CLI. Documentation link: Creating a database using COD This is available starting in COD v1.40 and you do not need to upgrade to a higher version of COD to benefit from this feature. Try the Cloudera Operational Database for free with Test Drive (no cloud account or setup is needed).

Biplab14 · ‎01-11-2024

Upgrade your COD cluster without downtime Released on August 10, 2023 You can now upgrade the Cloudera Runtime version and the operating system version of the database that uses HDFS and Object Store without Ephemeral Storage, in a rolling restart mode. Previously, while performing a Cloudera Runtime upgrade, users experienced HBase or Phoenix service downtime provided by COD. You can now avoid a service outage of a COD cluster while performing a Cloudera Runtime upgrade. This feature ensures continuous service availability. To upgrade the Cloudera Runtime version, use the --rolling-upgrade | --no-rolling-upgrade option on CDP CLI with the upgrade-database command. cdp opdb upgrade-database --environment <environment-name> --database <database-name> --runtime <runtime-version> [--rolling-upgrade | --no-rolling-upgrade] To upgrade the operating system version, use the --os-upgrade-only option along with the --rolling-upgrade option in the upgrade-database command. cdp opdb upgrade-database --environment <environment-name> --database <database-name> [--runtime <runtime-version> | --image <imageId>] --os-upgrade-only --rolling-upgrade References: COD documentation ------------------------------------------------------------------------------------------------ Enhance your COD metrics view using Grafana dashboards Released on August 10, 2023 You can now obtain a consolidated view of your COD metrics using the Grafana dashboard for the supported components. It is a pre-defined solution to visualize the COD metrics comprehensively. On your CDP CLI, use the create-database command and the --enable-grafana option to enable the Grafana URL under the GRAFANA DASHBOARD option inside your COD database. Here’s an example of the create-database command. cdp opdb create-database --environment <environment_name> --database <database_name> --enable-grafana On successfully executing the command, the Grafana URL is added under the GRAFANA DASHBOARD option inside the COD database as shown in the following figure. When you click on the Grafana URL, it takes you to the Grafana dashboard. Here is an example of the HBase dashboard using Grafana. References: COD documentation ------------------------------------------------------------------------------------------------ Create your COD cluster using JDK8 and JDK11 Released on August 30, 2023 You can now create your database using either of the aforementioned Java versions. A new CLI option –java-version is available which you can use to configure the Java version on your COD cluster. Previously, users could only select the JDK 8 version while creating an operational database. Now, users can select the supported JDK versions that provide more flexibility. Use the following command on your CDP CLI to specify the Java version on your COD cluster. cdp opdb create-database --environment-name <environment_name> --database-name <database_name> --java-version <value> cdp opdb create-database --environment-name cod7215 --database-name testenv --java-version 11 The supported Java versions are JDK8 and JDK11. If you do not specify the Java version, by default, JDK8 is used. References: COD CLI documentation ------------------------------------------------------------------------------------------------ Create your COD cluster on a cloud environment with ephemeral storage COD introduces a new UI option, Cloud With Ephemeral Storage while creating a new operational database. You can set the storage type for the database using this UI option. This option is equivalent to using the --storage-type CLOUD_WITH_EPHEMERAL option on CDP CLI while creating an operational database. Previously, users were limited to using the CDP CLI to select the storage type; now they don’t need to use the CLI when creating a new COD cluster with cloud storage and using ephemeral caching. References: COD documentation ------------------------------------------------------------------------------------------------

Biplab14 · ‎12-22-2023

When you create a new operational database using CDP CLI, you can enable fast autoscaling by defining the required parameters using the --auto-scaling-parameters option. COD now supports a new instance group called, Compute. The nodes under this instance group are automatically scaled up or scaled down based on the CPU utilization and RPC latency. To use fast autoscaling, you must have the COD_USE_COMPUTE_ONLY_NODES entitlement. Following is a sample command. cdp opdb create-database —environment-name <env_name> –database-name <db_name> --auto-scaling-parameters '{"minComputeNodesForDatabase":<min_compute_nodes>, "maxComputeNodesForDatabase": <max_compute_nodes>}' Documentation link: Fast autoscaling in COD This is available starting in COD v1.37 and you do not need to upgrade to a higher version of COD to benefit from this feature. Try the Cloudera Operational Database for free with Test Drive (no cloud account or setup is needed).

Biplab14 · ‎12-22-2023

When you create a new operational database with Cloud With Ephemeral Storage as the storage type on an AWS environment, COD creates the database with an I4i instance type for the worker nodes. This is available starting in COD v1.37 and you do not need to upgrade to a higher version of COD to benefit from this feature. Try the Cloudera Operational Database for free with Test Drive (no cloud account or setup is needed).

Online	Offline
Last Visited	‎09-28-2024 12:07 PM

Member Since	‎10-05-2021 12:10 AM
Last Visited	‎09-28-2024 12:07 PM
Posts	69
Kudos received	7

Cloudera Community

Updates to the HDFS clusters on AWS environments t...

Enhancements to the create-database command

Cloudera Operational Database (COD) supports insta...

Cloudera Operational Database (COD) has updated t...

Cloudera Operational Database (COD) supports confi...

Cloudera Operational Database (COD) has updated th...

Cloudera Operational Database (COD) supports enhan...

Cloudera Operational Database (COD) key features r...

Cloudera Operational Database (COD) supports fast ...

Cloudera Operational Database (COD) supports a new...