About Cluster-CDP

frisch · ‎01-03-2023

Hi, Unfortunately it is built with java 11 and will not work on Java 8 so. However, you can install Java 11 on only one node, along with Java 8 and let Java 8 be the default (so you do not impact any of CDP components or your programs). Then go in CM > Datagen > Configuration and set java_home_custom to the path on the node where Java 11 is installed. Datagen should start with it. Thanks.

GangWar · ‎03-02-2021

@Cluster-CDP I can see bionic parcels as well. Please make sure you are using the correct document and method to install the Spark. Follow below doc: https://docs.cloudera.com/runtime/7.2.7/cds-3/topics/spark-spark-3-packaging.html https://docs.cloudera.com/runtime/7.2.7/cds-3/topics/spark-install-spark-3-parcel.html

GangWar · ‎09-30-2020

@Cluster-CDP You can follow below Cloudera Recommendation about Role distribution as per number of nodes in the cluster. Though in your case this seems a best fit for me. https://docs.cloudera.com/cloudera-manager/7.0.3/installation/topics/cdpdc-runtime-cluster-hosts-role-assignments.html Master Hosts Utility Hosts Gateway Hosts Worker Hosts Master Host 1: NameNode YARN ResourceManager JobHistory Server ZooKeeper Kudu master Spark History Server One host for all Utility and Gateway roles: Secondary NameNode Cloudera Manager Cloudera Manager Management Service Hive Metastore HiveServer2 Impala Catalog Server Impala StateStore Hue Oozie Flume Gateway configuration HBase backup master Ranger Admin, Tagsync, Usersync servers Atlas server Solr server (CDP-INFRA-SOLR instance to support Atlas) Streams Messaging Manager Streams Replication Manager Service ZooKeeper 3 - 10 Worker Hosts: DataNode NodeManager Impalad Kudu tablet server

Online	Offline
Last Visited	‎12-14-2023 11:26 AM

Member Since	‎09-30-2020 02:51 AM
Last Visited	‎12-14-2023 11:26 AM
Posts	3

Cloudera Community

Re: Datagen - Data Generator tool built for CDP

Re: No Bionic parcels for CDS3.0 (Apache Spark3)

Re: Cluster CDP Best Practices