About DataMike

DataMike · ‎10-19-2022

Thanks. I think I can use Cruise Control to re-distribute the partitions across the new brokers. Haven't tried yet though.

DataMike · ‎10-19-2022

Hi all, this may be an easy question, but just wanted to verify. When adding new brokers to the cluster, after installing the Kafka role/instance on the new hosts, should you start the new broker instances first before you restart the existing brokers? Or does it matter? This is CDP Private Cloud 7.1.7 Thanks

DataMike · ‎01-07-2022

Hi, we have recently configured SRM for one way topic replication from primary -> secondary. We have added a few test topics for test and everything looks healthy. Do you happen to know if it's possible to rename the "primary" alias to something else at this point? I understand we would have the modify the alias/name in the SRM config in CM, but would there be other unknown issues that you are aware - or recommend against renaming altogether? We only have a handful of test topics we are replicating so far... so wanted to ask before we open the floodgates. Thanks!

DataMike · ‎04-13-2020

Hey @StevenOD if we stop the service... do you know if there is a way to keep it from starting when we restart the cluster vi CM?

DataMike · ‎10-31-2019

Thank you @EricL . Makes sense. We currently have MySQL set up in a master/slave config. But it looks like even with that... if the Master is offline, you have to manually edit the CM config to point to the slave. There is no where in CM (that I see) to add a slave/secondary MySQL hostname. So I assume that is why you reference setting up MySQL in a "cluster" configuration and not just master/slave replication - correct? Thank you.

DataMike · ‎10-16-2019

Hi, I have a general question. All of our metadata (CM, Hive MS, Oozie, Navigator, etc) is stored in a local MySQL instance on the Cloudera Manager host (see list of DB's below). If this host were to fail, or the MySQL service were to become unavailable for a period of time, would all of the core cluster services (excluding CM services) continue to function? I am unclear if we need to look at implementing a MySQL cluster to maintain cluster uptime. Thank you! Edit: I should add that we are currently replicating MySQL to a slave. amon rman metastore metastore sentry nav navms oozie sqoop hue

DataMike · ‎09-09-2019

Does anyone know if it is possible to exclude the Kafka service from the primary "Cluster Start/Stop" sequence in Cloudera Manager? We need to stop the CDH cluster to perform maintenance on the MySQL metadata server, which affects Hive, Impala, Sentry, Hue, HBase?, Oozie, Navigator, etc... all of which we use. Kafka is part if this CDH cluster. To stop the cluster, I would like to use the cluster "start/stop" menu item on the main CM page just for peace of mind in maintaining the proper shut down and startup sequence, but that would include Kafka going down as well, which we would like to avoid if possible. Any thoughts are appreciated. Thanks!

DataMike · ‎07-11-2019

Hi, we need to decommission a host that the HDFS "Balancer" role resides on. I don't see a way to migrate that role in CM. Will the decommission process automatically assign it to a different host? Regards, Michael

DataMike · ‎04-19-2019

Hi All, does the "Balancer" role itself use any resources? Does it matter which host the role resides (e.g. NameNode, Edge Node, etc)? Thank you.

DataMike · ‎04-10-2019

Hi All, if we add a few additional DataNodes to our cluster, and then execute a rebalance, do the dependent services (Hive, Impala, SOLR, Flume, etc) require an immediate restart or can they run with a stale configuration for a week or so until we can schedule it? The DataNodes will include the following roles: HBase RegionServer HDFS DataNode Impala Daemon Solr Server YARN NodeManager Thank you.

Online	Offline
Last Visited	‎07-28-2023 02:44 PM

Member Since	‎04-21-2016 08:24 AM
Last Visited	‎07-28-2023 02:44 PM
Posts	15

Cloudera Community

Re: Adding New Kafka Brokers: Question

Adding New Kafka Brokers: Question

SRM: Changing cluster alias name?

Re: Dedicated Kafka Cluster: Does Sentry need HDFS...

Re: What if MySQL Metadata Host Failed?

What if MySQL Metadata Host Failed?

Exclude Kafka Service from Cluster Start/Stop?

Decommission Host / Balancer Role

Which Host Should HDFS "Balancer" Role Reside?

Hive/SOLR/HBase Restart Needed After Adding DataNo...