About HanzalaShaikh

HanzalaShaikh · ‎03-02-2024

@Loaimohamed79 please restart cloudera-scm-agent on all the kafka instances and check if you are still see this error. Were u able to run this command before enabling it?

HanzalaShaikh · ‎11-19-2023

After a thorough research on the space capacity and best practice. I have the recommendations to share and can conclude this as resolved. As a general recommendation, it is suggested not exceeding the data node DFS configured capacity for more than 100TB. Since our current setup is already at 87TB, It is recommended for scaling the cluster horizontally by adding more data nodes with homogeneous configurations. This way we can add more compute as well as additional I/O capacity to the cluster.

HanzalaShaikh · ‎11-14-2023

Hello All, We have 12 disk configured on each data node of 7.3 TB disk size of each, so that makes up the total space on each data node 87.6 TB. Disk size on each data node: /dev/sdb1 7.3T /data1 /dev/sdc1 7.3T /data2 /dev/sdd1 7.3T /data3 /dev/sde1 7.3T /data4 /dev/sdf1 7.3T /data5 /dev/sdg1 7.3T /data6 /dev/sdh1 7.3T /data7 /dev/sdi1 7.3T /data8 /dev/sdj1 7.3T /data9 /dev/sdk1 7.3T /data10 /dev/sdl1 7.3T /data11 /dev/sdm1 7.3T /data12 Due to growth in data we have already come close to the threshold value on each data node. Hence need suggestion/best practice to know is it better to add more disk of the same size or should we increase data nodes. considering we don't compromise with the load on the servers. So if adding nodes would be a better option then we will go for that. We are currently on CDP 7 and I want to ensure we follow the best practice so that should accommodate our space concerns in the long run. Kindly share if any one has to come to this situation and what would be the best approach in this case.

HanzalaShaikh · ‎10-02-2023

Hi miked, I had done those courses on coursera quiet a while ago. I would suggest you to still go through the training to get your concepts clear however if you talk bout the relevance then yes it is still relevant but the new offering are definitely not present so you will have to do self-study or join Cloudera webinars to gain knowledge on those areas. If you find my suggestion useful then please do reply.

HanzalaShaikh · ‎09-30-2023

Since we are using CDW Cloudera data warehouse, upon doing some research I can say there no change required on code level as we are using hive on Tez and it is going to be a not a major upgrade as we do from CDH to CDP. Hence accepting this as a solution to my query after thorough research.

HanzalaShaikh · ‎09-30-2023

Thanks samanta

HanzalaShaikh · ‎09-25-2023

Hi Experts, To address few of the vulnerabilities present in CDP 7.1.6 we were advised to upgrade to CDP 7.1.7 SP2 version and then we came across with Cloudera releasing the new CDP 7.1.9 version. So, we are confused as to which one should we go for. We are still using HDFS for storage and hive, impala, spark, Tez, oozie as other services in the stack along with JDK 8 and RHEL 7.8, we don't intend to compromise our current flow hope this functionality we can use in CDP 7.1.9. Please share what's your suggestion on this. our architect mostly prefer selecting the -1 version of the current version so technically we should be selecting CDP 7.1.8 which is the -1 version of CDP 7.1.9. The same was done during our last upgrade wherein we moved to CDP 7.1.6 where 7.1.7 was already released.

HanzalaShaikh · ‎05-25-2023

Hi Experts, We are on 7.1.6 CDP version and exposed to CVE-2022-25168. Versions affected: 2.0.0 to 2.10.1, 3.0.0-alpha to 3.2.3, 3.3.0 to 3.3.2 To address this vulnerability, we are planning to upgrade to CDP 7.1.7 as I got this information from one of the posts in the cloudera community. My question is does anyone did this upgrade before from 7.1.6 to 7.1.7 to eliminate this CVE. If yes, then how easy is it do we need to make changes in the code level also or we can do the upgrade from the GUI by just downloading, distributing and activating the new version. Please help with your suggestion and if possible, please share the documentation for this upgrade. Thanks

HanzalaShaikh · ‎11-06-2022

It looks there is some loading issue. Try reloading the page and multiple restart can also be the best option to correctly load the page with all options available to view.

HanzalaShaikh · ‎09-08-2022

Thanks for your quick reply @smruti , really appreciated. I have gone through this approach and will surely consider it for DR strategy.

Online	Offline
Last Visited	‎10-05-2024 10:54 AM

Member Since	‎04-25-2020 12:26 AM
Last Visited	‎10-05-2024 10:54 AM
Posts	43
Kudos received	5

Cloudera Community

Re: Is it best to increase the disk or datanode to...

Re: CDP minor upgrade to close vulnerability

Re: Oozie workflow failed for sqoop import job

Re: Impala Daemon Shutdown and unable to start up

Re: Error in Kafka when enable TLS

Re: Is it best to increase the disk or datanode to...

Is it best to increase the disk or datanode to add...

Re: Training material on coursera

Re: CDP minor upgrade to close vulnerability

Re: Cloudera Upgrade either to CDP 7.1.7 SP2 or CD...

Cloudera Upgrade either to CDP 7.1.7 SP2 or CDP 7....

CDP minor upgrade to close vulnerability

Re: I can open localhost:50070 successfully, but I...

Re: Backup and Disaster recovery alternative optio...