About Fawze

Fawze · ‎12-20-2021

I think Cloudera is using the 1.x log4j Is there any plan to apply mitigation to the 1.x?

Fawze · ‎06-28-2021

Hi @vidanimegh if you are talking abou mapreduce job, you need to check if the job is failing in the map or reduce phase. if the error is a java heap size, you need to increase me java heap size for teh mapper or reducer using mapreduce.map.java.opts or mapreduce.reduce.java.opts

Fawze · ‎07-17-2020

@Shelton Yes, i understand and know how to change this through CM, my question is that i changed it manually in one of the nodes this setting, will the node that this config locally where i changed it or will take what is the value in CM? what i need to do if i want to revert the manual change through CM and not reverting the change manually from the node. I want to proof that manual changes has no impact and it can be overriden through CM. i provided ACL only as an example but it can be any other config

Fawze · ‎07-17-2020

Thanks @Shelton for your response, just to make sure i understand this as it should be. The change that done manual has no meaning? suppose i change the config using ACL to false in one of the hadoop conf files in one node and in cloudera manager it's true, will the node that i made the change will take the value that i edited or the value in the cloudera? what i got from your answer that restarting the cloudera-scm agent or the the service may override the manual change i did? how i can trigger the change that i did in the node using vim or nano to take the value from cloudera manager?

Fawze · ‎07-17-2020

Hi Community, Suppose that i changed one of the values in the node hdfs-site.xml manually, will cloudera manager override this config? example : in /etc/hadoop/conf i want to change the dfs.nameservices in hdfs-site.xml manually and i want to how cloudera manager can override this. *** I don't want to make such a change but i want to know if cloudera manager can override this.

Fawze · ‎06-10-2020

Hello community, We started a Hadoop hardening review and one of the items is identifying security vulnerability issues, We are using https://nvd.nist.gov/vuln/search to review new vulnerability issues (not the OS ones), will be happy to hear how and what are the best ways and best practises to manage this process. 1) Is the patching process part of the CDH versions, if i need to apply a patch do i have other ways without upgrading the CDH version? 2) Is there a dedicated board for cloudera/hadoop vulnerability issues that can be used as source of truth? 3) Where i can get the patches? is it requesting subscription? For example, i want to follow this one https://nvd.nist.gov/vuln/detail/CVE-2019-14449 , is it mean to get this done i need to upgrade to 5.16.2 or there is a patch that i can download and run it?

Fawze · ‎05-29-2019

I'm using cloudera manager, once i added the node i need to provide the url for the cloudera manager packages, once this step finish, an automatic step kicked to distribute the parcels.

Fawze · ‎05-29-2019

so you installed the Cloudera manager agent manually and then the parcels distributed automatically? Did you face any issue?

Fawze · ‎05-29-2019

How i will choose which parcels to distribute to each node? or it will try to distribute both parcels on the node and one of them will fail?

Fawze · ‎05-29-2019

@chriswalton007 Hi Chris, i'm unbale to reach the limk, do you mind share the exact steps you managed to overcome this? Thanks in advance. @RajeshBodolla What about the CDH parcels, for other extra custom parcels like anaconda and airflow, i will face the same issue. what about the NameNode and the Mysql?

Online	Offline
Last Visited	‎12-22-2021 12:25 PM

Member Since	‎01-25-2017 01:09 PM
Last Visited	‎12-22-2021 12:25 PM
Posts	393
Kudos received	26

Cloudera Community

Cloudera Community

Re: Upgrade to CDH 6.0.x from 5.15

Re: How to define concrete resource consumption fo...

Re: Excution of the following command gives warnin...

Re: Excution of the following command gives warnin...

Re: problem in creation of input folder in root by...

Re: log4j2 vulnerability (CVE-2021-44228)

Re: MR jobs failed on IO and java heap size

Re: Override manual config changes using cloudera ...

Re: Override manual config changes using cloudera ...

Override manual config changes using cloudera mana...

Hadoop security patching management

Re: Nodes with different OS Versions

Re: Nodes with different OS Versions

Re: Nodes with different OS Versions

Re: Nodes with different OS Versions