Cloudera Community
Fawze
user rank
Master Collaborator

Re: Limit Hive query ressource consumption in Yarn

by Master Collaborator in Support Questions
‎10-19-2023 04:39 PM
‎10-19-2023 04:39 PM
Why not using the resource pool and sub pool, if it specific query then pass the resource pool for this query and create resource pool or subpool for this query ... View more

Re: How to make Yarn deploy resources to new added...

by Master Collaborator in Support Questions
‎10-19-2023 04:36 PM
1 Kudo
‎10-19-2023 04:36 PM
1 Kudo
The node must have a NodeManager role to take part of the processing, Spark gateway, and Yarn Gateway ... View more

Re: Spark application stuck at ACCEPTED state at s...

by Master Collaborator in Support Questions
‎10-19-2023 04:34 PM
‎10-19-2023 04:34 PM
Can you share the screenshot from the Yarn Web UI and the resources you are passing with the spark submit command? ... View more

Re: log4j2 vulnerability (CVE-2021-44228)

by Master Collaborator in Support Questions
‎12-20-2021 07:09 AM
‎12-20-2021 07:09 AM
I think Cloudera is using the 1.x log4j   Is there any plan to apply mitigation to the 1.x? ... View more

Re: MR jobs failed on IO and java heap size

by Master Collaborator in Support Questions
‎06-28-2021 02:27 AM
‎06-28-2021 02:27 AM
Hi @vidanimegh if you are talking abou mapreduce job, you need to check if the job is failing in the map or reduce phase.   if the error is a java heap size, you need to increase me java heap size for teh mapper or reducer using  mapreduce.map.java.opts  or  mapreduce.reduce.java.opts  ... View more

Re: Override manual config changes using cloudera ...

by Master Collaborator in Support Questions
‎07-17-2020 03:45 PM
‎07-17-2020 03:45 PM
@Shelton Yes, i understand and know how to change this through CM, my question is that i changed it manually in one of the nodes this setting, will the node that this config locally where i changed it or will take what is the value in CM? what i need to do if i want to revert the manual change through CM and not reverting the change manually from the node.   I want to proof that manual changes has no impact and it can be overriden through CM. i provided ACL only as an example but it can be any other config ... View more

Re: Override manual config changes using cloudera ...

by Master Collaborator in Support Questions
‎07-17-2020 02:27 PM
‎07-17-2020 02:27 PM
Thanks @Shelton for your response, just to make sure i understand this as it should be.   The change that done manual has no meaning? suppose i change the config using ACL to false in one of the hadoop conf files in one node and in cloudera manager it's true, will the node that i made the change will take the value that i edited or the value in the cloudera? what i got from your answer that restarting the cloudera-scm agent or the the service may override the manual change i did?   how i can trigger the change that i did in the node using vim or nano to take the value from cloudera manager? ... View more

Override manual config changes using cloudera mana...

by Master Collaborator in Support Questions
‎07-17-2020 05:16 AM
‎07-17-2020 05:16 AM
Hi Community, Suppose that i changed one of the values in the node hdfs-site.xml manually, will cloudera manager override this config? example : in /etc/hadoop/conf i want to change the dfs.nameservices in  hdfs-site.xml manually and i want to how cloudera manager can override this.   *** I don't want to make such a change but i want to know if cloudera manager can override this. ... View more
Labels:

Hadoop security patching management

by Master Collaborator in Support Questions
‎06-10-2020 12:06 PM
‎06-10-2020 12:06 PM
Hello community,   We started a Hadoop hardening review and one of the items is identifying security vulnerability issues,    We are using https://nvd.nist.gov/vuln/search to review new vulnerability issues (not the OS ones), will be happy to hear how and what are the best ways and best practises to manage this process. 1) Is the patching  process part of the CDH versions, if i need to apply a patch do i have other ways without upgrading the CDH version? 2) Is there a dedicated board for cloudera/hadoop vulnerability issues that can be used as source of truth? 3) Where i can get the patches? is it requesting subscription?    For example, i want to follow this one https://nvd.nist.gov/vuln/detail/CVE-2019-14449 , is it mean to get this done i need to upgrade to 5.16.2 or there is a patch that i can download and run it?     ... View more
Labels:

Re: Nodes with different OS Versions

by Master Collaborator in Support Questions
‎05-29-2019 06:02 AM
‎05-29-2019 06:02 AM
I'm using cloudera manager, once i added the node i need to provide the url for the cloudera manager packages, once this step finish, an automatic step kicked to distribute the parcels. ... View more
Contact Me
Online
Offline
Last Visited
‎10-19-2023 10:11 PM
Community Statistics
Member Since ‎01-25-2017 01:09 PM
Last Visited ‎10-19-2023 10:11 PM
Posts 396
Kudos received 27