Member since
01-25-2017
396
Posts
28
Kudos Received
11
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
614 | 10-19-2023 04:36 PM | |
4057 | 12-08-2018 06:56 PM | |
5030 | 10-05-2018 06:28 AM | |
18434 | 04-19-2018 02:27 AM | |
18456 | 04-18-2018 09:40 AM |
10-19-2023
04:39 PM
Why not using the resource pool and sub pool, if it specific query then pass the resource pool for this query and create resource pool or subpool for this query
... View more
10-19-2023
04:36 PM
1 Kudo
The node must have a NodeManager role to take part of the processing, Spark gateway, and Yarn Gateway
... View more
10-19-2023
04:34 PM
Can you share the screenshot from the Yarn Web UI and the resources you are passing with the spark submit command?
... View more
12-20-2021
07:09 AM
I think Cloudera is using the 1.x log4j Is there any plan to apply mitigation to the 1.x?
... View more
06-28-2021
02:27 AM
Hi @vidanimegh if you are talking abou mapreduce job, you need to check if the job is failing in the map or reduce phase. if the error is a java heap size, you need to increase me java heap size for teh mapper or reducer using mapreduce.map.java.opts or mapreduce.reduce.java.opts
... View more
07-17-2020
03:45 PM
@Shelton Yes, i understand and know how to change this through CM, my question is that i changed it manually in one of the nodes this setting, will the node that this config locally where i changed it or will take what is the value in CM? what i need to do if i want to revert the manual change through CM and not reverting the change manually from the node. I want to proof that manual changes has no impact and it can be overriden through CM. i provided ACL only as an example but it can be any other config
... View more
07-17-2020
02:27 PM
Thanks @Shelton for your response, just to make sure i understand this as it should be. The change that done manual has no meaning? suppose i change the config using ACL to false in one of the hadoop conf files in one node and in cloudera manager it's true, will the node that i made the change will take the value that i edited or the value in the cloudera? what i got from your answer that restarting the cloudera-scm agent or the the service may override the manual change i did? how i can trigger the change that i did in the node using vim or nano to take the value from cloudera manager?
... View more
07-17-2020
05:16 AM
Hi Community, Suppose that i changed one of the values in the node hdfs-site.xml manually, will cloudera manager override this config? example : in /etc/hadoop/conf i want to change the dfs.nameservices in hdfs-site.xml manually and i want to how cloudera manager can override this. *** I don't want to make such a change but i want to know if cloudera manager can override this.
... View more
Labels:
- Labels:
-
Cloudera Manager
-
HDFS
06-10-2020
12:06 PM
Hello community, We started a Hadoop hardening review and one of the items is identifying security vulnerability issues, We are using https://nvd.nist.gov/vuln/search to review new vulnerability issues (not the OS ones), will be happy to hear how and what are the best ways and best practises to manage this process. 1) Is the patching process part of the CDH versions, if i need to apply a patch do i have other ways without upgrading the CDH version? 2) Is there a dedicated board for cloudera/hadoop vulnerability issues that can be used as source of truth? 3) Where i can get the patches? is it requesting subscription? For example, i want to follow this one https://nvd.nist.gov/vuln/detail/CVE-2019-14449 , is it mean to get this done i need to upgrade to 5.16.2 or there is a patch that i can download and run it?
... View more
Labels:
- Labels:
-
Security
05-29-2019
06:02 AM
I'm using cloudera manager, once i added the node i need to provide the url for the cloudera manager packages, once this step finish, an automatic step kicked to distribute the parcels.
... View more