Member since
01-25-2017
396
Posts
28
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1858 | 10-19-2023 04:36 PM |
10-24-2023
09:36 PM
I think you don't have sufficient resources to run the job for queue root.hdfs. Verify is there any pending running jobs/application in the root.hdfs queue from Resource Manager UI. If it is running kill those if it is not required. And also verify from spark side you have given less resource to test it.
... View more
10-19-2023
04:39 PM
Why not using the resource pool and sub pool, if it specific query then pass the resource pool for this query and create resource pool or subpool for this query
... View more
10-19-2023
04:36 PM
1 Kudo
The node must have a NodeManager role to take part of the processing, Spark gateway, and Yarn Gateway
... View more
01-19-2022
11:49 AM
@kevmac you and @Eric_B can find out about the actual target Log4j library version for Cloudera's suggested remediation by consulting the blog post Cloudera Response to CVE-2021-44228. The version of the Log4j library that the aforementioned remediation script is intended for is specified in the very first paragraph, sub-headed Summary.
... View more
07-17-2020
03:45 PM
@Shelton Yes, i understand and know how to change this through CM, my question is that i changed it manually in one of the nodes this setting, will the node that this config locally where i changed it or will take what is the value in CM? what i need to do if i want to revert the manual change through CM and not reverting the change manually from the node. I want to proof that manual changes has no impact and it can be overriden through CM. i provided ACL only as an example but it can be any other config
... View more
01-29-2019
12:31 AM
We solved the issue. Looks like it is a ulimit related problem. We raised user limits under /etc/security/limits.d/ And then we created a file under /etc/systemd/system/cloudera-scm-agent.service.d/override.conf To override service-level limits And we raised the value echo "65536" > /sys/fs/cgroup/pids/system.slice/cloudera-scm-agent.service/pids.max (instead of rebooting).
... View more