Member since
03-06-2020
114
Posts
3
Kudos Received
0
Solutions
06-10-2020
05:57 AM
Hi @stevenmatison just want to know if you are familiar on this Use case also? Thank you!
... View more
06-09-2020
10:27 PM
My datanode is currently giving me this warning below: /dfs/dn is in a filesystem that reaches the threshold for free space. I have a 2nd disk mounted on /data and I'm thinking of moving the datanode filesystem under /data to have free space, is it possible to do that with no significant effect in the cluster? because i have this same issue also with Namenode and I think if I changed the path there also, fsimage is still retail on the original path..
... View more
Labels:
- Labels:
-
Cloudera Manager
06-09-2020
09:34 PM
hi when I do some hive basic query like "select * from table" using Mapred execution engine, my job is failing with these kind of errors: upon execution: Yarn Logs: Error: could not find or load main class 800 RM logs: == USER=user OPERATION=Application Finished - Failed TARGET=RMAppManager RESULT=FAILURE DESCRIPTION=App failed with state: FAILED PERMISSIONS=Application application_1591667296620_0286 failed 2 times due to AM Container for appattempt_1591667296620_0286_000002 exited with exitCode: 1
Failing this attempt.Diagnostics: [2020-06-10 12:14:43.978]Exception from container-launch.
Container id: container_1591667296620_0286_02_000001
Exit code: 1
[2020-06-10 12:14:43.979]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class 800
[2020-06-10 12:14:43.981]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class 800
For more detailed output, check the application tracking page: https://clouderacluster:8088/cluster/app/application_1591667296620_0286 Then click on links to logs of each attempt.
. Failing the application. APPID=application_1591667296620_0286
... View more
Labels:
- Labels:
-
Apache YARN
-
MapReduce
06-07-2020
11:28 PM
hi, how can I stop my container logs on the nodemanagers deleted once the job finished? they seems be deleted once the job are finished, they exist it here /data/yarn/container-logs when running.
... View more
Labels:
- Labels:
-
Apache YARN
06-03-2020
10:44 PM
Hi @paras do you think this is now somehow sufficient? only the know users are indicated on the Admin ACL, can dr.who no longer ran a job in my yarn? :
... View more
06-03-2020
03:02 AM
Dr.who is running on my CDH 6.3, I've seen its crontab also using YARN user: I've already remove the files of this and I want to implement some restrictions using firewalld, how can I block this virus on running on my YARN 8088? do I need to block the 8088 port in all nodes? and what IP addresses do I need to insert for whitelisting? below is my current rules in firewalld: public target: default icmp-block-inversion: no interfaces: sources: services: dhcpv6-client ssh ports: 8042/tcp 7191/tcp 2181/tcp 3181/tcp 4181/tcp 9010/tcp 8044/tcp 8041/tcp 8040/tcp 8091/tcp 9091/tcp 9995/tcp 9994/tcp 7184/tcp 7185/tcp 8084/tcp 8087/tcp 9087/tcp 9999/tcp 9998/tcp 9867/tcp 9866/tcp 9864/tcp 9865/tcp protocols: masquerade: no forward-ports: source-ports: icmp-blocks: rich rules: rule family="ipv4" source address="195.3.146.118" reject Appreciate your help on this! thanks!
... View more
Labels:
- Labels:
-
Apache YARN
06-03-2020
02:55 AM
Hi @dipesh_mywork what do you mean you've blocked the 8088 port of YARN? also what iP's do you included on the whitelist? thanks for your reply! 🙂
... View more
06-02-2020
08:00 PM
Hi I've tried to implement firewall using the firewalld of my rhel7 server which is also our datanode, what rules and ports do I need to implement here so that the cloudera services is still functioning and will not block there connection? firewall-cmd --list-all public target: default icmp-block-inversion: no interfaces: sources: services: dhcpv6-client ssh ports: protocols: masquerade: no forward-ports: source-ports: icmp-blocks: rich rules:
... View more
Labels:
- Labels:
-
Cloudera Manager
05-28-2020
10:56 PM
Hi @paras i've tried including my group where my admin user reside and the user itself on sentry.service.admin.group. but still no luck. what do I need to input on sentry.service.admin.group? the user or the group where it belongs? I'm still getting the error of Unable to obtain groups to cloudera(which is my user)
... View more