Member since
10-01-2018
802
Posts
143
Kudos Received
130
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3072 | 04-15-2022 09:39 AM | |
| 2475 | 03-16-2022 06:22 AM | |
| 6554 | 03-02-2022 09:44 PM | |
| 2907 | 03-02-2022 08:40 PM | |
| 1916 | 01-05-2022 07:01 AM |
12-28-2020
05:54 AM
@TGH No, Cloudera manager will not adjust resources automatically whatever you will set per service base will be used by CM and services in the cluster.
... View more
12-28-2020
05:52 AM
@SPARK_LEARN Below doc can help you. https://docs.cloudera.com/documentation/enterprise/5-9-x/topics/operation_spark_applications.html https://spark.apache.org/docs/1.6.0/monitoring.html
... View more
12-28-2020
05:24 AM
@kimanore For the Error snippet you mentioned is related with permission which seems fixed as you said [1]. However for the cannery test you have to see the logs, also you mentioned that you forget to stop cluster I guess that's okay you can still make this workable. [1] These step can also fit that. a) Namenode => Actions => Format
b) For JobHistory:
===> All you need to do is:
kinit as hdfs if Kerberized
or
sudo -u hdfs hdfs dfs -mkdir -p /user/history/done [2] hdfs dfs -mkdir /user
hdfs dfs -mkdir /user/history
hdfs dfs -mkdir /tmp
hdfs dfs -mkdir /tmp/logs
hdfs dfs -chown mapred:mapred /user/history
hdfs dfs -chown mapred:mapred /tmp/logs
... View more
12-28-2020
05:13 AM
@syedshakir This is most probably ssh is not setup properly. You can try below steps. On the Oozie Server host run the command: ps -ef| grep oozie Identify the user that runs the Oozie server. For example, the user is oozie Modify /etc/passwd file to edit the user oozie Change: oozie:x:485:483:Oozie User:/var/lib/oozie:/bin/false to: oozie:x:485:483:Oozie User:/var/lib/oozie:/bin/bash Note: This will enable the user oozie to login. In the command prompt switch user as oozie: su - oozie Verify that the user is switched by executing the command: id Execute ssh-keygen: Note:Do not give any password. This generates Public and Private Key for passwordless authentication and saves it in the Oozie user's home directory. ssh-keygen Execute ssh-copy-id to copy the public key to user’s home directory in the remote host. This user will be the one that runs ssh commands in remote host: ssh-copy-id -i /home/oozie/.ssh/id_rsa.pub cloudera@example.local.com Test by executing ssh without a password to confirm a successful authentication: ssh cloudera@example.local.com Run the Oozie workflow and verify success.
... View more
12-22-2020
10:37 AM
@Raj77 The most potential error message is this: OSError: Cannot initialize new instance of inotify, Errno=Too many open files (EMFILE) This states that there are so many open file descriptor so that agent is not able to handle this. One easy way to mitigate this by hard stop/start agent using the doc. Then comes to the second error about DnsTest. [17/Dec/2020 11:31:05 +0000] 9333 DnsResolutionMonitor throttling_logger ERROR Failed to run DnsTest. This seems and issue with your java installation most probably you should remove offending packages (mostly openjdk) from the host and some broken (zero bytes or red) alternatives from /var/lib/alternatives and /etc/alternatives, and restart the CM agent.
... View more
12-20-2020
06:24 AM
@Mondi you can follow below doc for reference. All you have to do is modify the db.properties file and point to the server which is having CM DB installed. https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ig_mysql.html#cmig_topic_5_5
... View more
12-17-2020
01:43 PM
Thanks @GangWar for referenced links I will go through it.
... View more
12-16-2020
03:40 AM
@Prav_kumar Yes you can but since you are going to upgrade in Feb to 6.3.4 it's purely your decision to choose what is most feasible path. Just a tip make sure to read the release notes and known issue of the respective version you are Upgrading to make better decision.
... View more
12-11-2020
03:22 PM
@Yuriy_but The answer is very simple you have logging in as admin user in hue and admin has no HDFS home directory. there are 2-ways delegate the HDFS home directory creation to HUE by checking Create a home directory in HUE Users--->AddSync LDAP User username=admin [search]
Distinguished Name = unchecked
Create home directory= checked or as the HDFS user $ hdfs dfs -mkdir /user/admin Change permissions $ hdfs dfs -chown admin /user/admin Now when you log in HUE you should get any issues please let me know
... View more
12-11-2020
09:32 AM
1 Kudo
Yes you need a subscription to access.
... View more