Member since
11-07-2017
6
Posts
0
Kudos Received
0
Solutions
10-31-2018
03:45 AM
Wow! That's very informative contribution, thank you for solving one of my long lasting questions about CDH. The screenshot will be helpfull too, not only for me, but for all community members. Thanks a million!
... View more
10-31-2018
02:55 AM
Hello @mbalassi, thank you very much for your reply, but I still have some doubts regarding this feature. I've just upgraded CDH5.9 to 5.11 and after that I don't see any 'previous' directory in Namenodes' Data Directories, neither in Datanodes data directories. Cloudera's documentation suggests this action is required only if you upgrade CDH version 5.0, 5.1 or 5.2: https://www.cloudera.com/documentation/enterprise/5-11-x/PDF/cloudera-upgrade.pdf Similarly -upgradeProgress subcommand is unavailable in hadodp dfsadmin command in my current CDH installation. My guess is that Cloudera doesn't support this mechanism and keeps it only for compliance with older versions. Do you think it's correct assumption?
... View more
11-30-2017
05:20 AM
Hi!
I've just finished CDH upgrade with help of Cloudera Manager. Do you know what is the result of 'Finalize Metadata Update' NameNode's option after successful upgrade? I've used this option, but it's still enabled. How can I confirm that upgrade is finalized?
Provided that upgrade is not finalized yet - is there a rollback/downgrade path in case of problems with HDFS? Is it available in any configuration or only if rolling upgrade (HA and Cloudera Enterprise in place) is carried out?
... View more
Labels:
- Labels:
-
Cloudera Manager
-
HDFS
-
Manual Installation
11-23-2017
12:37 AM
Hi Ben, Thank you very much for your explanations. Especially I appreciated your clarification about service/client configuration difference and how to enable client configuration for yarn. It solves my issue, thanks a million. Regards, Sz
... View more
11-22-2017
07:38 AM
Hi, I've just realized there is a difference in configuration of alternatives functionality between Datanodes and the NameNode. NameNode: alternatives --display hadoop-conf hadoop-conf - status is auto. link currently points to /etc/hadoop/conf.cloudera.hdfs /etc/hadoop/conf.cloudera.hdfs - priority 90 /opt/cloudera/parcels/CDH-5.7.0-1.cdh5.7.0.p0.45/etc/hadoop/conf.empty - priority 10 Current `best' version is /etc/hadoop/conf.cloudera.hdfs. DataNode: alternatives --display hadoop-conf hadoop-conf - status is auto. link currently points to /etc/hadoop/conf.cloudera.yarn /opt/cloudera/parcels/CDH-5.7.0-1.cdh5.7.0.p0.45/etc/hadoop/conf.empty - priority 10 /etc/hadoop/conf.cloudera.yarn - priority 92 /etc/hadoop/conf.cloudera.hdfs - priority 90 Current `best' version is /etc/hadoop/conf.cloudera.yarn On NameNode I see directory /etc/hadoop/conf.cloudera.yarn but it seems to be unused. For example, even though yarn.resourcemanager.address is set correctly in /etc/hadoop/conf.cloudera.yarn/yarn-site.xml I receive: INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) when I try 'yarn application -list' from NameNode, and correct results when I try from DataNodes. Is it expected behaviour? Has anybody hit this problem before?
... View more
Labels:
- Labels:
-
Apache YARN
-
Cloudera Manager
-
HDFS