Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

yarn scmadmin will not connect to resoucemanager or namenode, ignores -fs / -jt

yarn scmadmin will not connect to resoucemanager or namenode, ignores -fs / -jt

New Contributor

yarn scmadmin will not connect to resoucemanager or namenode, ignores -fs / -jt

Even if -jt or -fs is specified, it is seemingly ignored:

17/05/15 09:48:03 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8047. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=50, sleepTime=1000 MILLISECONDS)

Relevant code:

Search on "server".

https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/ap...

https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/m...

If the generic options are not really supported, they are being parsed/shown incorrectly

[mtdeguzis@gdchdpmn02drlx ~]$ yarn scmadmin
Usage: yarn scmadmin
           [-runCleanerTask]
           [-help [cmd]]
Generic options supported are
-conf <configuration file>     specify an application configuration file
-D <property=value>            use value for given property
-fs <local|namenode:port>      specify a namenode
-jt <local|resourcemanager:port>    specify a ResourceManager
-files <comma separated list of files>    specify comma separated files to be copied to the map reduce cluster
-libjars <comma separated list of jars>    specify comma separated jar files to include in the classpath.
-archives <comma separated list of archives>    specify comma separated archives to be unarchived on the compute machines.
The general command line syntax is
bin/hadoop command [genericOptions] [commandOptions]

https://github.com/apache/hadoop/blob/373bb4931fb392e3ca6bfd78992887e5a405e186/hadoop-common-project...

2 REPLIES 2

Re: yarn scmadmin will not connect to resoucemanager or namenode, ignores -fs / -jt

New Contributor

Hello @MichaelDeGuz

When you are using scadmin command, this means your try to Access Shared Cache Manager,

To do that make that, make sure that the machine from where you are yarn-site.xml contains yarn.sharedcache.admin.address (the default is 0.0.0.0:8047) property defined.

From Error log you posted, it seems your configuration does not provide yarn.sharedcache.admin.address, so it is trying to connect to default shared cache manager address (i.e. 0.0.0.0:8047).

Using -fs/-jt will not work here , -fs is used for providing fs.defaultFS option on command line, similarly -jt is option used to provide Resource manager added on CLI as generic toption

To provide yarn.sharedcache.admin.address, you can try to yarn generic CLI as following alsotry :

yarn scadmin -Dyarn.sharedcache.admin.address=<sharedcachemanager address:port>

Re: yarn scmadmin will not connect to resoucemanager or namenode, ignores -fs / -jt

New Contributor

I don't believe our site has "yarn.sharedcache.admin.address". Is this a manual addition, or is there a graceful way to set this up? Documentation link?

Don't have an account?
Coming from Hortonworks? Activate your account here