yarn scmadmin will not connect to resoucemanager or namenode, ignores -fs / -jt
Even if -jt or -fs is specified, it is seemingly ignored:
17/05/15 09:48:03 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8047. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=50, sleepTime=1000 MILLISECONDS)
Search on "server".
If the generic options are not really supported, they are being parsed/shown incorrectly
[mtdeguzis@gdchdpmn02drlx ~]$ yarn scmadmin Usage: yarn scmadmin [-runCleanerTask] [-help [cmd]] Generic options supported are -conf <configuration file> specify an application configuration file -D <property=value> use value for given property -fs <local|namenode:port> specify a namenode -jt <local|resourcemanager:port> specify a ResourceManager -files <comma separated list of files> specify comma separated files to be copied to the map reduce cluster -libjars <comma separated list of jars> specify comma separated jar files to include in the classpath. -archives <comma separated list of archives> specify comma separated archives to be unarchived on the compute machines. The general command line syntax is bin/hadoop command [genericOptions] [commandOptions]
When you are using scadmin command, this means your try to Access Shared Cache Manager,
To do that make that, make sure that the machine from where you are yarn-site.xml contains yarn.sharedcache.admin.address (the default is 0.0.0.0:8047) property defined.
From Error log you posted, it seems your configuration does not provide yarn.sharedcache.admin.address, so it is trying to connect to default shared cache manager address (i.e. 0.0.0.0:8047).
Using -fs/-jt will not work here , -fs is used for providing fs.defaultFS option on command line, similarly -jt is option used to provide Resource manager added on CLI as generic toption
To provide yarn.sharedcache.admin.address, you can try to yarn generic CLI as following alsotry :
yarn scadmin -Dyarn.sharedcache.admin.address=<sharedcachemanager address:port>
I don't believe our site has "yarn.sharedcache.admin.address". Is this a manual addition, or is there a graceful way to set this up? Documentation link?