Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

Multiple SLF4j binding error while running a SPARK job on YARN

Highlighted

Multiple SLF4j binding error while running a SPARK job on YARN

While running a Spark job I am running into this error on CDH 5.4.8 cluster:-

 

     SLF4J: Class path contains multiple SLF4J bindings.
     SLF4J: Found binding in [jar:file:/cdh/yarn/nm/filecache/74/spark-assembly-1.5.2-hadoop2.6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/cdh/opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
16/01/28 01:32:28 INFO yarn.ApplicationMaster: Registered signal handlers for [TERM, HUP, INT]
16/01/28 01:32:29 INFO yarn.ApplicationMaster: ApplicationAttemptId: appattempt_1453743558330_0179_000001
16/01/28 01:32:30 INFO spark.SecurityManager: Changing view acls to: yarn,cloud
16/01/28 01:32:30 INFO spark.SecurityManager: Changing modify acls to: yarn,cloud
16/01/28 01:32:30 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, cloud); users with modify permissions: Set(yarn, cloud)
16/01/28 01:32:30 INFO yarn.ApplicationMaster: Starting the user application in a separate Thread
16/01/28 01:32:30 INFO yarn.ApplicationMaster: Waiting for spark context initialization
16/01/28 01:32:30 INFO main.Main: Args:
16/01/28 01:32:30 INFO main.Main: Args : 0 : true
16/01/28 01:32:30 INFO main.Main: Args : 1 : 2
16/01/28 01:32:30 INFO main.Main: Args : 2 : hdfs://cdh54:8020/user/jars/config.properties
16/01/28 01:32:30 INFO main.Main: Args : 3 : http://10.206.146.177:9141/
16/01/28 01:32:30 INFO main.Main: Args : 4 : astroni
16/01/28 01:32:30 INFO yarn.ApplicationMaster: Waiting for spark context initialization ...
16/01/28 01:32:30 INFO file.HdfsFileProvider: Reading file : hdfs://cdh54:8020/user/jars/config.properties
16/01/28 01:32:31 INFO Remoting: Starting remoting
16/01/28 01:32:31 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriver@10.184.46.249:52005]
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.