Welcome to the Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

Multiple SLF4j binding error while running a SPARK job on YARN

avatar
Contributor

While running a Spark job I am running into this error on CDH 5.4.8 cluster:-

 

     SLF4J: Class path contains multiple SLF4J bindings.
     SLF4J: Found binding in [jar:file:/cdh/yarn/nm/filecache/74/spark-assembly-1.5.2-hadoop2.6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/cdh/opt/cloudera/parcels/CDH-5.4.8-1.cdh5.4.8.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
16/01/28 01:32:28 INFO yarn.ApplicationMaster: Registered signal handlers for [TERM, HUP, INT]
16/01/28 01:32:29 INFO yarn.ApplicationMaster: ApplicationAttemptId: appattempt_1453743558330_0179_000001
16/01/28 01:32:30 INFO spark.SecurityManager: Changing view acls to: yarn,cloud
16/01/28 01:32:30 INFO spark.SecurityManager: Changing modify acls to: yarn,cloud
16/01/28 01:32:30 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, cloud); users with modify permissions: Set(yarn, cloud)
16/01/28 01:32:30 INFO yarn.ApplicationMaster: Starting the user application in a separate Thread
16/01/28 01:32:30 INFO yarn.ApplicationMaster: Waiting for spark context initialization
16/01/28 01:32:30 INFO main.Main: Args:
16/01/28 01:32:30 INFO main.Main: Args : 0 : true
16/01/28 01:32:30 INFO main.Main: Args : 1 : 2
16/01/28 01:32:30 INFO main.Main: Args : 2 : hdfs://cdh54:8020/user/jars/config.properties
16/01/28 01:32:30 INFO main.Main: Args : 3 : http://10.206.146.177:9141/
16/01/28 01:32:30 INFO main.Main: Args : 4 : astroni
16/01/28 01:32:30 INFO yarn.ApplicationMaster: Waiting for spark context initialization ...
16/01/28 01:32:30 INFO file.HdfsFileProvider: Reading file : hdfs://cdh54:8020/user/jars/config.properties
16/01/28 01:32:31 INFO Remoting: Starting remoting
16/01/28 01:32:31 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriver@10.184.46.249:52005]
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.

Who agreed with this topic