How do I suppress INFO and WARNING messages when reading and writing to HDFS

Question

How to suppress below INFO and WARNING messages using log4j.properties

log4j:WARN No appenders could be found for logger (com.ibm.connect.shadow.parquet.crypto.EncryptionPropertiesFactory).

log4j:WARN Please initialize the log4j system properly.

log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new compressor [.snappy]

srmitta · Accepted Answer

Hi Arun

Seeing this Information warnings on client side, created log4j.properties file on client and added properties what you suggested and passed log4j.properties file using -Dlog4j.configuration to client application, this didn't help, still seeing messages.

Only way I could stop that message is by setting .level = SEVERE in IBM JDK logging.properties file. Wondering if there is another way I could stop this message without making changes to logging.properties file.

Thanks

Srinivasa

arunek95 · Answer

Hi Srmitta,In my lab I cannot see any warn or info while doing hadoop commands. Please try the below setting in the hdfs-log4j : hadoop.root.logger=INFO,WARN,consolehadoop.log.dir=.hadoop.log.file=hadoop.log

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.