question Re: How do I suppress INFO and WARNING messages when reading and writing to HDFS in Support Questions

How do I suppress INFO and WARNING messages when reading and writing to HDFS

srmitta — Sun, 14 Nov 2021 14:26:39 GMT

How to suppress below INFO and WARNING messages using log4j.properties

log4j:WARN No appenders could be found for logger (com.ibm.connect.shadow.parquet.crypto.EncryptionPropertiesFactory).

log4j:WARN Please initialize the log4j system properly.

log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new compressor [.snappy]

Re: How do I suppress INFO and WARNING messages when reading and writing to HDFS

arunek95 — Mon, 15 Nov 2021 10:38:01 GMT

Hi Srmitta,

In my lab I cannot see any warn or info while doing hadoop commands. Please try the below setting in the hdfs-log4j :

hadoop.root.logger=INFO,WARN,console
hadoop.log.dir=.
hadoop.log.file=hadoop.log

Re: How do I suppress INFO and WARNING messages when reading and writing to HDFS

VidyaSargur — Thu, 18 Nov 2021 05:19:24 GMT

@srmitta, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.

Re: How do I suppress INFO and WARNING messages when reading and writing to HDFS

srmitta — Thu, 18 Nov 2021 13:13:15 GMT

Hi Arun

Seeing this Information warnings on client side, created log4j.properties file on client and added properties what you suggested and passed log4j.properties file using -Dlog4j.configuration to client application, this didn't help, still seeing messages.

Only way I could stop that message is by setting .level = SEVERE in IBM JDK logging.properties file. Wondering if there is another way I could stop this message without making changes to logging.properties file.

Thanks

Srinivasa

Re: How do I suppress INFO and WARNING messages when reading and writing to HDFS

arunek95 — Mon, 13 Dec 2021 07:00:19 GMT

Hi Srinivasa, As this is a 3rd party application I am not really sure about it. Glad that currently you have a property that help in achieving the goal.