Reply
Highlighted
PNS
Explorer
Posts: 38
Registered: ‎05-20-2014

Logging overhead

Hi...

 

Is there any way of reducing the logging overhead of the Kite SDK (e.g., by placing a dedicated log4j.properties file somewhere in the classpath)?

 

For example, in a morphline with multiple tryRules to parse events matching different regexes, we get tons of messages per event, like

 

15/10/02 12:35:35,200 WARN Thread-11 TryRulesBuilder$TryRules: tryRules command found no successful rule

Can this be avoided?

 

Thanks.

 

Cloudera Employee
Posts: 146
Registered: ‎08-21-2013

Re: Logging overhead

Yes, try loading a different log4j.properties file with custom log level directives, e.g. via the --log4j CLI option in MapReduceIndexerTool, or similar.

Wolfgang.

Announcements
The Kite SDK is a collection of docs, sample code, APIs, and tools to make Hadoop application development faster. Learn more at http://kitesdk.org.