question Re: Where is the log4j.properties that Flume uses? in Support Questions

Where is the log4j.properties that Flume uses?

laurenryan — Fri, 16 Sep 2022 09:15:03 GMT

Perhaps a silly question, but I cannot seem to find where Cloudera Manager's Flume service gets it log4j.properties from. I'm currently just looking at the quickstart vm. I can see the "Agent Logging Advanced Configuration Snippet (Safety Valve)" and have been able to change some configuration from there, but I'd like to see what the whole file looks like.

All the flume log4j.properties files I can find on the vm don't seem to have any effect on my flume agent and they are all completely different than what it looks like I'm editing.

Could someone point out what I'm missing here?

Re: Where is the log4j.properties that Flume uses?

laurenryan — Thu, 11 Dec 2014 20:35:47 GMT

Okay. Thanks to this post I found copies of it in the /var/run/cloudera-scm-agent/process/... directory. Not what I was hoping for but at least I can see how it's configured.

Re: Where is the log4j.properties that Flume uses?

GautamG — Thu, 11 Dec 2014 22:41:51 GMT

http://blog.cloudera.com/blog/2013/07/how-does-cloudera-manager-work/

This blog entry explains some of the design and logic behind how Cloudera Manager works. It should help with some of the questions in your post.

Re: Where is the log4j.properties that Flume uses?

laurenryan — Fri, 12 Dec 2014 18:09:04 GMT

Thanks for the link Gautam. That does help a bit, but I still don't know where cloudera manager is getting its template for the log4j.properties that each flume agent uses in the first place! Could anyone tell me if it possible to edit the "source" log4j.properties directly? So that the safety valves will use the log4j.properties that I created rather than Cloudera Manager's?

Re: Where is the log4j.properties that Flume uses?

GautamG — Mon, 15 Dec 2014 02:58:04 GMT

The template is probably part of the build and might need a rebuild to change.

However, I am not sure I understand the problem you're trying to solve. What about the current log4j.properties did you want to change?

Re: Where is the log4j.properties that Flume uses?

laurenryan — Mon, 15 Dec 2014 15:59:43 GMT

Not necessarily any problem, just experimenting with cloudera manager and our deployment options, etc. Thanks Gautam, that answers my question!

Re: Where is the log4j.properties that Flume uses?

Bhairav — Fri, 10 Apr 2015 17:27:33 GMT

Hi Gautam,

Could you please let me know the location of this log4j.properties file, so that I can apply custom settings for my flume application.

Thanks

Bhairav

Countertack

Re: Where is the log4j.properties that Flume uses?

ClouderaAik — Sun, 17 Apr 2016 11:20:46 GMT

Are you talking about the log4j file which are used by flume agents? If yes, they are at /etc/flume-ng/conf folder?