Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Can we pass environment configuration at an agent level in Flume?

Highlighted

Can we pass environment configuration at an agent level in Flume?

Explorer

I have flume sinks that access the database and filesystems. The connection parameters of these system change as I move from on env to other.

Current Implementation: Provide configuration file at flume start up using the flume configuration.

Java Configuration Options for Flume Agent 
-Dapp.config.file=hdfs://.../config.json

But I don't think its a good HDFS application.

Is there a way we can provide custom environment configuration at flume source channel sink configuration itself. I know we can provide above config at a sink level, but is there a way to provide it agent level and get the data in MycustomSink.java.

 

Please let me know if a better approach is available