Reply
Highlighted
Explorer
Posts: 8
Registered: ‎06-05-2015

Can we pass environment configuration at an agent level in Flume?

I have flume sinks that access the database and filesystems. The connection parameters of these system change as I move from on env to other.

Current Implementation: Provide configuration file at flume start up using the flume configuration.

Java Configuration Options for Flume Agent 
-Dapp.config.file=hdfs://.../config.json

But I don't think its a good HDFS application.

Is there a way we can provide custom environment configuration at flume source channel sink configuration itself. I know we can provide above config at a sink level, but is there a way to provide it agent level and get the data in MycustomSink.java.

 

Please let me know if a better approach is available

Announcements
New solutions