06-07-2017 03:39 PM
I have flume sinks that access the database and filesystems. The connection parameters of these system change as I move from on env to other.
Current Implementation: Provide configuration file at flume start up using the flume configuration.
Java Configuration Options for Flume Agent -Dapp.config.file=hdfs://.../config.json
But I don't think its a good HDFS application.
Is there a way we can provide custom environment configuration at flume source channel sink configuration itself. I know we can provide above config at a sink level, but is there a way to provide it agent level and get the data in MycustomSink.java.
Please let me know if a better approach is available