Support Questions

Find answers, ask questions, and share your expertise

Flume + Knox

avatar

Is it possible to execute flume agent outside hadoop network using Knox gateway + WebHDFS?

I found this JIRA (https://issues.apache.org/jira/browse/FLUME-2701), but it's not resolved yet.

A workaround I found would be to mount hdfs/nfs in flume-agent remote node and use File Roll Sink to this nfs/hdfs directory, but it does not seem be a good approach.

1 ACCEPTED SOLUTION

avatar

@Artem Ervits

I'm using workaround describe above (flume file roll to a nfs/hdfs mount dir) so far.

View solution in original post

4 REPLIES 4

avatar
Master Mentor
@Guilherme Braccialli

You may want to open a jira for this.

avatar
Master Mentor

avatar
Master Mentor

@Guilherme Braccialli what did you end up using? Please post your solution.

avatar

@Artem Ervits

I'm using workaround describe above (flume file roll to a nfs/hdfs mount dir) so far.