question Flume + Knox in Archives of Support Questions (Read Only)

Flume + Knox

gbraccialli3 — Tue, 29 Dec 2015 23:44:10 GMT

Is it possible to execute flume agent outside hadoop network using Knox gateway + WebHDFS?

I found this JIRA (https://issues.apache.org/jira/browse/FLUME-2701), but it's not resolved yet.

A workaround I found would be to mount hdfs/nfs in flume-agent remote node and use File Roll Sink to this nfs/hdfs directory, but it does not seem be a good approach.

Re: Flume + Knox

nsabharwal — Sun, 17 Jan 2016 10:31:17 GMT

@Guilherme Braccialli

You may want to open a jira for this.

Re: Flume + Knox

nsabharwal — Sun, 31 Jan 2016 20:52:56 GMT

@Kevin Minder

Re: Flume + Knox

aervits — Tue, 02 Feb 2016 23:23:26 GMT

@Guilherme Braccialli what did you end up using? Please post your solution.

Re: Flume + Knox

gbraccialli3 — Wed, 17 Feb 2016 19:54:54 GMT

@Artem Ervits

I'm using workaround describe above (flume file roll to a nfs/hdfs mount dir) so far.