Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Flume + Knox

avatar

Is it possible to execute flume agent outside hadoop network using Knox gateway + WebHDFS?

I found this JIRA (https://issues.apache.org/jira/browse/FLUME-2701), but it's not resolved yet.

A workaround I found would be to mount hdfs/nfs in flume-agent remote node and use File Roll Sink to this nfs/hdfs directory, but it does not seem be a good approach.

1 ACCEPTED SOLUTION

avatar

@Artem Ervits

I'm using workaround describe above (flume file roll to a nfs/hdfs mount dir) so far.

View solution in original post

4 REPLIES 4

avatar
Master Mentor
@Guilherme Braccialli

You may want to open a jira for this.

avatar
Master Mentor

avatar
Master Mentor

@Guilherme Braccialli what did you end up using? Please post your solution.

avatar

@Artem Ervits

I'm using workaround describe above (flume file roll to a nfs/hdfs mount dir) so far.