question Re: Flume 1.6 in HDP? in Archives of Support Questions (Read Only)

Flume 1.6 in HDP?

vromeo — Wed, 07 Sep 2016 02:38:12 GMT

Any word on when Flume 1.6 is likely be rolled into HDP?

I haven't switched to 2.5.0 yet, but was disappointed to see the release notes indicate flume 1.5.2 is still the latest in HDP 2.5 even tho flume 1.6 has been out for over a year....

Re: Flume 1.6 in HDP?

aervits — Wed, 07 Sep 2016 05:35:48 GMT

What features are you looking for in Flume 1.6? We backported a few things from 1.6 into 1.5.2 like Kafka channel and some security enhancements, these will appear in 2.5 even though Flume version does not change from HDP 2.4.

Re: Flume 1.6 in HDP?

bandalora — Thu, 08 Sep 2016 01:18:09 GMT

Feature updates that were added to Flume 1.5.2 with HDP releases are now listed in the introduction to the Flume documentation. See http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_flume-component-guide/content/flume_features.html for the list of major added features.

Re: Flume 1.6 in HDP?

vromeo — Thu, 08 Sep 2016 02:37:35 GMT

Looks like the features I was after have been back-ported. It gets confusing when the primary documentation hortonworks points users to is the Apache docs, which states these features are in 1.6...

I don't understand why hwx seems to be avoiding 1.6.

Re: Flume 1.6 in HDP?

bandalora — Thu, 08 Sep 2016 03:57:38 GMT

@Vincent Romeo, I can't answer your question about why 1.5.2 vs 1.6, but tech docs will continue to track any backported functionality in the new 1.5.2 "cover" document.

As I encounter pointers in Hortonworks info that link to the Apache 1.6 documentation, I'm trying to replace them with pointers to the 1.5.2 documentation, to reduce confusion. If you are aware of any links in Hortonworks content (website, documentation, tutorials, etc.) that should redirect to 1.5.2, I'd appreciate knowing about them if you'd care to share. Thanks!

Re: Flume 1.6 in HDP?

rishit606 — Sat, 17 Dec 2016 19:33:34 GMT

hi, is hive streaming support present in flume 1.5.2?

Re: Flume 1.6 in HDP?

aervits — Sat, 17 Dec 2016 22:33:43 GMT

Yes, please see http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_flume-component-guide/content/flume_features.html

Re: Flume 1.6 in HDP?

david_dobbins — Fri, 26 Jan 2018 00:56:21 GMT

I am also curious about when flume 1.6 (or later) will be included in HDP. Specifically looking for Kerberos support for ThriftSource. Thanks!