easy to integrate NiFi -> Kafka -> Spark or Storm or Flink or APEX Also NiFi -> S2s -> Spark / Flink / ... ... View more

Hi! Nice example of Nifi integration I encountered a problem doing the same thing with HDP sandox 2.5 I get this error message on zeppelin <console>:11: error: identifier expected but ',' found. time struct<millis:bigint>, Do you import more librairies before ? ... View more

Yes, I'm thinking using ExecuteScript, jedis and Groovy, should be straight forward ... View more

May I know the fix for this error? ... View more

is there an update for 2.4? ... View more

@Alex Coast The 5 minute retention of Bulletins is a hard coded value that cannot be edited by the end user. It is normal to see the occasional bulletin from some NiFi processors. For example a failed putSFTP because of filename conflict or network issues, but on retry it is successful. A continuous problem would result in non stop bulletins being produced which would be easily noticed. - Take a look at my response further up on using the "SiteToSiteBulletinReportingTask" if you are looking to retain bulletins info longer, manipulate, route, store that somewhere, etc.. - Thank you, Matt - If you found this answer addressed your question, please take a moment to login in and click the "ACCEPT" link. ... View more

https://community.hortonworks.com/articles/149910/handling-hl7-records-part-1-hl7-ingest.html https://community.hortonworks.com/articles/149891/handling-hl7-records-and-storing-in-apache-hive-fo.html https://community.hortonworks.com/articles/149982/hl7-ingest-part-4-streaming-analytics-manager-and.html https://community.hortonworks.com/articles/150026/hl7-processing-part-3-apache-zeppelin-sql-bi-and-a.html Attribute Name Cleaner (Needed for messy C-CDA and HL7 attribute names) https://github.com/tspannhw/nifi-attributecleaner-processor ... View more

Avro 1.8.2 is now available ... View more

core-site has worked for me ... View more

ORC is considering adding a faster decompression in 2016 - zstd (ZStandard). The enum values for that has already been reserved, but until we work through the trade-offs involved in ZStd - more on that sometime later this year. https://issues.apache.org/jira/browse/ORC-46 But bigger wins are in motion for ORC with LLAP, the in-memory format for LLAP isn't compressed at all - so it performs like ORC without compression overheads, while letting the cold data on disk sit around in Zlib. ... View more