https://community.cloudera.com/t5/Archives-of-Support-Questions/How-will-Apache-Calcite-be-integrated-into-Apache-NiFi/m-p/143549#M32189 <A rel="user" href="https://community.cloudera.com/users/9304/tspann.html" nodeid="9304">@Timothy Spann</A><P> there is a JIRA created for bringing Calcite into a NiFi processor - <A href="https://issues.apache.org/jira/browse/NIFI-1280" target="_blank">https://issues.apache.org/jira/browse/NIFI-1280</A>. The idea originally was to use it to filter out specific columns in incoming CSV data. However, as we looked at it, we found that there is a lot more that this can do! Initially, it will likely be used to simply run SQL over CSV data, with each incoming FlowFile being transformed into an outgoing FlowFile. Eventually, I would like to see additional data formats being introduced into this, so that SQL could be run over any number of different data formats to filter, transform, etc.</P> Fri, 17 Jun 2016 04:07:14 GMT mpayne 2016-06-17T04:07:14Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-will-Apache-Calcite-be-integrated-into-Apache-NiFi/m-p/143548#M32188 <P>How will Apache <A href="http://calcite.apache.org/">Calcite</A> be used to enhance Apache NiFi's SQL abilities?</P> Fri, 17 Jun 2016 03:23:09 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-will-Apache-Calcite-be-integrated-into-Apache-NiFi/m-p/143548#M32188 TimothySpann 2016-06-17T03:23:09Z https://community.cloudera.com/t5/Archives-of-Support-Questions/How-will-Apache-Calcite-be-integrated-into-Apache-NiFi/m-p/143549#M32189 <A rel="user" href="https://community.cloudera.com/users/9304/tspann.html" nodeid="9304">@Timothy Spann</A><P> there is a JIRA created for bringing Calcite into a NiFi processor - <A href="https://issues.apache.org/jira/browse/NIFI-1280" target="_blank">https://issues.apache.org/jira/browse/NIFI-1280</A>. The idea originally was to use it to filter out specific columns in incoming CSV data. However, as we looked at it, we found that there is a lot more that this can do! Initially, it will likely be used to simply run SQL over CSV data, with each incoming FlowFile being transformed into an outgoing FlowFile. Eventually, I would like to see additional data formats being introduced into this, so that SQL could be run over any number of different data formats to filter, transform, etc.</P> Fri, 17 Jun 2016 04:07:14 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/How-will-Apache-Calcite-be-integrated-into-Apache-NiFi/m-p/143549#M32189 mpayne 2016-06-17T04:07:14Z