question Re: PutHiveQL Processor function in NIFI in Support Questions

PutHiveQL Processor function in NIFI

suman_gupta2 — Fri, 09 Sep 2016 20:06:37 GMT

Hi,

I noticed that the only configurable part in PutHiveQL processor is Hive Database Connection Pooling Service Name. And this needs to be setup as a controller service. So i'm wondering where to mention the actual insert statement or query which will do the job. Does this imply that there has to be other processor preceding to it with a means to generate insert queries that are specific to where and how we want the data in Hive and is fed to this processor as flowfiles?

Re: PutHiveQL Processor function in NIFI

andrewg — Fri, 09 Sep 2016 20:10:23 GMT

Sam, the statements should be in the flowfile content/payload. Please see https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.hive.PutHiveQL/index.html

Also, it's not limited to INSERT statements only, any Hive DDL will be executed by this processor as well. This becomes very useful for creating new partitions in a table, etc.

Re: PutHiveQL Processor function in NIFI

suman_gupta2 — Tue, 13 Sep 2016 11:37:42 GMT

@Andrew Grande

Thanks for the clarification.