Support Questions
Find answers, ask questions, and share your expertise

PutHiveQL Processor function in NIFI

Solved Go to solution
Highlighted

PutHiveQL Processor function in NIFI

Hi,

I noticed that the only configurable part in PutHiveQL processor is Hive Database Connection Pooling Service Name. And this needs to be setup as a controller service. So i'm wondering where to mention the actual insert statement or query which will do the job. Does this imply that there has to be other processor preceding to it with a means to generate insert queries that are specific to where and how we want the data in Hive and is fed to this processor as flowfiles?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: PutHiveQL Processor function in NIFI

Sam, the statements should be in the flowfile content/payload. Please see https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.hive.PutHiveQL/index.ht...

Also, it's not limited to INSERT statements only, any Hive DDL will be executed by this processor as well. This becomes very useful for creating new partitions in a table, etc.

View solution in original post

2 REPLIES 2
Highlighted

Re: PutHiveQL Processor function in NIFI

Sam, the statements should be in the flowfile content/payload. Please see https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.hive.PutHiveQL/index.ht...

Also, it's not limited to INSERT statements only, any Hive DDL will be executed by this processor as well. This becomes very useful for creating new partitions in a table, etc.

View solution in original post

Highlighted

Re: PutHiveQL Processor function in NIFI

@Andrew Grande

Thanks for the clarification.