question NiFi Phoenix processor? in Support Questions

NiFi Phoenix processor?

sunile_manjee — Sat, 18 Jun 2016 08:33:40 GMT

Can can NiFi run Phoenix query using ExecuteSQL processor on kerberized cluster?

Re: NiFi Phoenix processor?

tyu — Sat, 18 Jun 2016 19:59:13 GMT

It is work in progress:

https://issues.apache.org/jira/browse/NIFI-991

Re: NiFi Phoenix processor?

elserj — Sun, 19 Jun 2016 06:09:09 GMT

You should be able to use the ExecuteSQL processor to extract data from Phoenix now. As Ted points out, the write-side is still a TBD.

Re: NiFi Phoenix processor?

rgelhausen — Sun, 19 Jun 2016 06:16:54 GMT

@Sunile Manjee, you can read and write to Phoenix from NiFi. You'll need to setup a DBConnectionPool ControllerService (click the Wrench/ScrewDriver icon on the top right) pointing to the phoenix-client.jar.

Then you can use ExecuteSQL for reads.

To write, the following pattern works: ConvertAttributesToJSON->ConvertJSONToSQL in Insert mode->ReplaceText to replace "INSERT" with "UPSERT" -> PutSQL.

For details on connecting to Phoenix on a Kerberized cluster, see the instructions at phoenix.apache.org (use your browser's search/find feature, Kerberos details are about 1/3 the way down the page).

Re: NiFi Phoenix processor?

sunile_manjee — Sun, 19 Jun 2016 09:48:38 GMT

Thank you all for awesome knowledge share.

Re: NiFi Phoenix processor?

sunile_manjee — Sun, 19 Jun 2016 09:49:38 GMT

@Ted Yu pointed out the challenge. I hope to test your work around. thank you

Re: NiFi Phoenix processor?

TimothySpann — Sat, 24 Sep 2016 03:28:55 GMT

this works

https://community.hortonworks.com/content/kbentry/54947/reading-opendata-json-and-storing-into-phoenix-tab.html

Re: NiFi Phoenix processor?

nbalaji-elangov — Wed, 01 Mar 2017 08:44:33 GMT

Does this work with kerberos ?

Re: NiFi Phoenix processor?

kettle — Sat, 16 May 2020 01:53:45 GMT

If I insert a string containing 'or "or, PutSQL to Phoenix will be submitted to the grammatical errors, this should be how to solve?

Re: NiFi Phoenix processor?

ask_bill_brooks — Mon, 18 May 2020 03:41:33 GMT

Hi @kettle

As this thread was marked 'Solved' in June of 2016 you would have a better chance of receiving a useful response by starting a new thread. This will also provide you with the opportunity to provide details specific to your use of the PutSQL processor and/or Phoenix that could aid others in providing a more tailored answer to your question.