NiFi Phoenix processor?

[#1]

Can can NiFi run Phoenix query using ExecuteSQL processor on kerberized cluster?

[#2]

It is work in progress:

https://issues.apache.org/jira/browse/NIFI-991

[#3]

You should be able to use the ExecuteSQL processor to extract data from Phoenix now. As Ted points out, the write-side is still a TBD.

[#4 · Accepted solution]

@Sunile Manjee, you can read and write to Phoenix from NiFi. You'll need to setup a DBConnectionPool ControllerService (click the Wrench/ScrewDriver icon on the top right) pointing to the phoenix-client.jar.

Then you can use ExecuteSQL for reads.

To write, the following pattern works: ConvertAttributesToJSON->ConvertJSONToSQL in Insert mode->ReplaceText to replace "INSERT" with "UPSERT" -> PutSQL.

For details on connecting to Phoenix on a Kerberized cluster, see the instructions at phoenix.apache.org (use your browser's search/find feature, Kerberos details are about 1/3 the way down the page).

[#5]

@Ted Yu pointed out the challenge. I hope to test your work around. thank you

[#6]

If I insert a string containing 'or "or, PutSQL to Phoenix will be submitted to the grammatical errors, this should be how to solve?

[#7]

Hi @kettle 

As this thread was marked 'Solved' in June of 2016 you would have a better chance of receiving a useful response by starting a new thread. This will also provide you with the opportunity to provide details specific to your use of the PutSQL processor and/or Phoenix that could aid others in providing a more tailored answer to your question. 

[#8]

Thank you all for awesome knowledge share.

[#9]

this works

https://community.hortonworks.com/content/kbentry/54947/reading-opendata-json-and-storing-into-phoen...

[#10]

Does this work with kerberos ?