Support Questions

Find answers, ask questions, and share your expertise

NiFi Phoenix processor?

avatar
Master Guru

Can can NiFi run Phoenix query using ExecuteSQL processor on kerberized cluster?

1 ACCEPTED SOLUTION

avatar

@Sunile Manjee, you can read and write to Phoenix from NiFi. You'll need to setup a DBConnectionPool ControllerService (click the Wrench/ScrewDriver icon on the top right) pointing to the phoenix-client.jar.

Then you can use ExecuteSQL for reads.

To write, the following pattern works: ConvertAttributesToJSON->ConvertJSONToSQL in Insert mode->ReplaceText to replace "INSERT" with "UPSERT" -> PutSQL.

For details on connecting to Phoenix on a Kerberized cluster, see the instructions at phoenix.apache.org (use your browser's search/find feature, Kerberos details are about 1/3 the way down the page).

View solution in original post

9 REPLIES 9

avatar
Master Collaborator

avatar
Super Guru

You should be able to use the ExecuteSQL processor to extract data from Phoenix now. As Ted points out, the write-side is still a TBD.

avatar

@Sunile Manjee, you can read and write to Phoenix from NiFi. You'll need to setup a DBConnectionPool ControllerService (click the Wrench/ScrewDriver icon on the top right) pointing to the phoenix-client.jar.

Then you can use ExecuteSQL for reads.

To write, the following pattern works: ConvertAttributesToJSON->ConvertJSONToSQL in Insert mode->ReplaceText to replace "INSERT" with "UPSERT" -> PutSQL.

For details on connecting to Phoenix on a Kerberized cluster, see the instructions at phoenix.apache.org (use your browser's search/find feature, Kerberos details are about 1/3 the way down the page).

avatar
Master Guru

@Ted Yu pointed out the challenge. I hope to test your work around. thank you

avatar
New Contributor

If I insert a string containing 'or "or, PutSQL to Phoenix will be submitted to the grammatical errors, this should be how to solve?

avatar

Hi @kettle 

 

As this thread was marked 'Solved' in June of 2016 you would have a better chance of receiving a useful response by starting a new thread. This will also provide you with the opportunity to provide details specific to your use of the PutSQL processor and/or Phoenix that could aid others in providing a more tailored answer to your question. 

 

 

Bill Brooks, Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

avatar
Master Guru

Thank you all for awesome knowledge share.

avatar
Master Guru

avatar
Expert Contributor

Does this work with kerberos ?