Support Questions
Find answers, ask questions, and share your expertise

NiFi Phoenix processor?

Super Guru

Can can NiFi run Phoenix query using ExecuteSQL processor on kerberized cluster?

1 ACCEPTED SOLUTION

@Sunile Manjee, you can read and write to Phoenix from NiFi. You'll need to setup a DBConnectionPool ControllerService (click the Wrench/ScrewDriver icon on the top right) pointing to the phoenix-client.jar.

Then you can use ExecuteSQL for reads.

To write, the following pattern works: ConvertAttributesToJSON->ConvertJSONToSQL in Insert mode->ReplaceText to replace "INSERT" with "UPSERT" -> PutSQL.

For details on connecting to Phoenix on a Kerberized cluster, see the instructions at phoenix.apache.org (use your browser's search/find feature, Kerberos details are about 1/3 the way down the page).

View solution in original post

9 REPLIES 9

Super Collaborator

You should be able to use the ExecuteSQL processor to extract data from Phoenix now. As Ted points out, the write-side is still a TBD.

@Sunile Manjee, you can read and write to Phoenix from NiFi. You'll need to setup a DBConnectionPool ControllerService (click the Wrench/ScrewDriver icon on the top right) pointing to the phoenix-client.jar.

Then you can use ExecuteSQL for reads.

To write, the following pattern works: ConvertAttributesToJSON->ConvertJSONToSQL in Insert mode->ReplaceText to replace "INSERT" with "UPSERT" -> PutSQL.

For details on connecting to Phoenix on a Kerberized cluster, see the instructions at phoenix.apache.org (use your browser's search/find feature, Kerberos details are about 1/3 the way down the page).

Super Guru

@Ted Yu pointed out the challenge. I hope to test your work around. thank you

New Contributor

If I insert a string containing 'or "or, PutSQL to Phoenix will be submitted to the grammatical errors, this should be how to solve?

Hi @kettle 

 

As this thread was marked 'Solved' in June of 2016 you would have a better chance of receiving a useful response by starting a new thread. This will also provide you with the opportunity to provide details specific to your use of the PutSQL processor and/or Phoenix that could aid others in providing a more tailored answer to your question. 

 

 

Bill Brooks, Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Super Guru

Thank you all for awesome knowledge share.

Super Guru

Rising Star

Does this work with kerberos ?

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.