Created 06-18-2016 01:33 AM
Can can NiFi run Phoenix query using ExecuteSQL processor on kerberized cluster?
Created 06-18-2016 11:16 PM
@Sunile Manjee, you can read and write to Phoenix from NiFi. You'll need to setup a DBConnectionPool ControllerService (click the Wrench/ScrewDriver icon on the top right) pointing to the phoenix-client.jar.
Then you can use ExecuteSQL for reads.
To write, the following pattern works: ConvertAttributesToJSON->ConvertJSONToSQL in Insert mode->ReplaceText to replace "INSERT" with "UPSERT" -> PutSQL.
For details on connecting to Phoenix on a Kerberized cluster, see the instructions at phoenix.apache.org (use your browser's search/find feature, Kerberos details are about 1/3 the way down the page).
Created 06-18-2016 12:59 PM
It is work in progress:
Created 06-18-2016 11:09 PM
You should be able to use the ExecuteSQL processor to extract data from Phoenix now. As Ted points out, the write-side is still a TBD.
Created 06-18-2016 11:16 PM
@Sunile Manjee, you can read and write to Phoenix from NiFi. You'll need to setup a DBConnectionPool ControllerService (click the Wrench/ScrewDriver icon on the top right) pointing to the phoenix-client.jar.
Then you can use ExecuteSQL for reads.
To write, the following pattern works: ConvertAttributesToJSON->ConvertJSONToSQL in Insert mode->ReplaceText to replace "INSERT" with "UPSERT" -> PutSQL.
For details on connecting to Phoenix on a Kerberized cluster, see the instructions at phoenix.apache.org (use your browser's search/find feature, Kerberos details are about 1/3 the way down the page).
Created 06-19-2016 02:49 AM
@Ted Yu pointed out the challenge. I hope to test your work around. thank you
Created 05-15-2020 06:53 PM
If I insert a string containing 'or "or, PutSQL to Phoenix will be submitted to the grammatical errors, this should be how to solve?
Created 05-17-2020 08:41 PM
Hi @kettle
As this thread was marked 'Solved' in June of 2016 you would have a better chance of receiving a useful response by starting a new thread. This will also provide you with the opportunity to provide details specific to your use of the PutSQL processor and/or Phoenix that could aid others in providing a more tailored answer to your question.
Created 06-19-2016 02:48 AM
Thank you all for awesome knowledge share.
Created 09-23-2016 08:28 PM
Created 03-01-2017 12:44 AM
Does this work with kerberos ?