Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi Phoenix processor?

Solved Go to solution

NiFi Phoenix processor?

Super Guru

Can can NiFi run Phoenix query using ExecuteSQL processor on kerberized cluster?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: NiFi Phoenix processor?

@Sunile Manjee, you can read and write to Phoenix from NiFi. You'll need to setup a DBConnectionPool ControllerService (click the Wrench/ScrewDriver icon on the top right) pointing to the phoenix-client.jar.

Then you can use ExecuteSQL for reads.

To write, the following pattern works: ConvertAttributesToJSON->ConvertJSONToSQL in Insert mode->ReplaceText to replace "INSERT" with "UPSERT" -> PutSQL.

For details on connecting to Phoenix on a Kerberized cluster, see the instructions at phoenix.apache.org (use your browser's search/find feature, Kerberos details are about 1/3 the way down the page).

7 REPLIES 7

Re: NiFi Phoenix processor?

Super Collaborator

Re: NiFi Phoenix processor?

You should be able to use the ExecuteSQL processor to extract data from Phoenix now. As Ted points out, the write-side is still a TBD.

Re: NiFi Phoenix processor?

@Sunile Manjee, you can read and write to Phoenix from NiFi. You'll need to setup a DBConnectionPool ControllerService (click the Wrench/ScrewDriver icon on the top right) pointing to the phoenix-client.jar.

Then you can use ExecuteSQL for reads.

To write, the following pattern works: ConvertAttributesToJSON->ConvertJSONToSQL in Insert mode->ReplaceText to replace "INSERT" with "UPSERT" -> PutSQL.

For details on connecting to Phoenix on a Kerberized cluster, see the instructions at phoenix.apache.org (use your browser's search/find feature, Kerberos details are about 1/3 the way down the page).

Re: NiFi Phoenix processor?

Super Guru

@Ted Yu pointed out the challenge. I hope to test your work around. thank you

Re: NiFi Phoenix processor?

Super Guru

Thank you all for awesome knowledge share.

Re: NiFi Phoenix processor?

Super Guru

Re: NiFi Phoenix processor?

Rising Star

Does this work with kerberos ?

Don't have an account?
Coming from Hortonworks? Activate your account here