Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

NiFi Phoenix processor?

Solved Go to solution
Highlighted

NiFi Phoenix processor?

Super Guru

Can can NiFi run Phoenix query using ExecuteSQL processor on kerberized cluster?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: NiFi Phoenix processor?

@Sunile Manjee, you can read and write to Phoenix from NiFi. You'll need to setup a DBConnectionPool ControllerService (click the Wrench/ScrewDriver icon on the top right) pointing to the phoenix-client.jar.

Then you can use ExecuteSQL for reads.

To write, the following pattern works: ConvertAttributesToJSON->ConvertJSONToSQL in Insert mode->ReplaceText to replace "INSERT" with "UPSERT" -> PutSQL.

For details on connecting to Phoenix on a Kerberized cluster, see the instructions at phoenix.apache.org (use your browser's search/find feature, Kerberos details are about 1/3 the way down the page).

View solution in original post

9 REPLIES 9
Highlighted

Re: NiFi Phoenix processor?

Super Collaborator
Highlighted

Re: NiFi Phoenix processor?

You should be able to use the ExecuteSQL processor to extract data from Phoenix now. As Ted points out, the write-side is still a TBD.

Highlighted

Re: NiFi Phoenix processor?

@Sunile Manjee, you can read and write to Phoenix from NiFi. You'll need to setup a DBConnectionPool ControllerService (click the Wrench/ScrewDriver icon on the top right) pointing to the phoenix-client.jar.

Then you can use ExecuteSQL for reads.

To write, the following pattern works: ConvertAttributesToJSON->ConvertJSONToSQL in Insert mode->ReplaceText to replace "INSERT" with "UPSERT" -> PutSQL.

For details on connecting to Phoenix on a Kerberized cluster, see the instructions at phoenix.apache.org (use your browser's search/find feature, Kerberos details are about 1/3 the way down the page).

View solution in original post

Highlighted

Re: NiFi Phoenix processor?

Super Guru

@Ted Yu pointed out the challenge. I hope to test your work around. thank you

Highlighted

Re: NiFi Phoenix processor?

New Contributor

If I insert a string containing 'or "or, PutSQL to Phoenix will be submitted to the grammatical errors, this should be how to solve?

Highlighted

Re: NiFi Phoenix processor?

Community Manager

Hi @kettle 

 

As this thread was marked 'Solved' in June of 2016 you would have a better chance of receiving a useful response by starting a new thread. This will also provide you with the opportunity to provide details specific to your use of the PutSQL processor and/or Phoenix that could aid others in providing a more tailored answer to your question. 

 

 

Bill Brooks, Community Manager
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Highlighted

Re: NiFi Phoenix processor?

Super Guru

Thank you all for awesome knowledge share.

Highlighted

Re: NiFi Phoenix processor?

Super Guru
Highlighted

Re: NiFi Phoenix processor?

Rising Star

Does this work with kerberos ?

Don't have an account?
Coming from Hortonworks? Activate your account here