question Re: Use InvokeHTTP response body in another InvokeHTTP in Support Questions

Use InvokeHTTP response body in another InvokeHTTP

leqlaz777 — Thu, 17 Aug 2023 14:01:26 GMT

Hi there,

sorry for my silly question.

I have a InvokeHTTP processor which returns plaintext access token in the response body, since it is larger than 256 bytes I cannot assign it to an attribute. I need to use the token in another InvokeHTTP as a header to retrieve data. Token is a plain text (not a json).

Thanks!

Re: Use InvokeHTTP response body in another InvokeHTTP

DianaTorres — Thu, 17 Aug 2023 17:10:42 GMT

@leqlaz777 Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our NiFi experts @SAMSAL @cotopaul who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Re: Use InvokeHTTP response body in another InvokeHTTP

SAMSAL — Thu, 17 Aug 2023 18:22:24 GMT

How are you authenticating? Are you using OAuth2 token for example? If so see if you can take advantage of the "OAuth2 Access Token provider" in the InvokeHttp processors where you set and configure your token provider as a service:

https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-oauth2-provider-nar/1.22.0/org.apache.nifi.oauth2.StandardOauth2AccessTokenProvider/index.html

If that helps please accept solution.

Thanks

Re: Use InvokeHTTP response body in another InvokeHTTP

MattWho — Thu, 17 Aug 2023 19:00:39 GMT

@leqlaz777
What version of NiFi are you using?
How large is your response body?

I have no issues creating FlowFile Attributes with values larger then 256 bytes.
Can you share your processors being used and the configuration of them?

Thank you,

Matt

Re: Use InvokeHTTP response body in another InvokeHTTP

leqlaz777 — Fri, 18 Aug 2023 07:02:07 GMT

Hi,

Not exactly oAuth2, I send Authorization: Bearer [API KEY] header to /auth endpoint via POST request and get a JWT access token. Which then I have to use as an auth header to access resources.

In StandardOauth2AccessTokenProvider I am not able to use simple Bearer token in header.

Re: Use InvokeHTTP response body in another InvokeHTTP

leqlaz777 — Fri, 18 Aug 2023 07:12:02 GMT

Hi,

My version is 1.20.

It is a JWT token between 400-500 bytes.

I missed "Response Body Attribute Size" parameter, I can set arbitrary size to attribute. After changing it I am able to pass full length of my token.

Re: Use InvokeHTTP response body in another InvokeHTTP

JamesMillere — Fri, 18 Aug 2023 09:36:34 GMT

Hi,

If you're using Apache NiFi and the token you're trying to capture with the InvokeHTTP processor is too large to be stored as an attribute, you can follow the steps below to work around this limitation:

Keep the token in the content of the FlowFile if it's returned by the InvokeHTTP processor.

You can use processors like ReplaceText to wrap the token in the header format you need. For instance, if you need the header to be Authorization: Bearer {token}, then you can configure a ReplaceText processor to replace the content (i.e., the token) to match this format.