Cloudera Community

Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search

NIFI performing slow while calling Https Endpoint

Labels:
avatar
author-rank deepak123
Explorer

Created ‎11-29-2022 12:24 AM

Hi Team,

 

I have created an rest endpoint on NIFI as per below Screen.

The purpose of this endpoint is to fetch data from https://jsonplaceholder.typicode.com/todos/2 and present as http response of my API.

 

deepak123_0-1669709843029.png

 

Below is my template code -

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<template encoding-version="1.3">
<description></description>
<groupId>be506fdd-0184-1000-83e1-c82d0bfe4cb7</groupId>
<name>SampleTemplatetoCallHttpsEndpoint</name>
<snippet>
<processGroups>
<id>78122aea-0a0d-3713-0000-000000000000</id>
<parentGroupId>f175ed29-51e9-3358-0000-000000000000</parentGroupId>
<position>
<x>0.0</x>
<y>0.0</y>
</position>
<versionedComponentId>78122aea-0a0d-3713-ba11-a970a91b757e</versionedComponentId>
<comments></comments>
<contents>
<connections>
<id>00ded3d7-2d46-349b-0000-000000000000</id>
<parentGroupId>78122aea-0a0d-3713-0000-000000000000</parentGroupId>
<versionedComponentId>00ded3d7-2d46-349b-961f-70dea30221a0</versionedComponentId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>78122aea-0a0d-3713-0000-000000000000</groupId>
<id>ee78f8d2-3236-3a63-0000-000000000000</id>
<type>FUNNEL</type>
<versionedComponentId>ee78f8d2-3236-3a63-b432-78a440bb8729</versionedComponentId>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute></loadBalancePartitionAttribute>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name></name>
<selectedRelationships>failure</selectedRelationships>
<selectedRelationships>success</selectedRelationships>
<source>
<groupId>78122aea-0a0d-3713-0000-000000000000</groupId>
<id>3b9d7ee3-9200-333f-0000-000000000000</id>
<type>PROCESSOR</type>
<versionedComponentId>3b9d7ee3-9200-333f-8adb-3eb333f68939</versionedComponentId>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>93d70ed0-dd42-3a22-0000-000000000000</id>
<parentGroupId>78122aea-0a0d-3713-0000-000000000000</parentGroupId>
<versionedComponentId>93d70ed0-dd42-3a22-a36e-41b221e29208</versionedComponentId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>78122aea-0a0d-3713-0000-000000000000</groupId>
<id>8f168363-7317-3d50-0000-000000000000</id>
<type>PROCESSOR</type>
<versionedComponentId>8f168363-7317-3d50-ba9f-39c59db70b0b</versionedComponentId>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute></loadBalancePartitionAttribute>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name></name>
<selectedRelationships>success</selectedRelationships>
<source>
<groupId>78122aea-0a0d-3713-0000-000000000000</groupId>
<id>3bd96804-913b-3f17-0000-000000000000</id>
<type>PROCESSOR</type>
<versionedComponentId>3bd96804-913b-3f17-9130-1ba70c4e74cc</versionedComponentId>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>9f9438da-0a20-3e45-0000-000000000000</id>
<parentGroupId>78122aea-0a0d-3713-0000-000000000000</parentGroupId>
<versionedComponentId>9f9438da-0a20-3e45-94ff-89dda93f087f</versionedComponentId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>78122aea-0a0d-3713-0000-000000000000</groupId>
<id>27a101f8-d89c-3019-0000-000000000000</id>
<type>FUNNEL</type>
<versionedComponentId>27a101f8-d89c-3019-8925-19d9af051bb9</versionedComponentId>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute></loadBalancePartitionAttribute>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name></name>
<selectedRelationships>Failure</selectedRelationships>
<selectedRelationships>No Retry</selectedRelationships>
<selectedRelationships>Original</selectedRelationships>
<selectedRelationships>Retry</selectedRelationships>
<source>
<groupId>78122aea-0a0d-3713-0000-000000000000</groupId>
<id>8f168363-7317-3d50-0000-000000000000</id>
<type>PROCESSOR</type>
<versionedComponentId>8f168363-7317-3d50-ba9f-39c59db70b0b</versionedComponentId>
</source>
<zIndex>0</zIndex>
</connections>
<connections>
<id>dcdc230b-25da-3c22-0000-000000000000</id>
<parentGroupId>78122aea-0a0d-3713-0000-000000000000</parentGroupId>
<versionedComponentId>dcdc230b-25da-3c22-aced-9ddf1abe65c2</versionedComponentId>
<backPressureDataSizeThreshold>1 GB</backPressureDataSizeThreshold>
<backPressureObjectThreshold>10000</backPressureObjectThreshold>
<destination>
<groupId>78122aea-0a0d-3713-0000-000000000000</groupId>
<id>3b9d7ee3-9200-333f-0000-000000000000</id>
<type>PROCESSOR</type>
<versionedComponentId>3b9d7ee3-9200-333f-8adb-3eb333f68939</versionedComponentId>
</destination>
<flowFileExpiration>0 sec</flowFileExpiration>
<labelIndex>1</labelIndex>
<loadBalanceCompression>DO_NOT_COMPRESS</loadBalanceCompression>
<loadBalancePartitionAttribute></loadBalancePartitionAttribute>
<loadBalanceStatus>LOAD_BALANCE_NOT_CONFIGURED</loadBalanceStatus>
<loadBalanceStrategy>DO_NOT_LOAD_BALANCE</loadBalanceStrategy>
<name></name>
<selectedRelationships>Response</selectedRelationships>
<source>
<groupId>78122aea-0a0d-3713-0000-000000000000</groupId>
<id>8f168363-7317-3d50-0000-000000000000</id>
<type>PROCESSOR</type>
<versionedComponentId>8f168363-7317-3d50-ba9f-39c59db70b0b</versionedComponentId>
</source>
<zIndex>0</zIndex>
</connections>
<controllerServices>
<id>15effe06-a97d-3d0b-0000-000000000000</id>
<parentGroupId>78122aea-0a0d-3713-0000-000000000000</parentGroupId>
<versionedComponentId>15effe06-a97d-3d0b-b779-57e0fe9b6df6</versionedComponentId>
<bulletinLevel>WARN</bulletinLevel>
<bundle>
<artifact>nifi-http-context-map-nar</artifact>
<group>org.apache.nifi</group>
<version>1.18.0</version>
</bundle>
<descriptors>
<entry>
<key>Maximum Outstanding Requests</key>
<value>
<name>Maximum Outstanding Requests</name>
</value>
</entry>
<entry>
<key>Request Expiration</key>
<value>
<name>Request Expiration</name>
</value>
</entry>
</descriptors>
<name>StandardHttpContextMapnewservice</name>
<persistsState>false</persistsState>
<properties>
<entry>
<key>Maximum Outstanding Requests</key>
<value>5000</value>
</entry>
<entry>
<key>Request Expiration</key>
<value>1 min</value>
</entry>
</properties>
<state>ENABLED</state>
<type>org.apache.nifi.http.StandardHttpContextMap</type>
</controllerServices>
<controllerServices>
<id>759e504f-c10a-3cd2-0000-000000000000</id>
<parentGroupId>78122aea-0a0d-3713-0000-000000000000</parentGroupId>
<versionedComponentId>759e504f-c10a-3cd2-ad22-6eb7a72e5203</versionedComponentId>
<bulletinLevel>WARN</bulletinLevel>
<bundle>
<artifact>nifi-ssl-context-service-nar</artifact>
<group>org.apache.nifi</group>
<version>1.18.0</version>
</bundle>
<comments></comments>
<descriptors>
<entry>
<key>Keystore Filename</key>
<value>
<name>Keystore Filename</name>
</value>
</entry>
<entry>
<key>Keystore Password</key>
<value>
<name>Keystore Password</name>
</value>
</entry>
<entry>
<key>key-password</key>
<value>
<name>key-password</name>
</value>
</entry>
<entry>
<key>Keystore Type</key>
<value>
<name>Keystore Type</name>
</value>
</entry>
<entry>
<key>Truststore Filename</key>
<value>
<name>Truststore Filename</name>
</value>
</entry>
<entry>
<key>Truststore Password</key>
<value>
<name>Truststore Password</name>
</value>
</entry>
<entry>
<key>Truststore Type</key>
<value>
<name>Truststore Type</name>
</value>
</entry>
<entry>
<key>SSL Protocol</key>
<value>
<name>SSL Protocol</name>
</value>
</entry>
</descriptors>
<name>StandardSSLContextService</name>
<persistsState>false</persistsState>
<properties>
<entry>
<key>Keystore Filename</key>
</entry>
<entry>
<key>Keystore Password</key>
</entry>
<entry>
<key>key-password</key>
</entry>
<entry>
<key>Keystore Type</key>
</entry>
<entry>
<key>Truststore Filename</key>
<value>/usr/local/openjdk-8/lib/security/cacerts</value>
</entry>
<entry>
<key>Truststore Password</key>
</entry>
<entry>
<key>Truststore Type</key>
<value>JKS</value>
</entry>
<entry>
<key>SSL Protocol</key>
<value>TLS</value>
</entry>
</properties>
<state>ENABLED</state>
<type>org.apache.nifi.ssl.StandardSSLContextService</type>
</controllerServices>
<funnels>
<id>27a101f8-d89c-3019-0000-000000000000</id>
<parentGroupId>78122aea-0a0d-3713-0000-000000000000</parentGroupId>
<position>
<x>904.0</x>
<y>56.0</y>
</position>
<versionedComponentId>27a101f8-d89c-3019-8925-19d9af051bb9</versionedComponentId>
</funnels>
<funnels>
<id>ee78f8d2-3236-3a63-0000-000000000000</id>
<parentGroupId>78122aea-0a0d-3713-0000-000000000000</parentGroupId>
<position>
<x>1424.0</x>
<y>496.0</y>
</position>
<versionedComponentId>ee78f8d2-3236-3a63-b432-78a440bb8729</versionedComponentId>
</funnels>
<processors>
<id>3b9d7ee3-9200-333f-0000-000000000000</id>
<parentGroupId>78122aea-0a0d-3713-0000-000000000000</parentGroupId>
<position>
<x>1272.0</x>
<y>232.0</y>
</position>
<versionedComponentId>3b9d7ee3-9200-333f-8adb-3eb333f68939</versionedComponentId>
<bundle>
<artifact>nifi-standard-nar</artifact>
<group>org.apache.nifi</group>
<version>1.18.0</version>
</bundle>
<config>
<backoffMechanism>PENALIZE_FLOWFILE</backoffMechanism>
<bulletinLevel>WARN</bulletinLevel>
<comments></comments>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>HTTP Status Code</key>
<value>
<name>HTTP Status Code</name>
</value>
</entry>
<entry>
<key>HTTP Context Map</key>
<value>
<identifiesControllerService>org.apache.nifi.http.HttpContextMap</identifiesControllerService>
<name>HTTP Context Map</name>
</value>
</entry>
<entry>
<key>Attributes to add to the HTTP Response (Regex)</key>
<value>
<name>Attributes to add to the HTTP Response (Regex)</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<maxBackoffPeriod>10 mins</maxBackoffPeriod>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>HTTP Status Code</key>
<value>200</value>
</entry>
<entry>
<key>HTTP Context Map</key>
<value>15effe06-a97d-3d0b-0000-000000000000</value>
</entry>
<entry>
<key>Attributes to add to the HTTP Response (Regex)</key>
</entry>
</properties>
<retryCount>10</retryCount>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>HandleHttpResponse</name>
<relationships>
<autoTerminate>false</autoTerminate>
<name>failure</name>
<retry>false</retry>
</relationships>
<relationships>
<autoTerminate>false</autoTerminate>
<name>success</name>
<retry>false</retry>
</relationships>
<state>STOPPED</state>
<style/>
<type>org.apache.nifi.processors.standard.HandleHttpResponse</type>
</processors>
<processors>
<id>3bd96804-913b-3f17-0000-000000000000</id>
<parentGroupId>78122aea-0a0d-3713-0000-000000000000</parentGroupId>
<position>
<x>248.0</x>
<y>232.0</y>
</position>
<versionedComponentId>3bd96804-913b-3f17-9130-1ba70c4e74cc</versionedComponentId>
<bundle>
<artifact>nifi-standard-nar</artifact>
<group>org.apache.nifi</group>
<version>1.18.0</version>
</bundle>
<config>
<backoffMechanism>PENALIZE_FLOWFILE</backoffMechanism>
<bulletinLevel>WARN</bulletinLevel>
<comments></comments>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>Listening Port</key>
<value>
<name>Listening Port</name>
</value>
</entry>
<entry>
<key>Hostname</key>
<value>
<name>Hostname</name>
</value>
</entry>
<entry>
<key>SSL Context Service</key>
<value>
<identifiesControllerService>org.apache.nifi.ssl.RestrictedSSLContextService</identifiesControllerService>
<name>SSL Context Service</name>
</value>
</entry>
<entry>
<key>HTTP Protocols</key>
<value>
<dependencies>
<propertyName>SSL Context Service</propertyName>
</dependencies>
<name>HTTP Protocols</name>
</value>
</entry>
<entry>
<key>HTTP Context Map</key>
<value>
<identifiesControllerService>org.apache.nifi.http.HttpContextMap</identifiesControllerService>
<name>HTTP Context Map</name>
</value>
</entry>
<entry>
<key>Allowed Paths</key>
<value>
<name>Allowed Paths</name>
</value>
</entry>
<entry>
<key>Default URL Character Set</key>
<value>
<name>Default URL Character Set</name>
</value>
</entry>
<entry>
<key>Allow GET</key>
<value>
<name>Allow GET</name>
</value>
</entry>
<entry>
<key>Allow POST</key>
<value>
<name>Allow POST</name>
</value>
</entry>
<entry>
<key>Allow PUT</key>
<value>
<name>Allow PUT</name>
</value>
</entry>
<entry>
<key>Allow DELETE</key>
<value>
<name>Allow DELETE</name>
</value>
</entry>
<entry>
<key>Allow HEAD</key>
<value>
<name>Allow HEAD</name>
</value>
</entry>
<entry>
<key>Allow OPTIONS</key>
<value>
<name>Allow OPTIONS</name>
</value>
</entry>
<entry>
<key>Additional HTTP Methods</key>
<value>
<name>Additional HTTP Methods</name>
</value>
</entry>
<entry>
<key>Client Authentication</key>
<value>
<name>Client Authentication</name>
</value>
</entry>
<entry>
<key>container-queue-size</key>
<value>
<name>container-queue-size</name>
</value>
</entry>
<entry>
<key>multipart-request-max-size</key>
<value>
<name>multipart-request-max-size</name>
</value>
</entry>
<entry>
<key>multipart-read-buffer-size</key>
<value>
<name>multipart-read-buffer-size</name>
</value>
</entry>
<entry>
<key>parameters-to-attributes</key>
<value>
<name>parameters-to-attributes</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<maxBackoffPeriod>10 mins</maxBackoffPeriod>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>Listening Port</key>
<value>8084</value>
</entry>
<entry>
<key>Hostname</key>
</entry>
<entry>
<key>SSL Context Service</key>
</entry>
<entry>
<key>HTTP Protocols</key>
<value>HTTP_1_1</value>
</entry>
<entry>
<key>HTTP Context Map</key>
<value>15effe06-a97d-3d0b-0000-000000000000</value>
</entry>
<entry>
<key>Allowed Paths</key>
<value>/evcharge</value>
</entry>
<entry>
<key>Default URL Character Set</key>
<value>UTF-8</value>
</entry>
<entry>
<key>Allow GET</key>
<value>true</value>
</entry>
<entry>
<key>Allow POST</key>
<value>true</value>
</entry>
<entry>
<key>Allow PUT</key>
<value>true</value>
</entry>
<entry>
<key>Allow DELETE</key>
<value>true</value>
</entry>
<entry>
<key>Allow HEAD</key>
<value>false</value>
</entry>
<entry>
<key>Allow OPTIONS</key>
<value>false</value>
</entry>
<entry>
<key>Additional HTTP Methods</key>
</entry>
<entry>
<key>Client Authentication</key>
<value>No Authentication</value>
</entry>
<entry>
<key>container-queue-size</key>
<value>50</value>
</entry>
<entry>
<key>multipart-request-max-size</key>
<value>1 MB</value>
</entry>
<entry>
<key>multipart-read-buffer-size</key>
<value>512 KB</value>
</entry>
<entry>
<key>parameters-to-attributes</key>
</entry>
</properties>
<retryCount>10</retryCount>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>HandleHttpRequest</name>
<relationships>
<autoTerminate>false</autoTerminate>
<name>success</name>
<retry>false</retry>
</relationships>
<state>STOPPED</state>
<style/>
<type>org.apache.nifi.processors.standard.HandleHttpRequest</type>
</processors>
<processors>
<id>8f168363-7317-3d50-0000-000000000000</id>
<parentGroupId>78122aea-0a0d-3713-0000-000000000000</parentGroupId>
<position>
<x>768.0</x>
<y>224.0</y>
</position>
<versionedComponentId>8f168363-7317-3d50-ba9f-39c59db70b0b</versionedComponentId>
<bundle>
<artifact>nifi-standard-nar</artifact>
<group>org.apache.nifi</group>
<version>1.18.0</version>
</bundle>
<config>
<backoffMechanism>PENALIZE_FLOWFILE</backoffMechanism>
<bulletinLevel>WARN</bulletinLevel>
<comments></comments>
<concurrentlySchedulableTaskCount>1</concurrentlySchedulableTaskCount>
<descriptors>
<entry>
<key>HTTP Method</key>
<value>
<name>HTTP Method</name>
</value>
</entry>
<entry>
<key>Remote URL</key>
<value>
<name>Remote URL</name>
</value>
</entry>
<entry>
<key>disable-http2</key>
<value>
<name>disable-http2</name>
</value>
</entry>
<entry>
<key>SSL Context Service</key>
<value>
<identifiesControllerService>org.apache.nifi.ssl.SSLContextService</identifiesControllerService>
<name>SSL Context Service</name>
</value>
</entry>
<entry>
<key>Connection Timeout</key>
<value>
<name>Connection Timeout</name>
</value>
</entry>
<entry>
<key>Read Timeout</key>
<value>
<name>Read Timeout</name>
</value>
</entry>
<entry>
<key>idle-timeout</key>
<value>
<name>idle-timeout</name>
</value>
</entry>
<entry>
<key>max-idle-connections</key>
<value>
<name>max-idle-connections</name>
</value>
</entry>
<entry>
<key>proxy-configuration-service</key>
<value>
<identifiesControllerService>org.apache.nifi.proxy.ProxyConfigurationService</identifiesControllerService>
<name>proxy-configuration-service</name>
</value>
</entry>
<entry>
<key>Proxy Host</key>
<value>
<name>Proxy Host</name>
</value>
</entry>
<entry>
<key>Proxy Port</key>
<value>
<dependencies>
<propertyName>Proxy Host</propertyName>
</dependencies>
<name>Proxy Port</name>
</value>
</entry>
<entry>
<key>Proxy Type</key>
<value>
<dependencies>
<propertyName>Proxy Host</propertyName>
</dependencies>
<name>Proxy Type</name>
</value>
</entry>
<entry>
<key>invokehttp-proxy-user</key>
<value>
<dependencies>
<propertyName>Proxy Host</propertyName>
</dependencies>
<name>invokehttp-proxy-user</name>
</value>
</entry>
<entry>
<key>invokehttp-proxy-password</key>
<value>
<dependencies>
<propertyName>Proxy Host</propertyName>
</dependencies>
<name>invokehttp-proxy-password</name>
</value>
</entry>
<entry>
<key>oauth2-access-token-provider</key>
<value>
<identifiesControllerService>org.apache.nifi.oauth2.OAuth2AccessTokenProvider</identifiesControllerService>
<name>oauth2-access-token-provider</name>
</value>
</entry>
<entry>
<key>Basic Authentication Username</key>
<value>
<name>Basic Authentication Username</name>
</value>
</entry>
<entry>
<key>Basic Authentication Password</key>
<value>
<name>Basic Authentication Password</name>
</value>
</entry>
<entry>
<key>Digest Authentication</key>
<value>
<dependencies>
<propertyName>Basic Authentication Username</propertyName>
</dependencies>
<name>Digest Authentication</name>
</value>
</entry>
<entry>
<key>Penalize on "No Retry"</key>
<value>
<name>Penalize on "No Retry"</name>
</value>
</entry>
<entry>
<key>send-message-body</key>
<value>
<dependencies>
<dependentValues>POST</dependentValues>
<dependentValues>PATCH</dependentValues>
<dependentValues>PUT</dependentValues>
<propertyName>HTTP Method</propertyName>
</dependencies>
<name>send-message-body</name>
</value>
</entry>
<entry>
<key>form-body-form-name</key>
<value>
<dependencies>
<dependentValues>true</dependentValues>
<propertyName>send-message-body</propertyName>
</dependencies>
<name>form-body-form-name</name>
</value>
</entry>
<entry>
<key>set-form-filename</key>
<value>
<dependencies>
<propertyName>form-body-form-name</propertyName>
</dependencies>
<name>set-form-filename</name>
</value>
</entry>
<entry>
<key>Use Chunked Encoding</key>
<value>
<dependencies>
<dependentValues>POST</dependentValues>
<dependentValues>PATCH</dependentValues>
<dependentValues>PUT</dependentValues>
<propertyName>HTTP Method</propertyName>
</dependencies>
<name>Use Chunked Encoding</name>
</value>
</entry>
<entry>
<key>Content-Encoding</key>
<value>
<dependencies>
<dependentValues>POST</dependentValues>
<dependentValues>PATCH</dependentValues>
<dependentValues>PUT</dependentValues>
<propertyName>HTTP Method</propertyName>
</dependencies>
<name>Content-Encoding</name>
</value>
</entry>
<entry>
<key>Content-Type</key>
<value>
<dependencies>
<dependentValues>POST</dependentValues>
<dependentValues>PATCH</dependentValues>
<dependentValues>PUT</dependentValues>
<propertyName>HTTP Method</propertyName>
</dependencies>
<name>Content-Type</name>
</value>
</entry>
<entry>
<key>Include Date Header</key>
<value>
<name>Include Date Header</name>
</value>
</entry>
<entry>
<key>Attributes to Send</key>
<value>
<name>Attributes to Send</name>
</value>
</entry>
<entry>
<key>Useragent</key>
<value>
<name>Useragent</name>
</value>
</entry>
<entry>
<key>Put Response Body In Attribute</key>
<value>
<name>Put Response Body In Attribute</name>
</value>
</entry>
<entry>
<key>Max Length To Put In Attribute</key>
<value>
<dependencies>
<propertyName>Put Response Body In Attribute</propertyName>
</dependencies>
<name>Max Length To Put In Attribute</name>
</value>
</entry>
<entry>
<key>ignore-response-content</key>
<value>
<name>ignore-response-content</name>
</value>
</entry>
<entry>
<key>use-etag</key>
<value>
<name>use-etag</name>
</value>
</entry>
<entry>
<key>etag-max-cache-size</key>
<value>
<dependencies>
<dependentValues>true</dependentValues>
<propertyName>use-etag</propertyName>
</dependencies>
<name>etag-max-cache-size</name>
</value>
</entry>
<entry>
<key>cookie-strategy</key>
<value>
<name>cookie-strategy</name>
</value>
</entry>
<entry>
<key>Always Output Response</key>
<value>
<name>Always Output Response</name>
</value>
</entry>
<entry>
<key>flow-file-naming-strategy</key>
<value>
<name>flow-file-naming-strategy</name>
</value>
</entry>
<entry>
<key>Add Response Headers to Request</key>
<value>
<name>Add Response Headers to Request</name>
</value>
</entry>
<entry>
<key>Follow Redirects</key>
<value>
<name>Follow Redirects</name>
</value>
</entry>
</descriptors>
<executionNode>ALL</executionNode>
<lossTolerant>false</lossTolerant>
<maxBackoffPeriod>10 mins</maxBackoffPeriod>
<penaltyDuration>30 sec</penaltyDuration>
<properties>
<entry>
<key>HTTP Method</key>
<value>GET</value>
</entry>
<entry>
<key>Remote URL</key>
<value>https://jsonplaceholder.typicode.com/todos/2</value>
</entry>
<entry>
<key>disable-http2</key>
<value>True</value>
</entry>
<entry>
<key>SSL Context Service</key>
<value>759e504f-c10a-3cd2-0000-000000000000</value>
</entry>
<entry>
<key>Connection Timeout</key>
<value>5 secs</value>
</entry>
<entry>
<key>Read Timeout</key>
<value>15 secs</value>
</entry>
<entry>
<key>idle-timeout</key>
<value>5 mins</value>
</entry>
<entry>
<key>max-idle-connections</key>
<value>5</value>
</entry>
<entry>
<key>proxy-configuration-service</key>
</entry>
<entry>
<key>Proxy Host</key>
</entry>
<entry>
<key>Proxy Port</key>
</entry>
<entry>
<key>Proxy Type</key>
<value>http</value>
</entry>
<entry>
<key>invokehttp-proxy-user</key>
</entry>
<entry>
<key>invokehttp-proxy-password</key>
</entry>
<entry>
<key>oauth2-access-token-provider</key>
</entry>
<entry>
<key>Basic Authentication Username</key>
</entry>
<entry>
<key>Basic Authentication Password</key>
</entry>
<entry>
<key>Digest Authentication</key>
<value>false</value>
</entry>
<entry>
<key>Penalize on "No Retry"</key>
<value>false</value>
</entry>
<entry>
<key>send-message-body</key>
<value>true</value>
</entry>
<entry>
<key>form-body-form-name</key>
</entry>
<entry>
<key>set-form-filename</key>
<value>true</value>
</entry>
<entry>
<key>Use Chunked Encoding</key>
<value>false</value>
</entry>
<entry>
<key>Content-Encoding</key>
<value>DISABLED</value>
</entry>
<entry>
<key>Content-Type</key>
<value>${mime.type}</value>
</entry>
<entry>
<key>Include Date Header</key>
<value>True</value>
</entry>
<entry>
<key>Attributes to Send</key>
</entry>
<entry>
<key>Useragent</key>
</entry>
<entry>
<key>Put Response Body In Attribute</key>
</entry>
<entry>
<key>Max Length To Put In Attribute</key>
<value>256</value>
</entry>
<entry>
<key>ignore-response-content</key>
<value>false</value>
</entry>
<entry>
<key>use-etag</key>
<value>false</value>
</entry>
<entry>
<key>etag-max-cache-size</key>
<value>10MB</value>
</entry>
<entry>
<key>cookie-strategy</key>
<value>DISABLED</value>
</entry>
<entry>
<key>Always Output Response</key>
<value>true</value>
</entry>
<entry>
<key>flow-file-naming-strategy</key>
<value>RANDOM</value>
</entry>
<entry>
<key>Add Response Headers to Request</key>
<value>false</value>
</entry>
<entry>
<key>Follow Redirects</key>
<value>True</value>
</entry>
</properties>
<retryCount>10</retryCount>
<runDurationMillis>0</runDurationMillis>
<schedulingPeriod>0 sec</schedulingPeriod>
<schedulingStrategy>TIMER_DRIVEN</schedulingStrategy>
<yieldDuration>1 sec</yieldDuration>
</config>
<executionNodeRestricted>false</executionNodeRestricted>
<name>InvokeHTTP</name>
<relationships>
<autoTerminate>false</autoTerminate>
<name>Failure</name>
<retry>false</retry>
</relationships>
<relationships>
<autoTerminate>false</autoTerminate>
<name>No Retry</name>
<retry>false</retry>
</relationships>
<relationships>
<autoTerminate>false</autoTerminate>
<name>Original</name>
<retry>false</retry>
</relationships>
<relationships>
<autoTerminate>false</autoTerminate>
<name>Response</name>
<retry>false</retry>
</relationships>
<relationships>
<autoTerminate>false</autoTerminate>
<name>Retry</name>
<retry>false</retry>
</relationships>
<state>STOPPED</state>
<style/>
<type>org.apache.nifi.processors.standard.InvokeHTTP</type>
</processors>
</contents>
<defaultBackPressureDataSizeThreshold>1 GB</defaultBackPressureDataSizeThreshold>
<defaultBackPressureObjectThreshold>10000</defaultBackPressureObjectThreshold>
<defaultFlowFileExpiration>0 sec</defaultFlowFileExpiration>
<flowfileConcurrency>UNBOUNDED</flowfileConcurrency>
<flowfileOutboundPolicy>STREAM_WHEN_AVAILABLE</flowfileOutboundPolicy>
<name>Sample</name>
<variables/>
</processGroups>
</snippet>
<timestamp>11/29/2022 08:14:53 UTC</timestamp>
</template>

Tenplate code completed .................................

Issue -  My API is responding slow as compare to remote api which i am calling into my implementation.

 

Any suggestion or guide so that i can improve my API's perfomance?

 

Thanks

 

 

 

1,512 Views
0 Kudos
4 REPLIES 4

avatar
author-rank deepak123
Explorer

Created ‎03-09-2023 08:41 PM

hi guys,

 

please suggest me on same?

 

thanks

1,410 Views
0 Kudos

avatar
author-rank cotopaul
Guru

Created ‎03-09-2023 11:21 PM

Hi @deepak123 , what do you mean by Nifi is performing slow? Based on your question, it is not very clear in which point you encountering performance issue. When waiting for an answer from your InvokeHTTP endpoint or when doing some actions on the result of the API call?

1,389 Views
0 Kudos

avatar
author-rank deepak123
Explorer

Created on ‎03-14-2023 04:04 AM - edited ‎03-14-2023 04:17 AM

Hi @cotopaul ,

 

Thanks for reply,

Below is my answer for your queries-

It is slower if invokehttp processor calls https endpoint while there in no perfomance issue if invokehttp processor calls http endpoint (non secured endpoint).

 

Steps which i followed to investigate for same-

Suppose i have two rest endpoint REMOTE-REST-ENDPOINT1 (Non Https) and REMOTE-REST-ENDPOINT2 (https).

Step 1 - Now i tested perfomance of both REST Endpoint(REMOTE-REST-ENDPOINT1 & REMOTE-REST-ENDPOINT2) with jmeter and found throughput of each REST Endpoint about 60 req/sec.

Step2 -  Create a rest api suppose NIFI-REST-API1 in same manner as nifi template attached in this question. but invokeHttp processor will hit REMOTE-REST-ENDPOINT1 (Non Https) .

Step3 - Create another rest api suppose NIFI-REST-API2 in same manner as nifi template attached in this question. But  invokeHttp processor will hit REMOTE-REST-ENDPOINT2 (Https).

Step4 - Now while i am checking performance of NIFI-REST-API1 & NIFI-REST-API2 then the result is surprsing as below-

  Throughput of NIFI-REST-API1 - is approx 58 req/sec

  Throughput of NIFI-REST-API2 -  is approx 6 req/sec (big difference although the remote api (REMOTE-REST-ENDPOINT1 & REMOTE-REST-ENDPOINT1) were performing same while tested into step1 )

 

Note - i am using same NIFI instance to deploy both APIS NIFI-REST-API1 & NIFI-REST-API2. 

 

Please let me know for any query or comment.

 

please suggest me for same.

 

Thanks

 

1,355 Views
0 Kudos

avatar
author-rank deepak123
Explorer

Created ‎03-15-2023 04:08 AM

Please suggest me for same

1,315 Views
0 Kudos
Announcements
What's New @ Cloudera
Cloudera Data Engineering 1.23: Access Spark from Your Favor...
What's New @ Cloudera
HBase REST server scaling support is Generally Available
What's New @ Cloudera
New CLI option in the update-database command
What's New @ Cloudera
New Action menu item in the Cloudera Operational Database UI
What's New @ Cloudera
Get the list of supported instance types in the Cloudera Ope...
View More Announcements