question Unable to start MiNiFi because of an error caused due to the number of threads in Support Questions

Unable to start MiNiFi because of an error caused due to the number of threads

Leo3103 — Mon, 09 Sep 2024 10:50:37 GMT

What am I doing:

I am new to minifi and I want to get a bit workout on how to use minifi and generate a dataflow and send it to Apache NiFi.
After going through the web I understood that first we need to design the flow using the NiFi and download its JSON definition as json.gz format and place it in the conf folder of minifi. Then start the minifi using run-minifi.bat file.
These are things I have done to build the dataflow for MiNiFi:
1. First I have created a pipeline to read from a table present in my Postgres SQL database using a ExecuteSQL processor, Remote Process Group, Input Port and logAttribute Processor.
  
  Input port connected to a LogAttribute to receive the data from the Remote Process Group
2. Second, I have downloaded the ExecuteSQL, Remote Process Group and LogAttribute pipeline as a JSON file and compressed it as flow.json.gz and placed it in the conf folder and started the minifi instance.

The Error I am Facing:

java.lang.Exception: Unable to load flow due to: org.apache.nifi.controller.serialization.FlowSynchronizationException: java.lang.IllegalArgumentException: Cannot set max number of threads to less than 1 at org.apache.nifi.headless.HeadlessNiFiServer.start(HeadlessNiFiServer.java:194) at org.apache.nifi.minifi.StandardMiNiFiServer.start(StandardMiNiFiServer.java:62) at org.apache.nifi.minifi.MiNiFi.<init>(MiNiFi.java:141) at org.apache.nifi.minifi.MiNiFi.<init>(MiNiFi.java:62) at org.apache.nifi.minifi.MiNiFi.main(MiNiFi.java:226) Caused by: org.apache.nifi.controller.serialization.FlowSynchronizationException: java.lang.IllegalArgumentException: Cannot set max number of threads to less than 1 at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:477) at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.sync(VersionedFlowSynchronizer.java:224) at org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1729) at org.apache.nifi.persistence.StandardFlowConfigurationDAO.load(StandardFlowConfigurationDAO.java:91) at org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:805) at org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:526) at org.apache.nifi.headless.HeadlessNiFiServer.start(HeadlessNiFiServer.java:170) ... 4 common frames omitted Caused by: java.lang.IllegalArgumentException: Cannot set max number of threads to less than 1 at org.apache.nifi.controller.FlowController.setMaxThreadCount(FlowController.java:1783) at org.apache.nifi.controller.FlowController.setMaxTimerDrivenThreadCount(FlowController.java:1766) at org.apache.nifi.controller.serialization.VersionedFlowSynchronizer.synchronizeFlow(VersionedFlowSynchronizer.java:410) ... 10 common frames omitted

What did I try to resolve the Error:

I tried adding this property in my minifi.properties but the file is getting reset to the previous properties making this to get erased on every start of minifi instance nifi.flow.engine.threads= 5 .
I tried adding this in my bootstrap.conf file but the error still persists. nifi.minifi.flow.max.concurrent.threads=1.

I'm hoping someone who has encountered this error before or has an idea about how to resolve it can help me please. Thank you in advance.

Re: Unable to start MiNiFi because of an error caused due to the number of threads

VidyaSargur — Mon, 09 Sep 2024 11:42:00 GMT

@Leo3103, Welcome to our community! To help you get the best possible answer, I have tagged in our NiFi experts @MattWho @SAMSAL who may be able to assist you further.

Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.

Re: Unable to start MiNiFi because of an error caused due to the number of threads

MattWho — Mon, 09 Sep 2024 12:37:26 GMT

@Leo3103

It appeasr you are handling the conversion of your NiFi flow Definition for use in your MiNiFi incorrectly as per doscumetation:
https://github.com/apache/nifi/blob/main/minifi/minifi-docs/src/main/markdown/minifi-java-agent-quick-start.md

You should be downloading your flow definition (json file) via the NiFi UI.
Then you should be renaming that file "flow.json.raw" (no mention of compression here) and place it in the MiNiFi conf directory.

Once you have your flow.json.raw file in the minifi/conf directory, launch that instance of MiNiFi and your dataflow begins automatically.

Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped.

Thank you,
Matt

Re: Unable to start MiNiFi because of an error caused due to the number of threads

Leo3103 — Tue, 10 Sep 2024 06:24:03 GMT

@VidyaSargur @MattWho Thank you for your time and extending your help. Hey Matt I did as you mentioned in the reply and followed the instructions in the quick start too. Now I am facing a new error
cannot invoke "org.apache.nifi.flow.VersionedProcessGroup.getIdentifier()" because "rootGroup" is null

here is the complete error too can you please help me if you have an idea on how to resolve this error.

Command Exception happened during MiNiFi startup org.apache.nifi.minifi.bootstrap.configuration.ConfigurationChangeException: Unable to perform reload of received configuration change at org.apache.nifi.minifi.bootstrap.service.MiNiFiConfigurationChangeListener.handleChange(MiNiFiConfigurationChangeListener.java:103) at org.apache.nifi.minifi.bootstrap.command.StartRunner.regenerateFlowConfiguration(StartRunner.java:279) at org.apache.nifi.minifi.bootstrap.command.StartRunner.start(StartRunner.java:131) at org.apache.nifi.minifi.bootstrap.command.StartRunner.runCommand(StartRunner.java:107) at org.apache.nifi.minifi.bootstrap.RunMiNiFi.run(RunMiNiFi.java:133) at org.apache.nifi.minifi.bootstrap.RunMiNiFi.main(RunMiNiFi.java:150) Caused by: java.lang.NullPointerException: Cannot invoke "org.apache.nifi.flow.VersionedProcessGroup.getIdentifier()" because "rootGroup" is null at org.apache.nifi.minifi.commons.service.StandardFlowEnrichService.enrichFlow(StandardFlowEnrichService.java:115) at org.apache.nifi.minifi.bootstrap.service.MiNiFiConfigurationChangeListener.handleChange(MiNiFiConfigurationChangeListener.java:92) ... 5 common frames omitted

Here is my json definition can you please help me out to resolve this error.

{

"flowContents":{

"identifier":"e112dc88-89fb-3b93-ae94-558da67bb792",

"instanceIdentifier":"a3c3c70f-0191-1000-edb6-e2cf3fd3a7d4",

"name":"flow",

"comments":"",

"position":{

"x":-208.0,

"y":152.0

"processGroups":[

"remoteProcessGroups":[

{

"identifier":"704a77a9-410d-3114-a724-b37bdc242187",

"instanceIdentifier":"a37a0ea6-0191-1000-eea1-3b9e8a9dcc34",

"name":"NiFi Flow",

"comments":"",

"position":{

"x":-280.0,

"y":456.0

"targetUri":"http://localhost:8088/nifi",

"targetUris":"http://localhost:8088/nifi",

"communicationsTimeout":"60 sec",

"yieldDuration":"20 sec",

"transportProtocol":"RAW",

"proxyHost":"",

"proxyUser":"",

"inputPorts":[

{

"identifier":"9221b58f-8ff5-340d-ae7b-401cc053abb0",

"instanceIdentifier":"d4493e75-0fbf-34dc-a6ad-f5d633d1c474",

"name":"FromMiNiFi",

"remoteGroupId":"704a77a9-410d-3114-a724-b37bdc242187",

"concurrentlySchedulableTaskCount":1,

"useCompression":false,

"batchSize":{

"componentType":"REMOTE_INPUT_PORT",

"targetId":"9d7361b0-0191-1000-2493-b894111e3ef6",

"scheduledState":"ENABLED",

"groupIdentifier":"704a77a9-410d-3114-a724-b37bdc242187"

{

"identifier":"cc5997a9-f62f-3764-9a10-d13e424a4008",

"instanceIdentifier":"f2b798e2-88e4-36d8-b5af-5c667f6a2360",

"name":"Copy of receiveSQLData",

"remoteGroupId":"704a77a9-410d-3114-a724-b37bdc242187",

"concurrentlySchedulableTaskCount":1,

"useCompression":false,

"batchSize":{

"componentType":"REMOTE_INPUT_PORT",

"targetId":"a37f55f2-0191-1000-19c7-1260366aa0d3",

"scheduledState":"ENABLED",

"groupIdentifier":"704a77a9-410d-3114-a724-b37bdc242187"

}

"outputPorts":[

"componentType":"REMOTE_PROCESS_GROUP",

"groupIdentifier":"e112dc88-89fb-3b93-ae94-558da67bb792"

}

"processors":[

{

"identifier":"d26346ca-8682-3704-ab65-a33435b1b7d2",

"instanceIdentifier":"a38182fb-0191-1000-54f0-10cf9ad54935",

"name":"LogAttribute",

"comments":"",

"position":{

"x":481.0553418104679,

"y":419.9186557338876

"type":"org.apache.nifi.processors.standard.LogAttribute",

"bundle":{

"group":"org.apache.nifi",

"artifact":"nifi-standard-nar",

"version":"1.23.2"

"properties":{

"Log prefix":null,

"character-set":"UTF-8",

"Log FlowFile Properties":"true",

"Log Level":"info",

"attributes-to-ignore-regex":null,

"Attributes to Ignore":null,

"Attributes to Log":null,

"attributes-to-log-regex":".*",

"Output Format":"Line per Attribute",

"Log Payload":"false"

"propertyDescriptors":{

"Log prefix":{

"name":"Log prefix",

"displayName":"Log prefix",

"identifiesControllerService":false,

"sensitive":false

"character-set":{

"name":"character-set",

"displayName":"Character Set",

"identifiesControllerService":false,

"sensitive":false

"Log FlowFile Properties":{

"name":"Log FlowFile Properties",

"displayName":"Log FlowFile Properties",

"identifiesControllerService":false,

"sensitive":false

"Log Level":{

"name":"Log Level",

"displayName":"Log Level",

"identifiesControllerService":false,

"sensitive":false

"attributes-to-ignore-regex":{

"name":"attributes-to-ignore-regex",

"displayName":"Attributes to Ignore by Regular Expression",

"identifiesControllerService":false,

"sensitive":false

"Attributes to Ignore":{

"name":"Attributes to Ignore",

"displayName":"Attributes to Ignore",

"identifiesControllerService":false,

"sensitive":false

"Attributes to Log":{

"name":"Attributes to Log",

"displayName":"Attributes to Log",

"identifiesControllerService":false,

"sensitive":false

"attributes-to-log-regex":{

"name":"attributes-to-log-regex",

"displayName":"Attributes to Log by Regular Expression",

"identifiesControllerService":false,

"sensitive":false

"Output Format":{

"name":"Output Format",

"displayName":"Output Format",

"identifiesControllerService":false,

"sensitive":false

"Log Payload":{

"name":"Log Payload",

"displayName":"Log Payload",

"identifiesControllerService":false,

"sensitive":false

}

"style":{

"schedulingPeriod":"0 sec",

"schedulingStrategy":"TIMER_DRIVEN",

"executionNode":"ALL",

"penaltyDuration":"30 sec",

"yieldDuration":"1 sec",

"bulletinLevel":"WARN",

"runDurationMillis":25,

"concurrentlySchedulableTaskCount":1,

"autoTerminatedRelationships":[

"success"

"scheduledState":"ENABLED",

"retryCount":10,

"retriedRelationships":[

"backoffMechanism":"PENALIZE_FLOWFILE",

"maxBackoffPeriod":"10 mins",

"componentType":"PROCESSOR",

"groupIdentifier":"e112dc88-89fb-3b93-ae94-558da67bb792"

{

"identifier":"75f885a8-f584-36cf-9d90-b92a7cad5af0",

"instanceIdentifier":"a3644f7e-0191-1000-b197-019d8ad10c41",

"name":"ExecuteSQL",

"comments":"",

"position":{

"x":-104.0,

"y":64.0

"type":"org.apache.nifi.processors.standard.ExecuteSQL",

"bundle":{

"group":"org.apache.nifi",

"artifact":"nifi-standard-nar",

"version":"1.23.2"

"properties":{

"esql-max-rows":"0",

"dbf-default-precision":"10",

"Max Wait Time":"0 seconds",

"Database Connection Pooling Service":"822e5ffc-8f36-3466-8ecc-5f319e4980c8",

"sql-post-query":null,

"esql-auto-commit":"true",

"dbf-user-logical-types":"false",

"dbf-default-scale":"0",

"sql-pre-query":null,

"compression-format":"NONE",

"esql-output-batch-size":"0",

"esql-fetch-size":"0",

"SQL select query":"select col1, col2, col3, col4, col5 from public.tjavatest;",

"dbf-normalize":"false"

"propertyDescriptors":{

"esql-max-rows":{

"name":"esql-max-rows",

"displayName":"Max Rows Per Flow File",

"identifiesControllerService":false,

"sensitive":false

"dbf-default-precision":{

"name":"dbf-default-precision",

"displayName":"Default Decimal Precision",

"identifiesControllerService":false,

"sensitive":false

"Max Wait Time":{

"name":"Max Wait Time",

"displayName":"Max Wait Time",

"identifiesControllerService":false,

"sensitive":false

"Database Connection Pooling Service":{

"name":"Database Connection Pooling Service",

"displayName":"Database Connection Pooling Service",

"identifiesControllerService":true,

"sensitive":false

"sql-post-query":{

"name":"sql-post-query",

"displayName":"SQL Post-Query",

"identifiesControllerService":false,

"sensitive":false

"esql-auto-commit":{

"name":"esql-auto-commit",

"displayName":"Set Auto Commit",

"identifiesControllerService":false,

"sensitive":false

"dbf-user-logical-types":{

"name":"dbf-user-logical-types",

"displayName":"Use Avro Logical Types",

"identifiesControllerService":false,

"sensitive":false

"dbf-default-scale":{

"name":"dbf-default-scale",

"displayName":"Default Decimal Scale",

"identifiesControllerService":false,

"sensitive":false

"sql-pre-query":{

"name":"sql-pre-query",

"displayName":"SQL Pre-Query",

"identifiesControllerService":false,

"sensitive":false

"compression-format":{

"name":"compression-format",

"displayName":"Compression Format",

"identifiesControllerService":false,

"sensitive":false

"esql-output-batch-size":{

"name":"esql-output-batch-size",

"displayName":"Output Batch Size",

"identifiesControllerService":false,

"sensitive":false

"esql-fetch-size":{

"name":"esql-fetch-size",

"displayName":"Fetch Size",

"identifiesControllerService":false,

"sensitive":false

"SQL select query":{

"name":"SQL select query",

"displayName":"SQL select query",

"identifiesControllerService":false,

"sensitive":false

"dbf-normalize":{

"name":"dbf-normalize",

"displayName":"Normalize Table/Column Names",

"identifiesControllerService":false,

"sensitive":false

}

"style":{

"schedulingPeriod":"0 sec",

"schedulingStrategy":"TIMER_DRIVEN",

"executionNode":"ALL",

"penaltyDuration":"30 sec",

"yieldDuration":"1 sec",

"bulletinLevel":"WARN",

"runDurationMillis":0,

"concurrentlySchedulableTaskCount":1,

"autoTerminatedRelationships":[

"scheduledState":"ENABLED",

"retryCount":10,

"retriedRelationships":[

"backoffMechanism":"PENALIZE_FLOWFILE",

"maxBackoffPeriod":"10 mins",

"componentType":"PROCESSOR",

"groupIdentifier":"e112dc88-89fb-3b93-ae94-558da67bb792"

}

"inputPorts":[

"outputPorts":[

"connections":[

{

"identifier":"a4c0a496-5351-3cc3-a4fb-4aadcfb93ac4",

"instanceIdentifier":"a3819773-0191-1000-47c5-0adb24a80f96",

"name":"",

"source":{

"id":"75f885a8-f584-36cf-9d90-b92a7cad5af0",

"type":"PROCESSOR",

"groupId":"e112dc88-89fb-3b93-ae94-558da67bb792",

"name":"ExecuteSQL",

"comments":"",

"instanceIdentifier":"a3644f7e-0191-1000-b197-019d8ad10c41"

"destination":{

"id":"d26346ca-8682-3704-ab65-a33435b1b7d2",

"type":"PROCESSOR",

"groupId":"e112dc88-89fb-3b93-ae94-558da67bb792",

"name":"LogAttribute",

"comments":"",

"instanceIdentifier":"a38182fb-0191-1000-54f0-10cf9ad54935"

"labelIndex":1,

"zIndex":0,

"selectedRelationships":[

"failure"

"backPressureObjectThreshold":10000,

"backPressureDataSizeThreshold":"1 GB",

"flowFileExpiration":"0 sec",

"prioritizers":[

"bends":[

"loadBalanceStrategy":"DO_NOT_LOAD_BALANCE",

"partitioningAttribute":"",

"loadBalanceCompression":"DO_NOT_COMPRESS",

"componentType":"CONNECTION",

"groupIdentifier":"e112dc88-89fb-3b93-ae94-558da67bb792"

{

"identifier":"51ef2902-0ce4-3254-8398-0f07b666ec6b",

"instanceIdentifier":"a380e710-0191-1000-5968-000a66ac2604",

"name":"",

"source":{

"id":"75f885a8-f584-36cf-9d90-b92a7cad5af0",

"type":"PROCESSOR",

"groupId":"e112dc88-89fb-3b93-ae94-558da67bb792",

"name":"ExecuteSQL",

"comments":"",

"instanceIdentifier":"a3644f7e-0191-1000-b197-019d8ad10c41"

"destination":{

"id":"cc5997a9-f62f-3764-9a10-d13e424a4008",

"type":"REMOTE_INPUT_PORT",

"groupId":"704a77a9-410d-3114-a724-b37bdc242187",

"name":"Copy of receiveSQLData",

"instanceIdentifier":"f2b798e2-88e4-36d8-b5af-5c667f6a2360"

"labelIndex":1,

"zIndex":0,

"selectedRelationships":[

"success"

"backPressureObjectThreshold":10000,

"backPressureDataSizeThreshold":"1 GB",

"flowFileExpiration":"0 sec",

"prioritizers":[

"bends":[

"loadBalanceStrategy":"DO_NOT_LOAD_BALANCE",

"partitioningAttribute":"",

"loadBalanceCompression":"DO_NOT_COMPRESS",

"componentType":"CONNECTION",

"groupIdentifier":"e112dc88-89fb-3b93-ae94-558da67bb792"

}

"labels":[

"funnels":[

"controllerServices":[

"variables":{

"defaultFlowFileExpiration":"0 sec",

"defaultBackPressureObjectThreshold":10000,

"defaultBackPressureDataSizeThreshold":"1 GB",

"componentType":"PROCESS_GROUP",

"flowFileOutboundPolicy":"STREAM_WHEN_AVAILABLE",

"flowFileConcurrency":"UNBOUNDED"

"externalControllerServices":{

"822e5ffc-8f36-3466-8ecc-5f319e4980c8":{

"identifier":"822e5ffc-8f36-3466-8ecc-5f319e4980c8",

"name":"DBCPConnectionPool"

}

"parameterContexts":[],

"flowEncodingVersion":"1.0",

"parameterProviders":[],

"latest":false

}

Re: Unable to start MiNiFi because of an error caused due to the number of threads

MattWho — Wed, 11 Sep 2024 21:03:50 GMT

@Leo3103

This exception might be caused by a missing nar file in your MiNiFi.
MiNiFi does not include all the NiFi nars.
https://github.com/apache/nifi/blob/main/minifi/minifi-docs/src/main/markdown/minifi-java-agent-quick-start.md

A quick look through your flow definition I saw you were using the ExecuteSQL processor. While ExecuteSQL is part of one of the included nars, it does require another nar that is not included (this is noted in the above linked quick start guide).

You'll need to add the "nifi-dbcp-service-nar" from your NiFi distribution to your MiNiFi's lib directory.

Thank you,
Matt

Re: Unable to start MiNiFi because of an error caused due to the number of threads

Leo3103 — Thu, 12 Sep 2024 07:31:13 GMT

@MattWho thank you for responding back, I do understand I did not include the "nifi-dbcp-service-nar". But this time I am trying to run a new flow which is defined as below

Image 1

Image 2: This the flow designed inside the internalTest processGroup

When I downloaded the flow definition of the internalTest and placed it in the conf folder of minifi I am still facing the same issue.

Re: Unable to start MiNiFi because of an error caused due to the number of threads

Leo3103 — Wed, 25 Sep 2024 12:34:52 GMT

@MattWho I did try adding the "nifi-dbcp-service-nar" from NiFi distribution to MiNiFi's lib directory. Even then I am facing the same error

C:\SoftwareCenterApplications\minifi-2.0.0-M4-bin\minifi-2.0.0-M4\bin>run-minifi.bat 2024-09-25 18:00:58,785 INFO [main] o.a.n.minifi.properties.PropertiesLoader Loading Bootstrap Properties [conf\bootstrap.conf] 2024-09-25 18:00:58,911 INFO [main] o.a.n.minifi.properties.PropertiesLoader Loading Bootstrap Properties [conf\bootstrap.conf] 2024-09-25 18:00:58,917 INFO [main] o.a.n.minifi.properties.PropertiesLoader Loading Bootstrap Properties [conf\bootstrap.conf] 2024-09-25 18:00:59,047 INFO [main] o.a.n.minifi.properties.PropertiesLoader Loading Bootstrap Properties [conf\bootstrap.conf] 2024-09-25 18:00:59,612 ERROR [main] o.apache.nifi.minifi.bootstrap.Command Exception happened during MiNiFi startup org.apache.nifi.minifi.bootstrap.configuration.ConfigurationChangeException: Unable to perform reload of received configuration change at org.apache.nifi.minifi.bootstrap.service.MiNiFiConfigurationChangeListener.handleChange(MiNiFiConfigurationChangeListener.java:103) at org.apache.nifi.minifi.bootstrap.command.StartRunner.regenerateFlowConfiguration(StartRunner.java:279) at org.apache.nifi.minifi.bootstrap.command.StartRunner.start(StartRunner.java:131) at org.apache.nifi.minifi.bootstrap.command.StartRunner.runCommand(StartRunner.java:107) at org.apache.nifi.minifi.bootstrap.RunMiNiFi.run(RunMiNiFi.java:133) at org.apache.nifi.minifi.bootstrap.RunMiNiFi.main(RunMiNiFi.java:150) Caused by: java.lang.NullPointerException: Cannot invoke "org.apache.nifi.flow.VersionedProcessGroup.getIdentifier()" because "rootGroup" is null at org.apache.nifi.minifi.commons.service.StandardFlowEnrichService.enrichFlow(StandardFlowEnrichService.java:115) at org.apache.nifi.minifi.bootstrap.service.MiNiFiConfigurationChangeListener.handleChange(MiNiFiConfigurationChangeListener.java:92) ... 5 common frames omitted

Can you please help me out if you have any idea on this. Thank you in advance.

Re: Unable to start MiNiFi because of an error caused due to the number of threads

MattWho — Mon, 30 Sep 2024 19:09:34 GMT

@Leo3103

Things to note.

Your process group that you will be exporting a flow definition for can NOT contain local input or output ports at the top level. ---> The Process Group will become the "root" process group in your MiNiFi deployment. Only "remote" input or output ports are supported at the root level. Within the Process group you are exporting, you can have child process group deeper down that contain local input and output ports. But the test process group "internalTest" you are exporting has a local output port.
If you take entire flow.json.gz from the NiFi conf directory and rename it to flow.json.raw, you can start MiNiFi with no issues.
Since you are exporting a flow definition of a process group, you'll need to utilize the MiNiFi toolkit to transform it in to the proper format that can be loaded by MiNiFi. The MiNiFi-toolkit can be downloaded from here: https://nifi.apache.org/download/ (select "MINIFI' and click download link for Toolkit). Execute:

./minifi-toolkit/bin/config.sh transform-nifi <exported flow definition> flow.json.raw

Now edit the flow.json.raw file and edit the following property at start of file (value can not be 0.)

"maxTimerDrivenThreadCount":5

Now you can start your MiNiFi and it will create the flow.json.gz as it starts.

Thank you,
Matt

Re: Unable to start MiNiFi because of an error caused due to the number of threads

MattWho — Mon, 30 Sep 2024 19:21:22 GMT

@Leo3103

Here are some additional challenges you may have:

NiFi flow definitions do not export with any encrypted values. So it your dataflow uses a component that has sensitive properties (passwords), those will not exist in the flow.json you export. You could get the encrypted values ( they will look like enc{....<long string>....}) from the NiFi flow.json.gz file and add them in to your flow.json.raw produced by the toolkit.
In order for your MiNiFi to be able to load a flow.json.raw containing sensitive encrypted values, the same sensitive.props.key value and sensitive.props.algorithm used in your NiFi (nifi.properties) must be used in your MiNiFi bootstrap.conf.

Thank you,
Matt

Re: Unable to start MiNiFi because of an error caused due to the number of threads

Leo3103 — Tue, 08 Oct 2024 10:53:08 GMT

Hi @MattWho, once again Thank you as always.

After going through your answer these are things I did.

1) I have created a new flow as attached below

Image 1

Image 2

Where Image 1 represents the complete flow and Image 2 shows the flow inside the remoteMiNiFiTest.

2) After designing the flow I have download the flow of the remoteMiNiFiTest as a .json file and converted into flow.json.gz using the minifi toolkit. ( Why I didn't convert it into a flow.json.raw

(2.a) Because I am facing the same error as mentioned in the above thread

"org.apache.nifi.flow.VersionedProcessGroup.getIdentifier()" because "rootGroup" is null

(2.b) While running the run-minifi.bat file the instance of minifi is not starting up and prompting that the format of the flow configuration file is not in the format of GZIP ).

3) So in - order to tackle these errors I have converted it into flow.json.gz rather flow.json.raw.

4) Even though after my minifi is getting started up without any issues or breakdowns due to exception thrown by errors, the flowfile data is not getting generated by minifi.

Can you please help me out if you know what all wrong I am doing if you have an idea or so. Thank you for responding for all the previous troubles.

Re: Unable to start MiNiFi because of an error caused due to the number of threads

Leo3103 — Wed, 09 Oct 2024 05:58:01 GMT

This is the error that I am facing when I place the flow as flow.json.raw in the conf folder

java.lang.Exception: Unable to load flow due to: java.util.zip.ZipException: Not in GZIP format at org.apache.nifi.headless.HeadlessNiFiServer.start(HeadlessNiFiServer.java:194) at org.apache.nifi.minifi.StandardMiNiFiServer.start(StandardMiNiFiServer.java:62) at org.apache.nifi.minifi.MiNiFi.<init>(MiNiFi.java:141) at org.apache.nifi.minifi.MiNiFi.<init>(MiNiFi.java:62) at org.apache.nifi.minifi.MiNiFi.main(MiNiFi.java:226) Caused by: java.util.zip.ZipException: Not in GZIP format at java.base/java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:176) at java.base/java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:79) at java.base/java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:91) at org.apache.nifi.persistence.StandardFlowConfigurationDAO.load(StandardFlowConfigurationDAO.java:117) at org.apache.nifi.controller.StandardFlowService.copyCurrentFlow(StandardFlowService.java:1007) at org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:789) at org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:526) at org.apache.nifi.headless.HeadlessNiFiServer.start(HeadlessNiFiServer.java:170) ... 4 common frames omitted

Re: Unable to start MiNiFi because of an error caused due to the number of threads

MattWho — Wed, 09 Oct 2024 12:55:17 GMT

@Leo3103

I am confused by what you are showing me.

While not building the same flow as you, i have gone through the steps outlined using my minifi-2.0.0-M4 and minifi-toolkit-2.0.0-M4 downloads. Taking my downloaded <flow-definition-download.json> from my NiFi, I ran it through the toolkit using:

./minifi2/minifi-toolkit-2.0.0-M4/bin/config.sh transform-nifi NiFi_Template_XML_to_Flow_Definition_JSON.json flow.json.raw

The toolkit output file begins with:

{"maxTimerDrivenThreadCount":0,"parameterContexts":[],"rootGroup":{"identifier":"e2e44df7-dbd9-3890-aeee-67a6f48fe538","instanceIdentifier":"006c844b-0192-1000-1158-841acd760276","name":"NiFi_Template_XML_to_Flow_Definition_JSON","comments":"","position":{"x":-1032.0,"y":-456.0},"processGroups":[],"remoteProcessGroups":[],"processors":[{"identifier":"e5d........

If you were to start MiNiFi with this flow.json.raw with out editing it first, a flow.json.gz will be created and you will encounter the exception about number of threads can not be "0".

If you did start it, delete the generated flow.json.gz file. Then edit the flow.json.raw file:

{"maxTimerDrivenThreadCount":5,"parameterContexts":[],"rootGroup":{"identifier":"e2e44df7-dbd9-3890-aeee-67a6f48fe538","instanceIdentifier":"006c844b-0192-1000-1158-841acd760276","name":"NiFi_Template_XML_to_Flow_Definition_JSON","comments":"","position":{"x":-1032.0,"y":-456.0},"processGroups":[],"remoteProcessGroups":[],"processors":[{"identifier":"e5d

You'll see here that I set my thread pool size to 5.
I then started MiNiFi again and once again the flow.json.gz was created during startup from my flow.json.raw file. MiNiFi started successfully.
DEBUG logging shows here it persisting the loaded flow.json.raw to a flow.json.gz file:

2024-10-09 08:47:17,537 DEBUG [main] o.a.n.m.commons.util.FlowUpdateUtils Persisting flow to path /opt/minifi2/minifi-2.0.0-M4/./conf/flow.json.gz with content

You could edit the logback.xml to produce DEBUG output so you can see more detail about the flow being loaded.

Is your MiNiFi running on the same host as your NiFi?

I see you have your Remote Process Group (RPG) configured for localhost.

Thank you,
Matt

Re: Unable to start MiNiFi because of an error caused due to the number of threads

Leo3103 — Thu, 10 Oct 2024 08:43:10 GMT

@MattWho, thank you for your help. I am able to run the flow through MiNiFi without any error. But I am unable to see the generated flowfiles in my NiFi UI in which I have defined the flow. In the MiNiFi logs I am able to see that flowfiles are being generated but flowfiles are not being received to the Input port.

Yes both my nifi and minifi are running on the same machine.

Re: Unable to start MiNiFi because of an error caused due to the number of threads

MattWho — Thu, 10 Oct 2024 13:04:13 GMT

@Leo3103

What are you seeing in the minifi-app.log?
You could also try set DEBUG logging in the minifi logback.xml to capture more details.

Thank you,
Matt

Re: Unable to start MiNiFi because of an error caused due to the number of threads

lukas_s — Wed, 13 Nov 2024 12:31:06 GMT

I am facing the same issue, that flowfiles are not sent to NiFi. For evaluation purposes, I have set up a local NiFi and MiNiFi installation. The flows look like the following:

NiFi Flow

MiNiFi Flow

I can see in the MiNiFi log, that the flowfile is generated, but NiFi does not receive it.

Extract from MiNiFi Debug Log:

2024-11-13 12:06:23,593 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.client.protocol.RequestAddCookies CookieSpec selected: default 2024-11-13 12:06:23,595 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.client.protocol.RequestAuthCache Auth cache not set in the context 2024-11-13 12:06:23,596 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.PoolingHttpClientConnectionManager Connection request: [route: {s}->https://localhost:8443][total available: 0; route allocated: 0 of 2; total allocated: 0 of 20] 2024-11-13 12:06:23,600 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.PoolingHttpClientConnectionManager Connection leased: [id: 0][route: {s}->https://localhost:8443][total available: 0; route allocated: 1 of 2; total allocated: 1 of 20] 2024-11-13 12:06:23,601 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.http.impl.execchain.MainClientExec Opening connection {s}->https://localhost:8443 2024-11-13 12:06:23,615 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.DefaultHttpClientConnectionOperator Connecting to localhost/127.0.0.1:8443 2024-11-13 12:06:23,616 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory Connecting socket to localhost/127.0.0.1:8443 with timeout 30000 2024-11-13 12:06:23,618 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory Enabled protocols: [TLSv1.3, TLSv1.2] 2024-11-13 12:06:23,618 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory Enabled cipher suites:[TLS_AES_256_GCM_SHA384, TLS_AES_128_GCM_SHA256, TLS_CHACHA20_POLY1305_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256, TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_CHACHA20_POLY1305_SHA256, TLS_DHE_DSS_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_DSS_WITH_AES_128_GCM_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_RSA_WITH_AES_256_CBC_SHA256, TLS_DHE_DSS_WITH_AES_256_CBC_SHA256, TLS_DHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_DSS_WITH_AES_128_CBC_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_DSS_WITH_AES_256_CBC_SHA, TLS_DHE_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_DSS_WITH_AES_128_CBC_SHA, TLS_RSA_WITH_AES_256_GCM_SHA384, TLS_RSA_WITH_AES_128_GCM_SHA256, TLS_RSA_WITH_AES_256_CBC_SHA256, TLS_RSA_WITH_AES_128_CBC_SHA256, TLS_RSA_WITH_AES_256_CBC_SHA, TLS_RSA_WITH_AES_128_CBC_SHA, TLS_EMPTY_RENEGOTIATION_INFO_SCSV] 2024-11-13 12:06:23,618 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory Starting handshake 2024-11-13 12:06:23,642 INFO [main] o.apache.nifi.controller.FlowController Performed initial validation of all components in 2 milliseconds 2024-11-13 12:06:23,642 INFO [main] o.apache.nifi.controller.FlowController Starting 0 Stateless Process Groups 2024-11-13 12:06:23,642 INFO [main] o.apache.nifi.controller.FlowController Starting 0 processors/ports/funnels 2024-11-13 12:06:23,642 INFO [main] o.apache.nifi.controller.FlowController Started 0 Remote Group Ports transmitting 2024-11-13 12:06:23,645 INFO [main] o.a.nifi.minifi.StandardMiNiFiServer Flow validated successfully 2024-11-13 12:06:23,647 INFO [main] o.a.n.c.s.StandardProcessScheduler Starting LogAttribute[id=2525a2c3-0193-1000-8639-db6f8853dc9a] 2024-11-13 12:06:23,648 INFO [main] o.a.n.c.s.StandardProcessScheduler Starting ExtractText[id=252541af-0193-1000-52ad-e0d3365542f6] 2024-11-13 12:06:23,648 INFO [main] o.a.n.c.s.StandardProcessScheduler Starting GenerateFlowFile[id=2524c0b0-0193-1000-2494-efd9752b2244] 2024-11-13 12:06:23,650 INFO [main] org.apache.nifi.nar.NarAutoLoader Found 0 initial NARs from directory extensions 2024-11-13 12:06:23,651 INFO [main] org.apache.nifi.nar.NarAutoLoader Starting NAR Auto-Loader Thread for directory ./extensions ... 2024-11-13 12:06:23,651 INFO [main] o.a.nifi.headless.HeadlessNiFiServer Flow loaded successfully. 2024-11-13 12:06:23,652 INFO [Timer-Driven Process Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled GenerateFlowFile[id=2524c0b0-0193-1000-2494-efd9752b2244] to run with 1 threads 2024-11-13 12:06:23,652 INFO [Timer-Driven Process Thread-4] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled ExtractText[id=252541af-0193-1000-52ad-e0d3365542f6] to run with 1 threads 2024-11-13 12:06:23,652 INFO [Timer-Driven Process Thread-3] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled LogAttribute[id=2525a2c3-0193-1000-8639-db6f8853dc9a] to run with 1 threads 2024-11-13 12:06:23,660 INFO [MiNiFi Bootstrap Command Listener] o.a.n.minifi.properties.PropertiesLoader Loading Bootstrap Properties [/Users/xxx/Documents/minifi-2.0.0/conf/bootstrap.conf] 2024-11-13 12:06:23,660 INFO [main] org.apache.nifi.minifi.MiNiFi Controller initialization took 1059593625 nanoseconds (1,1 seconds). 2024-11-13 12:06:23,669 DEBUG [Timer-Driven Process Thread-1] StandardProcessSession.claims Creating ContentClaim StandardContentClaim [resourceClaim=StandardResourceClaim[id=1731495983668-1, container=.default, section=1], offset=0, length=-1] for 'write' for StandardFlowFileRecord[uuid=d07d27db-2a03-430c-bda5-f09b90443ac5,claim=,offset=0,name=d07d27db-2a03-430c-bda5-f09b90443ac5,size=0] 2024-11-13 12:06:23,671 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] jdk.event.security X509Certificate: Alg:SHA256withRSA, Serial:3217ee55c68ba, Subject:CN=localhost, OU=NIFI, Issuer:CN=localhost, OU=NIFI, Key type:RSA, Length:2048, Cert Id:4233696218, Valid from:10/09/2024, 12:40, Valid until:14/12/2026, 11:40 2024-11-13 12:06:23,671 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] jdk.event.security X509Certificate: Alg:SHA256withRSA, Serial:3217ed6d38d03, Subject:CN=localhost, OU=NIFI, Issuer:CN=localhost, OU=NIFI, Key type:RSA, Length:2048, Cert Id:2222995239, Valid from:10/09/2024, 12:40, Valid until:14/12/2026, 11:40 2024-11-13 12:06:23,678 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] jdk.event.security ValidationChain: 2222995239, 4233696218 2024-11-13 12:06:23,693 INFO [Timer-Driven Process Thread-5] o.a.n.processors.standard.LogAttribute LogAttribute[id=2525a2c3-0193-1000-8639-db6f8853dc9a] logging for flow file StandardFlowFileRecord[uuid=d07d27db-2a03-430c-bda5-f09b90443ac5,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1731495983668-1, container=.default, section=1], offset=0, length=28],offset=0,name=d07d27db-2a03-430c-bda5-f09b90443ac5,size=28] -------------------------------------------------- FlowFile Properties Key: 'entryDate' Value: 'Wed Nov 13 12:06:23 CET 2024' Key: 'lineageStartDate' Value: 'Wed Nov 13 12:06:23 CET 2024' Key: 'fileSize' Value: '28' FlowFile Attribute Map Content Key: 'content.0' Value: 'Wed Nov 13 12:06:23 CET 2024' Key: 'filename' Value: 'd07d27db-2a03-430c-bda5-f09b90443ac5' Key: 'path' Value: './' Key: 'uuid' Value: 'd07d27db-2a03-430c-bda5-f09b90443ac5' -------------------------------------------------- 2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] jdk.event.security TLSHandshake: localhost:8443, TLSv1.3, TLS_AES_256_GCM_SHA384, 4233696218 2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory Secure session established 2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory negotiated protocol: TLSv1.3 2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory negotiated cipher suite: TLS_AES_256_GCM_SHA384 2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory peer principal: CN=localhost, OU=NIFI 2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory peer alternative names: [localhost, xxx] 2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory issuer principal: CN=localhost, OU=NIFI 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.DefaultHttpClientConnectionOperator Connection established 127.0.0.1:62367<->127.0.0.1:8443 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.DefaultManagedHttpClientConnection http-outgoing-0: set socket timeout to 30000 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.http.impl.execchain.MainClientExec Executing request GET /nifi-api/site-to-site HTTP/1.1 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.http.impl.execchain.MainClientExec Target auth state: UNCHALLENGED 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.http.impl.execchain.MainClientExec Proxy auth state: UNCHALLENGED 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> GET /nifi-api/site-to-site HTTP/1.1 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> x-nifi-site-to-site-protocol-version: 1 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> Accept: application/json 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> Host: localhost:8443 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> Connection: Keep-Alive 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> User-Agent: Apache-HttpClient/4.5.14 (Java/21.0.2) 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> Accept-Encoding: gzip,deflate 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "GET /nifi-api/site-to-site HTTP/1.1[\r][\n]" 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "x-nifi-site-to-site-protocol-version: 1[\r][\n]" 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "Accept: application/json[\r][\n]" 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "Host: localhost:8443[\r][\n]" 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "Connection: Keep-Alive[\r][\n]" 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "User-Agent: Apache-HttpClient/4.5.14 (Java/21.0.2)[\r][\n]" 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "Accept-Encoding: gzip,deflate[\r][\n]" 2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "HTTP/1.1 200 OK[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Date: Wed, 13 Nov 2024 11:06:23 GMT[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Set-Cookie: __Secure-Request-Token=818310be-35ea-438d-8e73-eb18feb88a55; Path=/; Domain=localhost; Secure; SameSite=Strict[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Cache-Control: private, no-cache, no-store, no-transform[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Content-Type: application/json[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Vary: Accept-Encoding[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Content-Encoding: gzip[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Content-Security-Policy: frame-ancestors 'self'[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Strict-Transport-Security: max-age=31536000 ; includeSubDomains[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "X-Content-Type-Options: nosniff[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "X-Frame-Options: SAMEORIGIN[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "X-XSS-Protection: 0[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Content-Length: 299[\r][\n]" 2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "[\r][\n]" 2024-11-13 12:06:23,701 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "[0x1f][0x8b][0x8][0x0][0x0][0x0][0x0][0x0][0x0][0xff]][0x90][0xc1]N[0xc4] [0x10]@[0xc5][0xcc][0xb9]M[0x80][0xd2][0xee]v[0xaf]&[0xab][0x9b]hc\=[0x19][0xf][0x14][0x6]C[0xd2]BC[0xa7]z[0xd8][0xec][0xbf][0xb]q7V[0x8f][0xbc]y[0x84][0xe1][0x9d]@[0x7]O1[0xc][0x3]F[0xd8][0x9d][0xc0][0x19][0xd8][0x81][0xaa][0xf5][0xd6]Z[0xa5]J[0xc6][Vr[0xc6]Xi7[0xb2])[\r][0xb6][0xb5][0x90][0xc2][0xf6][0x86]3([0xc0][0xab][0x11][0x93][0xdd][0xb9][0xbd][0xbb][0xd9][0xf][0xe1]+![0x1d][0xc6][0x11]=[0xcd][0x9][0xa7]S\[0xbc]w[0xfe][0xe3]6,[0x9e]`[0xb7])`[0xa6]0Mh.[0x80]W[0x5]8[0xff][0xa9][0x6]w%[0xac][0x0][0xe3]f[0xd5][0xf][0xb8]"[0xce]O[0xb]=[0x85]H[0xd7]k[0x5][0x84][0x85][0xfe][0xb2][0xa4]E[0x1c][0x3][0xe1][0xd1][0x11]>[0xb8][0x99]0?[0x9c][0x85][0xe4]3YU[0xeb][0xf9]=[0xd1][0xf4][0xcf][0xd9]J[0x99][0x94]9[\r]_BV[0x8e][0xa8][0x97][0x98]>Gq[0xc1][0xbc][0xc1]L[0xca]k<[0xe4]8[0xa2][0xe6][0xbd][0xa9]5[0xcf]q[0xaa][0x9f]8[0x9b][0x86][0xf5]e[0xb3]Ei[0xa4][0x96][0x82][0xa1][0x85][0xd5][0xd6][0xa9][0xc5][0xdb][0xa5][0xab][0x90][0xb6][0xe7][0xbd][0xa8]WW[0x8d][0xb2]MYc[0xdd]6[0xaa]jQH[0xf9][0xdb][0xd5][0xc6]0>:[0xef][0xac][0x83]\NQ[0x86][0xcf][0xaf]]w[0xe8][0xee][0xe0][0xfc][0xbe][0xae][0x90][0xdf]x?[0x9f][0xbf][0x1]@C[0x9a][0x8c][0xcd][0x1][0x0][0x0]" 2024-11-13 12:06:23,701 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << HTTP/1.1 200 OK 2024-11-13 12:06:23,701 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Date: Wed, 13 Nov 2024 11:06:23 GMT 2024-11-13 12:06:23,701 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Set-Cookie: __Secure-Request-Token=818310be-35ea-438d-8e73-eb18feb88a55; Path=/; Domain=localhost; Secure; SameSite=Strict 2024-11-13 12:06:23,701 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Cache-Control: private, no-cache, no-store, no-transform 2024-11-13 12:06:23,701 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Content-Type: application/json 2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Vary: Accept-Encoding 2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Content-Encoding: gzip 2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Content-Security-Policy: frame-ancestors 'self' 2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Strict-Transport-Security: max-age=31536000 ; includeSubDomains 2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << X-Content-Type-Options: nosniff 2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << X-Frame-Options: SAMEORIGIN 2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << X-XSS-Protection: 0 2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Content-Length: 299 2024-11-13 12:06:23,703 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.http.impl.execchain.MainClientExec Connection can be kept alive indefinitely 2024-11-13 12:06:23,705 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.protocol.ResponseProcessCookies Cookie accepted [__Secure-Request-Token="818310be-35ea-438d-8e73-eb18feb88a55", version:0, domain:localhost, path:/, expiry:null] 2024-11-13 12:06:23,706 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.PoolingHttpClientConnectionManager Connection [id: 0][route: {s}->https://localhost:8443][state: CN=localhost, OU=NIFI] can be kept alive indefinitely 2024-11-13 12:06:23,706 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.DefaultManagedHttpClientConnection http-outgoing-0: set socket timeout to 0 2024-11-13 12:06:23,706 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.PoolingHttpClientConnectionManager Connection released: [id: 0][route: {s}->https://localhost:8443][state: CN=localhost, OU=NIFI][total available: 1; route allocated: 1 of 2; total allocated: 1 of 20] 2024-11-13 12:06:23,720 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.PoolingHttpClientConnectionManager Connection manager is shutting down 2024-11-13 12:06:23,720 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.DefaultManagedHttpClientConnection http-outgoing-0: Close connection 2024-11-13 12:06:23,721 INFO [Timer-Driven Process Thread-2] o.a.n.remote.StandardRemoteProcessGroup Successfully refreshed Flow Contents for RemoteProcessGroup[https://localhost:8443/nifi]; updated to reflect 1 Input Ports [InputPort[name=fromMinifi, targetId=24fb1b25-0193-1000-daf6-5e596a39e244]] and 0 Output Ports [] 2024-11-13 12:06:23,721 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.PoolingHttpClientConnectionManager Connection manager shut down 2024-11-13 12:06:26,536 INFO [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.n.remote.StandardRemoteProcessGroup Successfully refreshed Flow Contents for RemoteProcessGroup[https://localhost:8443/nifi]; updated to reflect 1 Input Ports [InputPort[name=fromMinifi, targetId=24fb1b25-0193-1000-daf6-5e596a39e244]] and 0 Output Ports [] 2024-11-13 12:06:43,576 INFO [Checkpoint FlowFile Repository] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository 2024-11-13 12:06:43,610 INFO [Checkpoint FlowFile Repository] o.a.n.wali.SequentialAccessWriteAheadLog Checkpointed Write-Ahead Log with 27 Records and 0 Swap Files in 32 milliseconds (Stop-the-world time = 10 milliseconds), max Transaction ID 70 2024-11-13 12:06:43,611 INFO [Checkpoint FlowFile Repository] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 27 records in 33 milliseconds 2024-11-13 12:06:53,725 DEBUG [Timer-Driven Process Thread-4] o.a.h.client.protocol.RequestAddCookies CookieSpec selected: default 2024-11-13 12:06:53,725 DEBUG [Timer-Driven Process Thread-4] o.a.h.client.protocol.RequestAuthCache Auth cache not set in the context 2024-11-13 12:06:53,725 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.PoolingHttpClientConnectionManager Connection request: [route: {s}->https://localhost:8443][total available: 0; route allocated: 0 of 2; total allocated: 0 of 20] 2024-11-13 12:06:53,725 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.PoolingHttpClientConnectionManager Connection leased: [id: 1][route: {s}->https://localhost:8443][total available: 0; route allocated: 1 of 2; total allocated: 1 of 20] 2024-11-13 12:06:53,725 DEBUG [Timer-Driven Process Thread-4] o.a.http.impl.execchain.MainClientExec Opening connection {s}->https://localhost:8443 2024-11-13 12:06:53,731 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.DefaultHttpClientConnectionOperator Connecting to localhost/127.0.0.1:8443 2024-11-13 12:06:53,731 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory Connecting socket to localhost/127.0.0.1:8443 with timeout 30000 2024-11-13 12:06:53,735 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory Enabled protocols: [TLSv1.3, TLSv1.2] 2024-11-13 12:06:53,735 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory Enabled cipher suites:[TLS_AES_256_GCM_SHA384, TLS_AES_128_GCM_SHA256, TLS_CHACHA20_POLY1305_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256, TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_CHACHA20_POLY1305_SHA256, TLS_DHE_DSS_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_DSS_WITH_AES_128_GCM_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_RSA_WITH_AES_256_CBC_SHA256, TLS_DHE_DSS_WITH_AES_256_CBC_SHA256, TLS_DHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_DSS_WITH_AES_128_CBC_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_DSS_WITH_AES_256_CBC_SHA, TLS_DHE_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_DSS_WITH_AES_128_CBC_SHA, TLS_RSA_WITH_AES_256_GCM_SHA384, TLS_RSA_WITH_AES_128_GCM_SHA256, TLS_RSA_WITH_AES_256_CBC_SHA256, TLS_RSA_WITH_AES_128_CBC_SHA256, TLS_RSA_WITH_AES_256_CBC_SHA, TLS_RSA_WITH_AES_128_CBC_SHA, TLS_EMPTY_RENEGOTIATION_INFO_SCSV] 2024-11-13 12:06:53,735 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory Starting handshake 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] jdk.event.security TLSHandshake: localhost:8443, TLSv1.3, TLS_AES_256_GCM_SHA384, 4233696218 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory Secure session established 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory negotiated protocol: TLSv1.3 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory negotiated cipher suite: TLS_AES_256_GCM_SHA384 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory peer principal: CN=localhost, OU=NIFI 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory peer alternative names: [localhost, xxx] 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory issuer principal: CN=localhost, OU=NIFI 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.DefaultHttpClientConnectionOperator Connection established 127.0.0.1:62383<->127.0.0.1:8443 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.DefaultManagedHttpClientConnection http-outgoing-1: set socket timeout to 30000 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.http.impl.execchain.MainClientExec Executing request GET /nifi-api/site-to-site HTTP/1.1 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.http.impl.execchain.MainClientExec Target auth state: UNCHALLENGED 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.http.impl.execchain.MainClientExec Proxy auth state: UNCHALLENGED 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> GET /nifi-api/site-to-site HTTP/1.1 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> x-nifi-site-to-site-protocol-version: 1 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> Accept: application/json 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> Host: localhost:8443 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> Connection: Keep-Alive 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> User-Agent: Apache-HttpClient/4.5.14 (Java/21.0.2) 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> Accept-Encoding: gzip,deflate 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "GET /nifi-api/site-to-site HTTP/1.1[\r][\n]" 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "x-nifi-site-to-site-protocol-version: 1[\r][\n]" 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "Accept: application/json[\r][\n]" 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "Host: localhost:8443[\r][\n]" 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "Connection: Keep-Alive[\r][\n]" 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "User-Agent: Apache-HttpClient/4.5.14 (Java/21.0.2)[\r][\n]" 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "Accept-Encoding: gzip,deflate[\r][\n]" 2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "HTTP/1.1 200 OK[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Date: Wed, 13 Nov 2024 11:06:53 GMT[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Set-Cookie: __Secure-Request-Token=93b9c410-760b-45c2-ac57-8d0c3ef3d1f5; Path=/; Domain=localhost; Secure; SameSite=Strict[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Cache-Control: private, no-cache, no-store, no-transform[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Content-Type: application/json[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Vary: Accept-Encoding[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Content-Encoding: gzip[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Content-Security-Policy: frame-ancestors 'self'[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Strict-Transport-Security: max-age=31536000 ; includeSubDomains[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "X-Content-Type-Options: nosniff[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "X-Frame-Options: SAMEORIGIN[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "X-XSS-Protection: 0[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Content-Length: 299[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "[\r][\n]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "[0x1f][0x8b][0x8][0x0][0x0][0x0][0x0][0x0][0x0][0xff]][0x90][0xc1]N[0xc4] [0x10]@[0xc5][0xcc][0xb9]M[0x80][0xd2][0xee]v[0xaf]&[0xab][0x9b]hc\=[0x19][0xf][0x14][0x6]C[0xd2]BC[0xa7]z[0xd8][0xec][0xbf][0xb]q7V[0x8f][0xbc]y[0x84][0xe1][0x9d]@[0x7]O1[0xc][0x3]F[0xd8][0x9d][0xc0][0x19][0xd8][0x81][0xaa][0xf5][0xd6]Z[0xa5]J[0xc6][Vr[0xc6]Xi7[0xb2])[\r][0xb6][0xb5][0x90][0xc2][0xf6][0x86]3([0xc0][0xab][0x11][0x93][0xdd][0xb9][0xbd][0xbb][0xd9][0xf][0xe1]+![0x1d][0xc6][0x11]=[0xcd][0x9][0xa7]S\[0xbc]w[0xfe][0xe3]6,[0x9e]`[0xb7])`[0xa6]0Mh.[0x80]W[0x5]8[0xff][0xa9][0x6]w%[0xac][0x0][0xe3]f[0xd5][0xf][0xb8]"[0xce]O[0xb]=[0x85]H[0xd7]k[0x5][0x84][0x85][0xfe][0xb2][0xa4]E[0x1c][0x3][0xe1][0xd1][0x11]>[0xb8][0x99]0?[0x9c][0x85][0xe4]3YU[0xeb][0xf9]=[0xd1][0xf4][0xcf][0xd9]J[0x99][0x94]9[\r]_BV[0x8e][0xa8][0x97][0x98]>Gq[0xc1][0xbc][0xc1]L[0xca]k<[0xe4]8[0xa2][0xe6][0xbd][0xa9]5[0xcf]q[0xaa][0x9f]8[0x9b][0x86][0xf5]e[0xb3]Ei[0xa4][0x96][0x82][0xa1][0x85][0xd5][0xd6][0xa9][0xc5][0xdb][0xa5][0xab][0x90][0xb6][0xe7][0xbd][0xa8]WW[0x8d][0xb2]MYc[0xdd]6[0xaa]jQH[0xf9][0xdb][0xd5][0xc6]0>:[0xef][0xac][0x83]\NQ[0x86][0xcf][0xaf]]w[0xe8][0xee][0xe0][0xfc][0xbe][0xae][0x90][0xdf]x?[0x9f][0xbf][0x1]@C[0x9a][0x8c][0xcd][0x1][0x0][0x0]" 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << HTTP/1.1 200 OK 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Date: Wed, 13 Nov 2024 11:06:53 GMT 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Set-Cookie: __Secure-Request-Token=93b9c410-760b-45c2-ac57-8d0c3ef3d1f5; Path=/; Domain=localhost; Secure; SameSite=Strict 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Cache-Control: private, no-cache, no-store, no-transform 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Content-Type: application/json 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Vary: Accept-Encoding 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Content-Encoding: gzip 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Content-Security-Policy: frame-ancestors 'self' 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Strict-Transport-Security: max-age=31536000 ; includeSubDomains 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << X-Content-Type-Options: nosniff 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << X-Frame-Options: SAMEORIGIN 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << X-XSS-Protection: 0 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Content-Length: 299 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] o.a.http.impl.execchain.MainClientExec Connection can be kept alive indefinitely 2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.protocol.ResponseProcessCookies Cookie accepted [__Secure-Request-Token="93b9c410-760b-45c2-ac57-8d0c3ef3d1f5", version:0, domain:localhost, path:/, expiry:null] 2024-11-13 12:06:53,750 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.PoolingHttpClientConnectionManager Connection [id: 1][route: {s}->https://localhost:8443][state: CN=localhost, OU=NIFI] can be kept alive indefinitely 2024-11-13 12:06:53,750 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.DefaultManagedHttpClientConnection http-outgoing-1: set socket timeout to 0 2024-11-13 12:06:53,750 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.PoolingHttpClientConnectionManager Connection released: [id: 1][route: {s}->https://localhost:8443][state: CN=localhost, OU=NIFI][total available: 1; route allocated: 1 of 2; total allocated: 1 of 20] 2024-11-13 12:06:53,752 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.PoolingHttpClientConnectionManager Connection manager is shutting down 2024-11-13 12:06:53,752 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.DefaultManagedHttpClientConnection http-outgoing-1: Close connection 2024-11-13 12:06:53,752 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.PoolingHttpClientConnectionManager Connection manager shut down 2024-11-13 12:06:53,752 INFO [Timer-Driven Process Thread-4] o.a.n.remote.StandardRemoteProcessGroup Successfully refreshed Flow Contents for RemoteProcessGroup[https://localhost:8443/nifi]; updated to reflect 1 Input Ports [InputPort[name=fromMinifi, targetId=24fb1b25-0193-1000-daf6-5e596a39e244]] and 0 Output Ports []

Also, flowStatus for Remote Process Group returns that it is not transmitting and has one inactive port.

2024-11-13 11:58:30,877 INFO [main] o.apache.nifi.minifi.bootstrap.Command {"controllerServiceStatusList":null,"processorStatusList":null,"connectionStatusList":null,"remoteProcessGroupStatusList":[{"name":"NiFi Flow","remoteProcessGroupHealth":{"transmissionStatus":"NotTransmitting","hasBulletins":false,"activePortCount":0,"inactivePortCount":1},"bulletinList":null,"inputPortStatusList":null,"outputPortStatusList":null,"remoteProcessGroupStats":null}],"instanceStatus":null,"systemDiagnosticsStatus":null,"reportingTaskStatusList":null,"errorsGeneratingReport":[]}