Member since
07-30-2019
3123
Posts
1563
Kudos Received
907
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
220 | 12-13-2024 10:58 AM | |
329 | 12-05-2024 06:38 AM | |
268 | 11-22-2024 05:50 AM | |
235 | 11-19-2024 10:30 AM | |
204 | 11-14-2024 01:03 PM |
11-14-2024
01:16 PM
@Ytch NiFi is designed to move data and the ListS3 processor is designed to list s3 objects/files and not directories. On the downstream side, NiFi does not have a processor that just create directories. Many out processors will create a missing directory if content is to be written must be written to a directory path that does not exist on the target. But without content those processor will not create any directories. I am clear on what yoru use case is here, but based on yoru description it is not something any of the stock processors would do. You would need to write something custom (either your own processor or some custom script you can execute via aNiFi scripting processor). Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more
11-13-2024
04:29 AM
I am facing the same issue, that flowfiles are not sent to NiFi. For evaluation purposes, I have set up a local NiFi and MiNiFi installation. The flows look like the following: NiFi Flow MiNiFi Flow I can see in the MiNiFi log, that the flowfile is generated, but NiFi does not receive it. Extract from MiNiFi Debug Log: 2024-11-13 12:06:23,593 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.client.protocol.RequestAddCookies CookieSpec selected: default
2024-11-13 12:06:23,595 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.client.protocol.RequestAuthCache Auth cache not set in the context
2024-11-13 12:06:23,596 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.PoolingHttpClientConnectionManager Connection request: [route: {s}->https://localhost:8443][total available: 0; route allocated: 0 of 2; total allocated: 0 of 20]
2024-11-13 12:06:23,600 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.PoolingHttpClientConnectionManager Connection leased: [id: 0][route: {s}->https://localhost:8443][total available: 0; route allocated: 1 of 2; total allocated: 1 of 20]
2024-11-13 12:06:23,601 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.http.impl.execchain.MainClientExec Opening connection {s}->https://localhost:8443
2024-11-13 12:06:23,615 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.DefaultHttpClientConnectionOperator Connecting to localhost/127.0.0.1:8443
2024-11-13 12:06:23,616 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory Connecting socket to localhost/127.0.0.1:8443 with timeout 30000
2024-11-13 12:06:23,618 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory Enabled protocols: [TLSv1.3, TLSv1.2]
2024-11-13 12:06:23,618 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory Enabled cipher suites:[TLS_AES_256_GCM_SHA384, TLS_AES_128_GCM_SHA256, TLS_CHACHA20_POLY1305_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256, TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_CHACHA20_POLY1305_SHA256, TLS_DHE_DSS_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_DSS_WITH_AES_128_GCM_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_RSA_WITH_AES_256_CBC_SHA256, TLS_DHE_DSS_WITH_AES_256_CBC_SHA256, TLS_DHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_DSS_WITH_AES_128_CBC_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_DSS_WITH_AES_256_CBC_SHA, TLS_DHE_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_DSS_WITH_AES_128_CBC_SHA, TLS_RSA_WITH_AES_256_GCM_SHA384, TLS_RSA_WITH_AES_128_GCM_SHA256, TLS_RSA_WITH_AES_256_CBC_SHA256, TLS_RSA_WITH_AES_128_CBC_SHA256, TLS_RSA_WITH_AES_256_CBC_SHA, TLS_RSA_WITH_AES_128_CBC_SHA, TLS_EMPTY_RENEGOTIATION_INFO_SCSV]
2024-11-13 12:06:23,618 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory Starting handshake
2024-11-13 12:06:23,642 INFO [main] o.apache.nifi.controller.FlowController Performed initial validation of all components in 2 milliseconds
2024-11-13 12:06:23,642 INFO [main] o.apache.nifi.controller.FlowController Starting 0 Stateless Process Groups
2024-11-13 12:06:23,642 INFO [main] o.apache.nifi.controller.FlowController Starting 0 processors/ports/funnels
2024-11-13 12:06:23,642 INFO [main] o.apache.nifi.controller.FlowController Started 0 Remote Group Ports transmitting
2024-11-13 12:06:23,645 INFO [main] o.a.nifi.minifi.StandardMiNiFiServer Flow validated successfully
2024-11-13 12:06:23,647 INFO [main] o.a.n.c.s.StandardProcessScheduler Starting LogAttribute[id=2525a2c3-0193-1000-8639-db6f8853dc9a]
2024-11-13 12:06:23,648 INFO [main] o.a.n.c.s.StandardProcessScheduler Starting ExtractText[id=252541af-0193-1000-52ad-e0d3365542f6]
2024-11-13 12:06:23,648 INFO [main] o.a.n.c.s.StandardProcessScheduler Starting GenerateFlowFile[id=2524c0b0-0193-1000-2494-efd9752b2244]
2024-11-13 12:06:23,650 INFO [main] org.apache.nifi.nar.NarAutoLoader Found 0 initial NARs from directory extensions
2024-11-13 12:06:23,651 INFO [main] org.apache.nifi.nar.NarAutoLoader Starting NAR Auto-Loader Thread for directory ./extensions ...
2024-11-13 12:06:23,651 INFO [main] o.a.nifi.headless.HeadlessNiFiServer Flow loaded successfully.
2024-11-13 12:06:23,652 INFO [Timer-Driven Process Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled GenerateFlowFile[id=2524c0b0-0193-1000-2494-efd9752b2244] to run with 1 threads
2024-11-13 12:06:23,652 INFO [Timer-Driven Process Thread-4] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled ExtractText[id=252541af-0193-1000-52ad-e0d3365542f6] to run with 1 threads
2024-11-13 12:06:23,652 INFO [Timer-Driven Process Thread-3] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled LogAttribute[id=2525a2c3-0193-1000-8639-db6f8853dc9a] to run with 1 threads
2024-11-13 12:06:23,660 INFO [MiNiFi Bootstrap Command Listener] o.a.n.minifi.properties.PropertiesLoader Loading Bootstrap Properties [/Users/xxx/Documents/minifi-2.0.0/conf/bootstrap.conf]
2024-11-13 12:06:23,660 INFO [main] org.apache.nifi.minifi.MiNiFi Controller initialization took 1059593625 nanoseconds (1,1 seconds).
2024-11-13 12:06:23,669 DEBUG [Timer-Driven Process Thread-1] StandardProcessSession.claims Creating ContentClaim StandardContentClaim [resourceClaim=StandardResourceClaim[id=1731495983668-1, container=.default, section=1], offset=0, length=-1] for 'write' for StandardFlowFileRecord[uuid=d07d27db-2a03-430c-bda5-f09b90443ac5,claim=,offset=0,name=d07d27db-2a03-430c-bda5-f09b90443ac5,size=0]
2024-11-13 12:06:23,671 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] jdk.event.security X509Certificate: Alg:SHA256withRSA, Serial:3217ee55c68ba, Subject:CN=localhost, OU=NIFI, Issuer:CN=localhost, OU=NIFI, Key type:RSA, Length:2048, Cert Id:4233696218, Valid from:10/09/2024, 12:40, Valid until:14/12/2026, 11:40
2024-11-13 12:06:23,671 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] jdk.event.security X509Certificate: Alg:SHA256withRSA, Serial:3217ed6d38d03, Subject:CN=localhost, OU=NIFI, Issuer:CN=localhost, OU=NIFI, Key type:RSA, Length:2048, Cert Id:2222995239, Valid from:10/09/2024, 12:40, Valid until:14/12/2026, 11:40
2024-11-13 12:06:23,678 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] jdk.event.security ValidationChain: 2222995239, 4233696218
2024-11-13 12:06:23,693 INFO [Timer-Driven Process Thread-5] o.a.n.processors.standard.LogAttribute LogAttribute[id=2525a2c3-0193-1000-8639-db6f8853dc9a] logging for flow file StandardFlowFileRecord[uuid=d07d27db-2a03-430c-bda5-f09b90443ac5,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1731495983668-1, container=.default, section=1], offset=0, length=28],offset=0,name=d07d27db-2a03-430c-bda5-f09b90443ac5,size=28]
--------------------------------------------------
FlowFile Properties
Key: 'entryDate'
Value: 'Wed Nov 13 12:06:23 CET 2024'
Key: 'lineageStartDate'
Value: 'Wed Nov 13 12:06:23 CET 2024'
Key: 'fileSize'
Value: '28'
FlowFile Attribute Map Content
Key: 'content.0'
Value: 'Wed Nov 13 12:06:23 CET 2024'
Key: 'filename'
Value: 'd07d27db-2a03-430c-bda5-f09b90443ac5'
Key: 'path'
Value: './'
Key: 'uuid'
Value: 'd07d27db-2a03-430c-bda5-f09b90443ac5'
--------------------------------------------------
2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] jdk.event.security TLSHandshake: localhost:8443, TLSv1.3, TLS_AES_256_GCM_SHA384, 4233696218
2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory Secure session established
2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory negotiated protocol: TLSv1.3
2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory negotiated cipher suite: TLS_AES_256_GCM_SHA384
2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory peer principal: CN=localhost, OU=NIFI
2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory peer alternative names: [localhost, xxx]
2024-11-13 12:06:23,694 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.ssl.SSLConnectionSocketFactory issuer principal: CN=localhost, OU=NIFI
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.DefaultHttpClientConnectionOperator Connection established 127.0.0.1:62367<->127.0.0.1:8443
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.DefaultManagedHttpClientConnection http-outgoing-0: set socket timeout to 30000
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.http.impl.execchain.MainClientExec Executing request GET /nifi-api/site-to-site HTTP/1.1
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.http.impl.execchain.MainClientExec Target auth state: UNCHALLENGED
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.http.impl.execchain.MainClientExec Proxy auth state: UNCHALLENGED
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> GET /nifi-api/site-to-site HTTP/1.1
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> x-nifi-site-to-site-protocol-version: 1
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> Accept: application/json
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> Host: localhost:8443
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> Connection: Keep-Alive
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> User-Agent: Apache-HttpClient/4.5.14 (Java/21.0.2)
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 >> Accept-Encoding: gzip,deflate
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "GET /nifi-api/site-to-site HTTP/1.1[\r][\n]"
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "x-nifi-site-to-site-protocol-version: 1[\r][\n]"
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "Accept: application/json[\r][\n]"
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "Host: localhost:8443[\r][\n]"
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "Connection: Keep-Alive[\r][\n]"
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "User-Agent: Apache-HttpClient/4.5.14 (Java/21.0.2)[\r][\n]"
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "Accept-Encoding: gzip,deflate[\r][\n]"
2024-11-13 12:06:23,695 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 >> "[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "HTTP/1.1 200 OK[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Date: Wed, 13 Nov 2024 11:06:23 GMT[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Set-Cookie: __Secure-Request-Token=818310be-35ea-438d-8e73-eb18feb88a55; Path=/; Domain=localhost; Secure; SameSite=Strict[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Cache-Control: private, no-cache, no-store, no-transform[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Content-Type: application/json[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Vary: Accept-Encoding[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Content-Encoding: gzip[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Content-Security-Policy: frame-ancestors 'self'[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Strict-Transport-Security: max-age=31536000 ; includeSubDomains[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "X-Content-Type-Options: nosniff[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "X-Frame-Options: SAMEORIGIN[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "X-XSS-Protection: 0[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "Content-Length: 299[\r][\n]"
2024-11-13 12:06:23,700 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "[\r][\n]"
2024-11-13 12:06:23,701 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.wire http-outgoing-0 << "[0x1f][0x8b][0x8][0x0][0x0][0x0][0x0][0x0][0x0][0xff]][0x90][0xc1]N[0xc4] [0x10]@[0xc5][0xcc][0xb9]M[0x80][0xd2][0xee]v[0xaf]&[0xab][0x9b]hc\=[0x19][0xf][0x14][0x6]C[0xd2]BC[0xa7]z[0xd8][0xec][0xbf][0xb]q7V[0x8f][0xbc]y[0x84][0xe1][0x9d]@[0x7]O1[0xc][0x3]F[0xd8][0x9d][0xc0][0x19][0xd8][0x81][0xaa][0xf5][0xd6]Z[0xa5]J[0xc6][Vr[0xc6]Xi7[0xb2])[\r][0xb6][0xb5][0x90][0xc2][0xf6][0x86]3([0xc0][0xab][0x11][0x93][0xdd][0xb9][0xbd][0xbb][0xd9][0xf][0xe1]+![0x1d][0xc6][0x11]=[0xcd][0x9][0xa7]S\[0xbc]w[0xfe][0xe3]6,[0x9e]`[0xb7])`[0xa6]0Mh.[0x80]W[0x5]8[0xff][0xa9][0x6]w%[0xac][0x0][0xe3]f[0xd5][0xf][0xb8]"[0xce]O[0xb]=[0x85]H[0xd7]k[0x5][0x84][0x85][0xfe][0xb2][0xa4]E[0x1c][0x3][0xe1][0xd1][0x11]>[0xb8][0x99]0?[0x9c][0x85][0xe4]3YU[0xeb][0xf9]=[0xd1][0xf4][0xcf][0xd9]J[0x99][0x94]9[\r]_BV[0x8e][0xa8][0x97][0x98]>Gq[0xc1][0xbc][0xc1]L[0xca]k<[0xe4]8[0xa2][0xe6][0xbd][0xa9]5[0xcf]q[0xaa][0x9f]8[0x9b][0x86][0xf5]e[0xb3]Ei[0xa4][0x96][0x82][0xa1][0x85][0xd5][0xd6][0xa9][0xc5][0xdb][0xa5][0xab][0x90][0xb6][0xe7][0xbd][0xa8]WW[0x8d][0xb2]MYc[0xdd]6[0xaa]jQH[0xf9][0xdb][0xd5][0xc6]0>:[0xef][0xac][0x83]\NQ[0x86][0xcf][0xaf]]w[0xe8][0xee][0xe0][0xfc][0xbe][0xae][0x90][0xdf]x?[0x9f][0xbf][0x1]@C[0x9a][0x8c][0xcd][0x1][0x0][0x0]"
2024-11-13 12:06:23,701 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << HTTP/1.1 200 OK
2024-11-13 12:06:23,701 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Date: Wed, 13 Nov 2024 11:06:23 GMT
2024-11-13 12:06:23,701 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Set-Cookie: __Secure-Request-Token=818310be-35ea-438d-8e73-eb18feb88a55; Path=/; Domain=localhost; Secure; SameSite=Strict
2024-11-13 12:06:23,701 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Cache-Control: private, no-cache, no-store, no-transform
2024-11-13 12:06:23,701 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Content-Type: application/json
2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Vary: Accept-Encoding
2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Content-Encoding: gzip
2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Content-Security-Policy: frame-ancestors 'self'
2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Strict-Transport-Security: max-age=31536000 ; includeSubDomains
2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << X-Content-Type-Options: nosniff
2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << X-Frame-Options: SAMEORIGIN
2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << X-XSS-Protection: 0
2024-11-13 12:06:23,702 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] org.apache.http.headers http-outgoing-0 << Content-Length: 299
2024-11-13 12:06:23,703 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.http.impl.execchain.MainClientExec Connection can be kept alive indefinitely
2024-11-13 12:06:23,705 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.c.protocol.ResponseProcessCookies Cookie accepted [__Secure-Request-Token="818310be-35ea-438d-8e73-eb18feb88a55", version:0, domain:localhost, path:/, expiry:null]
2024-11-13 12:06:23,706 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.PoolingHttpClientConnectionManager Connection [id: 0][route: {s}->https://localhost:8443][state: CN=localhost, OU=NIFI] can be kept alive indefinitely
2024-11-13 12:06:23,706 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.DefaultManagedHttpClientConnection http-outgoing-0: set socket timeout to 0
2024-11-13 12:06:23,706 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.PoolingHttpClientConnectionManager Connection released: [id: 0][route: {s}->https://localhost:8443][state: CN=localhost, OU=NIFI][total available: 1; route allocated: 1 of 2; total allocated: 1 of 20]
2024-11-13 12:06:23,720 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.PoolingHttpClientConnectionManager Connection manager is shutting down
2024-11-13 12:06:23,720 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.DefaultManagedHttpClientConnection http-outgoing-0: Close connection
2024-11-13 12:06:23,721 INFO [Timer-Driven Process Thread-2] o.a.n.remote.StandardRemoteProcessGroup Successfully refreshed Flow Contents for RemoteProcessGroup[https://localhost:8443/nifi]; updated to reflect 1 Input Ports [InputPort[name=fromMinifi, targetId=24fb1b25-0193-1000-daf6-5e596a39e244]] and 0 Output Ports []
2024-11-13 12:06:23,721 DEBUG [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.h.i.c.PoolingHttpClientConnectionManager Connection manager shut down
2024-11-13 12:06:26,536 INFO [Remote Process Group 25288b6e-0193-1000-f7d7-4b675d37116d Thread-1] o.a.n.remote.StandardRemoteProcessGroup Successfully refreshed Flow Contents for RemoteProcessGroup[https://localhost:8443/nifi]; updated to reflect 1 Input Ports [InputPort[name=fromMinifi, targetId=24fb1b25-0193-1000-daf6-5e596a39e244]] and 0 Output Ports []
2024-11-13 12:06:43,576 INFO [Checkpoint FlowFile Repository] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository
2024-11-13 12:06:43,610 INFO [Checkpoint FlowFile Repository] o.a.n.wali.SequentialAccessWriteAheadLog Checkpointed Write-Ahead Log with 27 Records and 0 Swap Files in 32 milliseconds (Stop-the-world time = 10 milliseconds), max Transaction ID 70
2024-11-13 12:06:43,611 INFO [Checkpoint FlowFile Repository] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 27 records in 33 milliseconds
2024-11-13 12:06:53,725 DEBUG [Timer-Driven Process Thread-4] o.a.h.client.protocol.RequestAddCookies CookieSpec selected: default
2024-11-13 12:06:53,725 DEBUG [Timer-Driven Process Thread-4] o.a.h.client.protocol.RequestAuthCache Auth cache not set in the context
2024-11-13 12:06:53,725 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.PoolingHttpClientConnectionManager Connection request: [route: {s}->https://localhost:8443][total available: 0; route allocated: 0 of 2; total allocated: 0 of 20]
2024-11-13 12:06:53,725 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.PoolingHttpClientConnectionManager Connection leased: [id: 1][route: {s}->https://localhost:8443][total available: 0; route allocated: 1 of 2; total allocated: 1 of 20]
2024-11-13 12:06:53,725 DEBUG [Timer-Driven Process Thread-4] o.a.http.impl.execchain.MainClientExec Opening connection {s}->https://localhost:8443
2024-11-13 12:06:53,731 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.DefaultHttpClientConnectionOperator Connecting to localhost/127.0.0.1:8443
2024-11-13 12:06:53,731 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory Connecting socket to localhost/127.0.0.1:8443 with timeout 30000
2024-11-13 12:06:53,735 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory Enabled protocols: [TLSv1.3, TLSv1.2]
2024-11-13 12:06:53,735 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory Enabled cipher suites:[TLS_AES_256_GCM_SHA384, TLS_AES_128_GCM_SHA256, TLS_CHACHA20_POLY1305_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256, TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305_SHA256, TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384, TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305_SHA256, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_RSA_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_CHACHA20_POLY1305_SHA256, TLS_DHE_DSS_WITH_AES_256_GCM_SHA384, TLS_DHE_RSA_WITH_AES_128_GCM_SHA256, TLS_DHE_DSS_WITH_AES_128_GCM_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_RSA_WITH_AES_256_CBC_SHA256, TLS_DHE_DSS_WITH_AES_256_CBC_SHA256, TLS_DHE_RSA_WITH_AES_128_CBC_SHA256, TLS_DHE_DSS_WITH_AES_128_CBC_SHA256, TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA, TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA, TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_RSA_WITH_AES_256_CBC_SHA, TLS_DHE_DSS_WITH_AES_256_CBC_SHA, TLS_DHE_RSA_WITH_AES_128_CBC_SHA, TLS_DHE_DSS_WITH_AES_128_CBC_SHA, TLS_RSA_WITH_AES_256_GCM_SHA384, TLS_RSA_WITH_AES_128_GCM_SHA256, TLS_RSA_WITH_AES_256_CBC_SHA256, TLS_RSA_WITH_AES_128_CBC_SHA256, TLS_RSA_WITH_AES_256_CBC_SHA, TLS_RSA_WITH_AES_128_CBC_SHA, TLS_EMPTY_RENEGOTIATION_INFO_SCSV]
2024-11-13 12:06:53,735 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory Starting handshake
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] jdk.event.security TLSHandshake: localhost:8443, TLSv1.3, TLS_AES_256_GCM_SHA384, 4233696218
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory Secure session established
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory negotiated protocol: TLSv1.3
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory negotiated cipher suite: TLS_AES_256_GCM_SHA384
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory peer principal: CN=localhost, OU=NIFI
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory peer alternative names: [localhost, xxx]
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.ssl.SSLConnectionSocketFactory issuer principal: CN=localhost, OU=NIFI
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.DefaultHttpClientConnectionOperator Connection established 127.0.0.1:62383<->127.0.0.1:8443
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.DefaultManagedHttpClientConnection http-outgoing-1: set socket timeout to 30000
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.http.impl.execchain.MainClientExec Executing request GET /nifi-api/site-to-site HTTP/1.1
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.http.impl.execchain.MainClientExec Target auth state: UNCHALLENGED
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] o.a.http.impl.execchain.MainClientExec Proxy auth state: UNCHALLENGED
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> GET /nifi-api/site-to-site HTTP/1.1
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> x-nifi-site-to-site-protocol-version: 1
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> Accept: application/json
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> Host: localhost:8443
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> Connection: Keep-Alive
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> User-Agent: Apache-HttpClient/4.5.14 (Java/21.0.2)
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 >> Accept-Encoding: gzip,deflate
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "GET /nifi-api/site-to-site HTTP/1.1[\r][\n]"
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "x-nifi-site-to-site-protocol-version: 1[\r][\n]"
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "Accept: application/json[\r][\n]"
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "Host: localhost:8443[\r][\n]"
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "Connection: Keep-Alive[\r][\n]"
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "User-Agent: Apache-HttpClient/4.5.14 (Java/21.0.2)[\r][\n]"
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "Accept-Encoding: gzip,deflate[\r][\n]"
2024-11-13 12:06:53,745 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 >> "[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "HTTP/1.1 200 OK[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Date: Wed, 13 Nov 2024 11:06:53 GMT[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Set-Cookie: __Secure-Request-Token=93b9c410-760b-45c2-ac57-8d0c3ef3d1f5; Path=/; Domain=localhost; Secure; SameSite=Strict[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Cache-Control: private, no-cache, no-store, no-transform[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Content-Type: application/json[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Vary: Accept-Encoding[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Content-Encoding: gzip[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Content-Security-Policy: frame-ancestors 'self'[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Strict-Transport-Security: max-age=31536000 ; includeSubDomains[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "X-Content-Type-Options: nosniff[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "X-Frame-Options: SAMEORIGIN[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "X-XSS-Protection: 0[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "Content-Length: 299[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "[\r][\n]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.wire http-outgoing-1 << "[0x1f][0x8b][0x8][0x0][0x0][0x0][0x0][0x0][0x0][0xff]][0x90][0xc1]N[0xc4] [0x10]@[0xc5][0xcc][0xb9]M[0x80][0xd2][0xee]v[0xaf]&[0xab][0x9b]hc\=[0x19][0xf][0x14][0x6]C[0xd2]BC[0xa7]z[0xd8][0xec][0xbf][0xb]q7V[0x8f][0xbc]y[0x84][0xe1][0x9d]@[0x7]O1[0xc][0x3]F[0xd8][0x9d][0xc0][0x19][0xd8][0x81][0xaa][0xf5][0xd6]Z[0xa5]J[0xc6][Vr[0xc6]Xi7[0xb2])[\r][0xb6][0xb5][0x90][0xc2][0xf6][0x86]3([0xc0][0xab][0x11][0x93][0xdd][0xb9][0xbd][0xbb][0xd9][0xf][0xe1]+![0x1d][0xc6][0x11]=[0xcd][0x9][0xa7]S\[0xbc]w[0xfe][0xe3]6,[0x9e]`[0xb7])`[0xa6]0Mh.[0x80]W[0x5]8[0xff][0xa9][0x6]w%[0xac][0x0][0xe3]f[0xd5][0xf][0xb8]"[0xce]O[0xb]=[0x85]H[0xd7]k[0x5][0x84][0x85][0xfe][0xb2][0xa4]E[0x1c][0x3][0xe1][0xd1][0x11]>[0xb8][0x99]0?[0x9c][0x85][0xe4]3YU[0xeb][0xf9]=[0xd1][0xf4][0xcf][0xd9]J[0x99][0x94]9[\r]_BV[0x8e][0xa8][0x97][0x98]>Gq[0xc1][0xbc][0xc1]L[0xca]k<[0xe4]8[0xa2][0xe6][0xbd][0xa9]5[0xcf]q[0xaa][0x9f]8[0x9b][0x86][0xf5]e[0xb3]Ei[0xa4][0x96][0x82][0xa1][0x85][0xd5][0xd6][0xa9][0xc5][0xdb][0xa5][0xab][0x90][0xb6][0xe7][0xbd][0xa8]WW[0x8d][0xb2]MYc[0xdd]6[0xaa]jQH[0xf9][0xdb][0xd5][0xc6]0>:[0xef][0xac][0x83]\NQ[0x86][0xcf][0xaf]]w[0xe8][0xee][0xe0][0xfc][0xbe][0xae][0x90][0xdf]x?[0x9f][0xbf][0x1]@C[0x9a][0x8c][0xcd][0x1][0x0][0x0]"
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << HTTP/1.1 200 OK
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Date: Wed, 13 Nov 2024 11:06:53 GMT
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Set-Cookie: __Secure-Request-Token=93b9c410-760b-45c2-ac57-8d0c3ef3d1f5; Path=/; Domain=localhost; Secure; SameSite=Strict
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Cache-Control: private, no-cache, no-store, no-transform
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Content-Type: application/json
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Vary: Accept-Encoding
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Content-Encoding: gzip
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Content-Security-Policy: frame-ancestors 'self'
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Strict-Transport-Security: max-age=31536000 ; includeSubDomains
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << X-Content-Type-Options: nosniff
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << X-Frame-Options: SAMEORIGIN
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << X-XSS-Protection: 0
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] org.apache.http.headers http-outgoing-1 << Content-Length: 299
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] o.a.http.impl.execchain.MainClientExec Connection can be kept alive indefinitely
2024-11-13 12:06:53,749 DEBUG [Timer-Driven Process Thread-4] o.a.h.c.protocol.ResponseProcessCookies Cookie accepted [__Secure-Request-Token="93b9c410-760b-45c2-ac57-8d0c3ef3d1f5", version:0, domain:localhost, path:/, expiry:null]
2024-11-13 12:06:53,750 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.PoolingHttpClientConnectionManager Connection [id: 1][route: {s}->https://localhost:8443][state: CN=localhost, OU=NIFI] can be kept alive indefinitely
2024-11-13 12:06:53,750 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.DefaultManagedHttpClientConnection http-outgoing-1: set socket timeout to 0
2024-11-13 12:06:53,750 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.PoolingHttpClientConnectionManager Connection released: [id: 1][route: {s}->https://localhost:8443][state: CN=localhost, OU=NIFI][total available: 1; route allocated: 1 of 2; total allocated: 1 of 20]
2024-11-13 12:06:53,752 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.PoolingHttpClientConnectionManager Connection manager is shutting down
2024-11-13 12:06:53,752 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.DefaultManagedHttpClientConnection http-outgoing-1: Close connection
2024-11-13 12:06:53,752 DEBUG [Timer-Driven Process Thread-4] o.a.h.i.c.PoolingHttpClientConnectionManager Connection manager shut down
2024-11-13 12:06:53,752 INFO [Timer-Driven Process Thread-4] o.a.n.remote.StandardRemoteProcessGroup Successfully refreshed Flow Contents for RemoteProcessGroup[https://localhost:8443/nifi]; updated to reflect 1 Input Ports [InputPort[name=fromMinifi, targetId=24fb1b25-0193-1000-daf6-5e596a39e244]] and 0 Output Ports [] Also, flowStatus for Remote Process Group returns that it is not transmitting and has one inactive port. 2024-11-13 11:58:30,877 INFO [main] o.apache.nifi.minifi.bootstrap.Command {"controllerServiceStatusList":null,"processorStatusList":null,"connectionStatusList":null,"remoteProcessGroupStatusList":[{"name":"NiFi Flow","remoteProcessGroupHealth":{"transmissionStatus":"NotTransmitting","hasBulletins":false,"activePortCount":0,"inactivePortCount":1},"bulletinList":null,"inputPortStatusList":null,"outputPortStatusList":null,"remoteProcessGroupStats":null}],"instanceStatus":null,"systemDiagnosticsStatus":null,"reportingTaskStatusList":null,"errorsGeneratingReport":[]}
... View more
11-12-2024
06:17 AM
@ZNFY Since you are exporting a flow definition of a process group, you'll need to utilize the MiNiFi toolkit to transform it in to the proper format that can be loaded by MiNiFi. The MiNiFi-toolkit can be downloaded from here: https://nifi.apache.org/download/ (select "MINIFI' and click download link for Toolkit). Execute: ./minifi-toolkit/bin/config.sh transform-nifi <exported flow definition> flow.json.raw Now edit the flow.json.raw file and edit the following property at start of file (value can not be 0.) "maxTimerDrivenThreadCount":5 Now you can start your MiNiFi and it will create the flow.json.gz as it starts. Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more
11-04-2024
10:50 PM
2 Kudos
Hi, I managed to fix this: In the PutFTP processor i change Dot Rename, from true to false and the Remote Path to ./path:
... View more
11-04-2024
06:51 PM
1 Kudo
The Groovy processor takes the incoming FlowFile and does stuff with it and writes a new FlowFile with the repsonse. What I tried was a JSON upload but will try "multipart/form-data" if I get a chance and see how that looks.
... View more
11-04-2024
06:26 AM
1 Kudo
@ehsan125 What version of Java is you NiFi using? This may be related to: https://issues.apache.org/jira/browse/HADOOP-19212 You could try adding a new java.arg to the nifi bootstrap.conf file as below to see if it helps: java.arg.manager=-Djava.security.manager=allow Any modifications to bootstrap.conf file will require a NiFi restart to take affect. Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more
11-04-2024
06:09 AM
2 Kudos
@shiva239 You can create an apache "NiFi" jira in the Apache community to highlight this new feature and request modification to existing processor to support it. https://issues.apache.org/jira/ The more detail you provide in your jira the better chance someone might take this on in the community. Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more
11-04-2024
06:02 AM
The problem was my StandardRestrictedSSLContextService didn't include a keystore. For some reason, I thought it was just one way SSL communication. Once I added the keystore to the ContextService it was authenticating correctly! Thanks @MattWho !
... View more
10-31-2024
08:02 PM
1 Kudo
@pankajgaikwad Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. If you are still experiencing the issue, can you provide the information Thanks.
... View more
10-31-2024
06:17 AM
1 Kudo
That's perfect !
... View more