Cloudera Community
MattWho
user rank
user rank
Master Mentor

Re: ListSFTP auth failure

by Rising Star in Support Questions
‎04-16-2025 02:59 AM
‎04-16-2025 02:59 AM
@MattWho Was able to resolve the issue. The issue was with the request we are sending which was missing the "Password" value. Sorry for ticket. ... View more

Re: Concurrent task and Max Timer Driven Thread Co...

by Rising Star in Support Questions
‎04-14-2025 08:12 AM
‎04-14-2025 08:12 AM
Thanks @MattWho for your response. ... View more

Re: Escaping forward slash

by Master Mentor Master Mentor in Support Questions
‎04-11-2025 05:53 AM
‎04-11-2025 05:53 AM
@nifier  I am not seeing the same behavior as you have reported which make me think your extracted.path is not not really 0 bytes. I suggest adding another dynamic property to your update Attribute processor to output the calculated length to verify. Here is what i see after my UpdateAttribute processor (newdir is set using your shared NiFi Expression Language (NEL) statement). So I created  extracted.path with a single white space and then see what you describe, but that whitespace is a byte, so expected output: If it turns out your problem is because you have white space in the Extracted.path attribute, you could modify your NEL statement as follows: ${extracted.path:trim():length():gt(0):ifElse(${extracted.path:append('/'):append(${filename})},${filename})} You use the trim() NEL function to remove leading or trialing whitespace from the extracted.path before calculating length.  This includes trimming of a line return. So in below you will see desired output even though extracted.path length is not 0 because I trimmed white space or line return. Please help our community grow. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt   ... View more

Re: Nifi : Failed to register with Flow Registry d...

by Master Mentor Master Mentor in Support Questions
‎04-10-2025 07:09 AM
‎04-10-2025 07:09 AM
@sha257  Reviewing all your configuration files is not the first step here. I suspect your MutualTLS exchange between your NiFi and NiFi-Registry is not successful resulting in that connection resulting as "anonymous" user.  (the user you see in the NIFi-Registry UI in upper right corner before you click login to access as a different authenticated user. Put the following class in DEBUG on your NiFi-Registry via the logback.xml:org.apache.nifi.registry.web.security.authentication Start tailing the nifi-registry-app.log You'll start seeing some DEBUG log lines (will be noisy) Then attempt to start version control on some process group in NiFi which will open the version control UI n NiFi. In the nifi-registry-app.log at that moment in time you will see one of two things:   2025-04-10 13:54:53,360 DEBUG org.apache.nifi.registry.web.security.authentication.IdentityFilter: Attempting to extract user credentials using X509IdentityProvider 2025-04-10 13:54:53,361 DEBUG org.apache.nifi.registry.web.security.authentication.IdentityFilter: Adding credentials claim to SecurityContext to be authenticated. Credentials extracted by X509IdentityProvider: AuthenticationRequest{username='<NIFI certificate DN>', credentials=[PROTECTED], details=org.apache.nifi.registry.web.security.authentication.x509.X509AuthenticationRequestDetails@713e0007}   above tells you NiFi presented a trusted and clientAuth certificate at you will see that certificate's DN. In this case make sure that DN exists as a user in NiFi-Registry (case sensitive) and give that user read on "Can manage Buckets" and read, write, delete on "Can proxy user requests". or you'll see....   2025-04-10 14:01:24,162 DEBUG org.apache.nifi.registry.web.security.authentication.IdentityFilter: Attempting to extract user credentials using X509IdentityProvider 2025-04-10 14:01:24,162 DEBUG org.apache.nifi.registry.web.security.authentication.x509.X509CertificateExtractor: No client certificate found in request. 2025-04-10 14:01:24,162 DEBUG org.apache.nifi.registry.web.security.authentication.IdentityFilter: Attempting to extract user credentials using JwtIdentityProvider 2025-04-10 14:01:24,163 DEBUG org.apache.nifi.registry.web.security.authentication.AnonymousIdentityFilter: Set SecurityContextHolder to anonymous SecurityContext   Above tells you the mutualTLS exchange was not successful and the connection was established as the "anonymous" user.  In this case you need to address your certificate issue so that mutualTLS can be successful. Please help our community grow. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt ... View more

Re: PGP encryptio/decryption

by Rising Star in Support Questions
‎04-07-2025 08:13 AM
‎04-07-2025 08:13 AM
Thanks @MattWho for your response. ... View more

Re: Throttling In Apache NIFI

by Master Mentor Master Mentor in Support Questions
‎04-07-2025 06:14 AM
‎04-07-2025 06:14 AM
@Fanxxx  You have what sounds like a rather complex use case here with numerous outputs, timing controls, and routing requirements.   Control Rate is very basic in nature (allow X FlowFiles to pass every X amount of time) which depending on volume of FlowFiles can lead to a backlog that ends up  resulting in most request to fail after your 5 second requirement (including new that end up delayed more the 5 seconds because they are still queued up behind other FlowFiles behind yoru ControlRate.) Cloudera offers professional Services to its licensed users that can help design and implement complex use cases.  Assisting you through the community would require considerable back and forth and exchange of information to include test files, etc. Thank you, Matt ... View more

Re: NIFI: Unable to post AVRO message to kafka top...

by New Contributor in Support Questions
‎04-04-2025 12:51 PM
‎04-04-2025 12:51 PM
Hi Matt,  yes it was the case of null values - we updated avro schema and set default values for enums and were able to connect and post messages to kafka. Thanks ... View more

Re: Use NiFi to execute Python Script

by Master Mentor Master Mentor in Support Questions
‎04-02-2025 04:39 AM
‎04-02-2025 04:39 AM
@Rothmny  Based on what you have shared, you should be able to accomplish this with  GenerateFlowFile and ExecuteStreamCommand processors. The GenerateFlowFile processor would be configured to generate a 0 byte FlowFile and scheduled using Cron so that it creates a FlowFile on your required schedule that will then trigger the execution of the ExecuteStreamCommand processor that will execute your python script. For calling rest-api endpoints via NiFi dataflows, you could use the InvokeHTTP processor.  Since the InvokeHTTP processor does not require and inbound connection, you could just have it as first processor in a dataflows scheduled with cron as well.  Or, if the invokeHTTP is called after your script successfully executes you could trigger with the FlowFile that exited the the ExecuteStreamCommandProcessor. Please help our community grow. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt   ... View more

Re: Interacting with Nifi Paramater Context using ...

by Contributor in Support Questions
‎04-02-2025 01:44 AM
‎04-02-2025 01:44 AM
It seems after i have added necessary permission, i am able to access the context parameter via invoke HTTP   ... View more
Contact Me
Online
Offline
Last Visited
‎11-09-2025 04:56 AM
Community Statistics
Member Since ‎07-30-2019 10:41 AM
Last Visited ‎11-09-2025 04:56 AM
Posts 3,387
Kudos received 1613