About Ghilani

Ghilani · ‎08-25-2025

In NiFi 2.4 and above, the Jython engine is no longer available in ExecuteScript. Previously, I used scripts like this to read and update attributes: val = flowFile.getAttribute('x') flowFile = session.putAttribute(flowFile, 'x', str(int(val) + 10)) Now I want to do the same using Python in NiFi 2.4+: Read an attribute (e.g., x) Compute a new value Write it back as an attribute (or a new one) Keep the original FlowFile content unchanged What’s the recommended way in NiFi 2.4+? Any official docs, samples, or best practices for this scenario would be very helpful.

MattWho · ‎02-06-2025

@Ghilani The Invalid SNI is caused by the server certificate presented in the TLS exchange not containing a SubjectAlternativeName (SAN) matching the hostname in the request URL. Valid SAN entries are required by the latest version of Java. The solution is to issue new certificates for your NiFi instance(s) that contain all possible SANs used when connecting to the NiFi. So you should have a SAN entry for you NiFi hostname as well as any alternative names used in connection URLs like "nifi" coming form your proxy to NiFi. Please help our community grow. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt

BadKarma · ‎11-21-2024

For remote access to login page, just add to c:/windows/system32/drivers/etc/hosts your server IP and hostname same on linux, /etc/hosts

steven-matison · ‎06-26-2023

@Ghilani You should know these 3 articles intimately if you want to use Execute Script https://community.cloudera.com/t5/Community-Articles/ExecuteScript-Cookbook-part-1/ta-p/248922 https://community.cloudera.com/t5/Community-Articles/ExecuteScript-Cookbook-part-2/ta-p/249018 https://community.cloudera.com/t5/Community-Articles/ExecuteScript-Cookbook-part-3/ta-p/249148 That said, it's sometimes helpful for me to see a working example and modify from there. As such, here is a github with a sample flow definition file (01_Fraud_Detection_Demo_Params_ExecuteScript.json) and script file(Fraud Demo ExecuteScript.py) that should work out of the box: https://github.com/cldr-steven-matison/Fraud-Prevention-With-Cloudera-SSB/tree/main/Templates Pay attention to imports and, then line 160 is what you want to get the flowfile. My flow ignores the content, but you should be able to find references in the Part 1 cookbook for anything you want to do w/ flowfile content.

MattWho · ‎12-05-2022

@Ghilani NiFi stores Templates in the flow.xml.gz file. the flow.xml.gz is just a compressed copy of dataflow(s) which reside inside NiFi's heap memory while NiFi is running. It is not recommended to keep templates in your NiFi. NiFi templates are also deprecated and will go away in next major release. It is recommended to use NiFi-registry to store version controlled flows. If not using NiFi-Registry, Flow definitions should be downloaded instead of creating templates and stored safely somewhere outside of NiFi itself. A flow definition can be downloaded by right clicking on a process group in NiFi and selecting "Download flow definition". This json file will be generated of that flow and downloaded. Flow definitions can be uploaded to NiFi by dragging the create Process Group icon to the canvas and selecting option to upload flow definition. If you found that the provided solution(s) assisted you with your query, please take a moment to login and click Accept as Solution below each response that helped. Thank you, Matt

Ghilani · ‎11-10-2022

I think everything works fine, the json flowfiles are the response of an invokeHttp request to an API, I receive more than 5000 flowfiles, each flowfile contains 200 records. Problems happen only with 4 files that contain the ETX symbol.

SAMSAL · ‎06-20-2022

I apologize for that, I hope someone else step in and help you with better solution. May I just know why it did not help?

SAMSAL · ‎06-16-2022

Sorry I forgot to mention that in the PutSql processor set the Batch Size property to 1

MattWho · ‎05-06-2022

@Ghilani While I agree that using record based processors so you can work with single FlowFiles with multiple records in them to make more efficient dataflows, what you are doing here should be possible with a ReplaceText processor in the interim using "Literal Replace": Here we are searching for the pattern _" and replacing it with just ". If you found this response assisted with your query, please take a moment to login and click on "Accept as Solution" below this post. Thank you, Matt

Online	Offline
Last Visited	‎08-25-2025 05:20 AM

Member Since	‎04-30-2022 05:38 PM
Last Visited	‎08-25-2025 05:20 AM
Posts	21
Kudos received	2

Cloudera Community

How to update FlowFile attributes in Python now th...

Re: HTTP ERROR 400 Invalid SNI When Accessing NiFi...

Re: Access failed after apache nifi installation

Re: How can we read a flowfile content with a pyth...

Re: Where does Nifi store templates?

Re: How to remove ETX character from json value ?

Re: How to store json object in a variable using a...

Re: How to load json record to postgres as json da...

Re: how to replace the underscore "_" at the end o...