Member since
07-29-2020
558
Posts
307
Kudos Received
167
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
110 | 11-28-2024 06:07 AM | |
76 | 11-25-2024 09:21 AM | |
212 | 11-22-2024 03:12 AM | |
114 | 11-20-2024 09:03 AM | |
313 | 10-29-2024 03:05 AM |
10-06-2021
01:27 PM
Take a look at the Nifi ListFile & Fetch File processors. They both work together. The ListFile will read files metadata based on the last read file modified date and will keep state of that so that only newly added files will be read. The fetch file will take the filename parameter from the ListFile processor and fetch the contents. Hope that helps
... View more
10-04-2021
04:58 PM
Can some one help verify this please. Im thinking that there is bug in the 1.14 version around this, because I have tried the same ReportingTask on version 1.11.4 against the same Azure Log Analytics workspace ID and Key and its working, so that tells me its not something with Azure. Both versions have the same settings when it comes to nifi.web.https and nifi.remote.input properties except for nifi.remote.input.socket.port where its set for different ports. Thank you.
... View more
10-01-2021
07:03 PM
Hi, Im having strange situation and I would really appreciate your help. Basically I was able to setup AzureLogAnalyticsReportingTask (Nifi 1.14) on a cluster and it was working after providing the Workspace ID and Key so I was able to see the log under Azure CustomLog and create my queries and dashboard, however after couple of days it started generating the following error: AzureLogAnalyticsReportingTask [id=] Failed to publish metrics to Azure Log Analytics: java.lang.RuntimeException: HTTP/1.1 403 Forbidden Not sure what happened. I re enter the workspace ID and Key but that did not help. Cam you please help. Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
09-27-2021
08:02 PM
I think the problem is that you are trying to evaluate path on a list of sensors: sensor":[{"sensor_id":"Data05_37_alarm","value ":"0"},{"sensor_id":"Data06_37_alarm","value":"0"}.... you probably need to flatten json first and if you are trying to get each sensor information then you need to do splitjson and then you can do evaluatejsonpath. Hope that helps.
... View more
09-25-2021
03:57 PM
Its Solved after upgrading to 1.14.0
... View more
09-25-2021
03:55 PM
Its Solved in the latest version 1.14.0. I'm not sure if they addressed this issue in later releases of 1.13 version
... View more
07-16-2021
11:33 AM
This appears to be fixed in the latest release 1.14.0. I will mark this as resolved. thanks
... View more
06-20-2021
11:43 AM
Hi, I have downloaded the latest version of Nifi 1.13.2. In one of my flows Im using an Execute script processor that utilizes python engine which I know it was working without problems in an older (version 1.11.4). I noticed when the processor executes for the first time it works then if you stop it and re run again it hangs and the flow files get stuck in the upstream queue. Initially I thought something in my script is causing the issue so I change it to something as simple as this flowFile = session.get() if flowFile != None: # All processing code starts at this indent session.transfer(flowFile, REL_SUCCESS) Even with this simple script the processor hangs and the flow files remain in the queue. This is a major issue and its causing me not to upgrade. Not sure if you are aware of it and if if there is anything that can be done to mitigate. please advise.
... View more
Labels:
- Labels:
-
Apache NiFi
05-20-2021
05:04 PM
Hi Matt, Thank you very much for taking the time and explaining how this process works. I spent a lot of time trying to troubleshoot the issue and I think I was able to resolve. what caught my eye in other similar post is the case of DN being authenticated and authorized which what you also highlighted "...which means the DN form that clientAuth certificate is going to be the user that needs to be authorized for both the "retrieve Site-To-Site details" and "receive data via site-to-site" NiFi authorization policies". Im not a security expert here but I assume DN refers to Domain, right? In any case for me to resolve this issue I had to do the following: 1- In the "SiteToSiteBulletinReportingTask" properties I kept the default value for "Instance URL" which is "http://${hostname(true)}:8080/nifi" despite my nifi instance is being secured. Im stil not very clear what this value is for and the tutorial doesnt give much info on and I always thought it has to match what is set for the Destination URL but its not. 2- In Nifi I have added the user "CN=localhost , OU=NIFI" and made sure to give it all kind of permission including view & modify data. Im thinking since my domain is "locahost" and the domain "DN" is what is being authenticated\authorized I needed to create this user account. 3- In the nifi.properties file I made sure the following properties are set as follows: nifi.remote.input.host= nifi.remote.input.secure= nifi.remote.input.socket.port=8080 nifi.remote.input.http.enabled=true If I set the "nifi.remote.input.secure" to true then I will keep getting 403 Forbidden error despite my instance is secured! Not sure if all of the above helped or combination of it but at least its working and I'm able to replicate playing with those parameters. Im hoping someone from the Nifi community can maybe elaborate more on this to confirm as Im not a security expert. Thank you.
... View more
05-18-2021
10:46 AM
Hi, I have SiteToSiteBulletinReportingTask setup to capture bulletin information for a standalone secure nifi instance. the reporting task is pointing to an input port as expected but when I start the task it doesnt work and it keeps giving this warning: SiteToSiteBulletinReportingTask[id=e99b03f1-0173-1000-c7ef-4e475ed2416d] org.apache.nifi.remote.client.PeerSelector@24677b11 Unable to refresh Remote Group's peers due to response code 403:Forbidden with explanation: null" The reporting task is setup as follows: The SSL context service is setup with the same values for the keystore and truststore as in the nifi.properties file which is working to secure my instance. I have added the policy "receive data via site-to-site" to the input port "S2S_Bulletins_rec" . The user created by securing the instance has the policy "retrieve site-to-site details". The error doesn't give much details. Can you please help? Thank you.
... View more
Labels:
- Labels:
-
Apache NiFi