Member since
07-29-2020
352
Posts
109
Kudos Received
105
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
54 | 12-06-2023 12:31 PM | |
58 | 12-05-2023 03:49 AM | |
86 | 12-03-2023 04:54 PM | |
102 | 12-03-2023 12:02 PM | |
49 | 12-02-2023 06:49 AM |
05-05-2022
03:06 PM
you can do that using ExtractText Processor to extract the line that you need with word "bind" into an attribute using regular expression "(bind.+$)", then you ReplaceText processor to basically located the same line using the same regular expression and the the replacement value is the attribute from the ExtractText processor (assume its called XYZ) like this ${XYZ:replace(" ","")}
... View more
05-05-2022
12:57 PM
1 Kudo
Not sure if this is the best way but try using QueryRecord and create one dynamic property to funnel the data into where your query will look like this: Select distinct * from FLOWFILE
... View more
05-05-2022
12:48 PM
1 Kudo
if this is a csv file where the first line is the header, you can easily split the source into two flowfiles: one containing all keyword1 rows and another containing all keyword2 rows using QueryRecord Processor. After you set you record writer\reader to CSV you can create two dynamic properties representing each keyword, and set the query as follows: Keyword1: SELECT * FROM FLOWFILE WHERE KeyWord like 'KeyWord1' Keyword2: SELECT * FROM FLOWFILE WHERE KeyWord like 'KeyWord2'
... View more
04-08-2022
05:40 AM
Hi, I have downloaded version 1.16 which is the latest. Im trying to secure nifi with TLS and LDAP. However I keep getting the followning message : Unknown user with identity 'CN=nifi_admin, OU=NIFI'. Contact the system administrator My Nifi,properties has the following set : nifi.security.user.authorizer=managed-authorizer nifi.security.user.login.identity.provider=ldap-provider If I have set as follows it works and it accepts the cert & authentication: nifi.security.user.authorizer=single-user-authorizer nifi.security.user.login.identity.provider=single-user-provider My Authorizer file has the identity set as follows: <userGroupProvider> ...<property name="Initial User Identity 1">CN=nifi_admin, OU=NIFI</property> </userGroupProvider> <accessPolicyProvider> ... <property name="Initial Admin Identity">CN=nifi_admin, OU=NIFI</property> <property name="Legacy Authorized Users File"></property> <property name="Node Identity 1"></property> ... </accessPolicyProvider> Im trying to log in first with the cert idenitity nifi_admin so I can start adding ldap users. If I log it as single user I dont see Users & Policies menu items. Can someone help point me in the right direction.
... View more
Labels:
- Labels:
-
Apache NiFi
02-11-2022
11:10 AM
Thank you so much, That did the trick. You seem to be a json jolt guru. Im trying to understand it myself but its not that straight forward. Can you just elaborate this syntax for me which remove null values on the base level: "*": { "*": { "@1": "&2" } } Why there is two asterisks in front of it?
... View more
02-10-2022
10:16 AM
Hi,
I have the following Json. I would like to create a Jolt Spec to remove all nulls from all levels. How can I do that? Any help would be appreciated. Thanks
{ "ID": "c22b657e-227b-4c65-e6f8-08d88a3e1118", "Name": "SomeName", "TaggedItemName": "SomeValue", "ITRName": "SomeValue", "TestReference": null, "JobCardName": null, "Comments": "test", "PrimaryHandoverName": null, "SecondaryHandoverNumber": null, "CertificationGroupingName": null, "DocumentCode": "SomeValue", "AssignedToName": "SomeName", "DocumentReference": null, "TagITRCompletionStatusName": "Rejected", "ScheduleRevision": null, "Completed": { "SignOff_AuthP": "John", "SignOff_Date": null }, "Accepted": { "SignOff_AuthP": "Smith", "SignOff_Date": null }, "Approved": { "SignOff_AuthP": "Ali", "SignOff_Date": null }, "ScheduleGroup": null, "DownloadUri": "SomeUrl", "UpdatedDate": "2022-01-18T11:36:33.9057626Z", "CreatedDate": "2020-11-30T10:57:20.8534287Z" }
... View more
Labels:
- Labels:
-
Apache NiFi
11-04-2021
05:59 AM
Hi, Best way I can think of store that attribute name in another attribute. You can also use execute script processor and read the attribute name you are looking for as in : var myAttr = flowFile.getAttribute('filename') and if the value is not null then you can route the flow File to the desired relationship. For more information on how to use the execute script processor: https://community.cloudera.com/t5/Community-Articles/ExecuteScript-Cookbook-part-1/ta-p/248922
... View more
10-14-2021
02:32 PM
can you share the jolt script so I can take a look?
... View more
10-13-2021
03:30 AM
Hi, Have you tried using JsonJolt processor. Its like json transformation from one format to another. Im not Json jolt expert myself but I found a link that might help you in what you are trying to do: https://www.titanwolf.org/Network/q/1600720e-fcfb-4711-bce6-4cca97006d16/y
... View more
10-07-2021
05:50 PM
Matt, Thanks for your reply. Basically I have two local nifi's: one is that 1.11 and another is 1.14 both of them are setup almost identical in the nifi.properties, however 1.11 is working when passing the azure workspace key and Id and the other 1.14 throwing the error. the log file doesnt have much info besides the message I posted above but here is the stack trace from the log file if that helps in anyway: java.lang.RuntimeException: HTTP/1.1 403 Forbidden at org.apache.nifi.reporting.azure.loganalytics.AbstractAzureLogAnalyticsReportingTask.postRequest(AbstractAzureLogAnalyticsReportingTask.java:164) at org.apache.nifi.reporting.azure.loganalytics.AbstractAzureLogAnalyticsReportingTask.sendToLogAnalytics(AbstractAzureLogAnalyticsReportingTask.java:147) at org.apache.nifi.reporting.azure.loganalytics.AzureLogAnalyticsReportingTask.sendMetrics(AzureLogAnalyticsReportingTask.java:137) at org.apache.nifi.reporting.azure.loganalytics.AzureLogAnalyticsReportingTask.onTrigger(AzureLogAnalyticsReportingTask.java:107) at org.apache.nifi.controller.tasks.ReportingTaskWrapper.run(ReportingTaskWrapper.java:44) at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Im hoping someone can try the same on their end to verify if they are getting the same results
... View more