About SAMSAL

SAMSAL · ‎05-06-2022

It should not matter if the format of the text inside is like csv.

SAMSAL · ‎05-05-2022

Not sure if this is the best way but try using QueryRecord and create one dynamic property to funnel the data into where your query will look like this: Select distinct * from FLOWFILE

SAMSAL · ‎05-05-2022

if this is a csv file where the first line is the header, you can easily split the source into two flowfiles: one containing all keyword1 rows and another containing all keyword2 rows using QueryRecord Processor. After you set you record writer\reader to CSV you can create two dynamic properties representing each keyword, and set the query as follows: Keyword1: SELECT * FROM FLOWFILE WHERE KeyWord like 'KeyWord1' Keyword2: SELECT * FROM FLOWFILE WHERE KeyWord like 'KeyWord2'

SAMSAL · ‎04-08-2022

Hi, I have downloaded version 1.16 which is the latest. Im trying to secure nifi with TLS and LDAP. However I keep getting the followning message : Unknown user with identity 'CN=nifi_admin, OU=NIFI'. Contact the system administrator My Nifi,properties has the following set : nifi.security.user.authorizer=managed-authorizer nifi.security.user.login.identity.provider=ldap-provider If I have set as follows it works and it accepts the cert & authentication: nifi.security.user.authorizer=single-user-authorizer nifi.security.user.login.identity.provider=single-user-provider My Authorizer file has the identity set as follows: <userGroupProvider> ...<property name="Initial User Identity 1">CN=nifi_admin, OU=NIFI</property> </userGroupProvider> <accessPolicyProvider> ... <property name="Initial Admin Identity">CN=nifi_admin, OU=NIFI</property> <property name="Legacy Authorized Users File"></property> <property name="Node Identity 1"></property> ... </accessPolicyProvider> Im trying to log in first with the cert idenitity nifi_admin so I can start adding ldap users. If I log it as single user I dont see Users & Policies menu items. Can someone help point me in the right direction.

SAMSAL · ‎02-11-2022

Thank you so much, That did the trick. You seem to be a json jolt guru. Im trying to understand it myself but its not that straight forward. Can you just elaborate this syntax for me which remove null values on the base level: "*": { "*": { "@1": "&2" } } Why there is two asterisks in front of it?

SAMSAL · ‎02-10-2022

Hi, I have the following Json. I would like to create a Jolt Spec to remove all nulls from all levels. How can I do that? Any help would be appreciated. Thanks { "ID": "c22b657e-227b-4c65-e6f8-08d88a3e1118", "Name": "SomeName", "TaggedItemName": "SomeValue", "ITRName": "SomeValue", "TestReference": null, "JobCardName": null, "Comments": "test", "PrimaryHandoverName": null, "SecondaryHandoverNumber": null, "CertificationGroupingName": null, "DocumentCode": "SomeValue", "AssignedToName": "SomeName", "DocumentReference": null, "TagITRCompletionStatusName": "Rejected", "ScheduleRevision": null, "Completed": { "SignOff_AuthP": "John", "SignOff_Date": null }, "Accepted": { "SignOff_AuthP": "Smith", "SignOff_Date": null }, "Approved": { "SignOff_AuthP": "Ali", "SignOff_Date": null }, "ScheduleGroup": null, "DownloadUri": "SomeUrl", "UpdatedDate": "2022-01-18T11:36:33.9057626Z", "CreatedDate": "2020-11-30T10:57:20.8534287Z" }

SAMSAL · ‎10-07-2021

Once it brings it it wont bring again because it will save its timestamp and then use that to get newer files added and so on.

SAMSAL · ‎10-07-2021

You really dont need a screenshot because you are not changing much properties: 1- Create ListFile Processor & set the "Input Directory" to whatever directory you want to track. 2- Create a FetchFile Processor and connect the ListFile to it via the "success" relationship. under the processor properties keep the "File to Fetch" property set to "${absolute.path}/${filename}" since the path and the file name will be set in those attributes using the ListFile and that is it. After that the content of the file will be passed via the success relation and you can do whatever you want with it just as if you are using GetFile except the ListFile will keep state of the latest file timestamp it grabbed and basically use that to grab any new files added to the folder and update the state to new timestamp and so.

SAMSAL · ‎10-07-2021

I think I know what is the problem. Since you are not doing any fragmentation -like in using split processor- try setting the Support Fragmented Transaction to False in the PUTSQL. Also remove the original \ failure connection from the Convert processor. you can mute those relationship in the convert setting table by checking the box.

SAMSAL · ‎10-06-2021

Hi, You seem to be having the correct processors and sequence. Can you share screenshot with the configuration of the put SQL. Have you configured the PUTSQL with the correct DB connection? Also are you seeing data (FlowFiles) flowing into it from the above processors. It could be that you are not getting any data to begin with or your configuration in the putSQL is incorrect. By the way why are you connecting failuer,original, sql relationship from the ConvertJsonTOSQL to the PUT SQL? you will get an error this way, you need to just connect the sql releationship. Another thing , the SQL property in the PUTSQL needs to be empty so that it process the sql received from the convert processor, if you have anything in there it will not take the sql insert from the convert processor

Online	Offline
Last Visited	‎05-08-2025 03:43 AM

Member Since	‎07-29-2020 02:31 PM
Last Visited	‎05-08-2025 03:43 AM
Posts	574
Kudos received	323

Cloudera Community

Re: CSVReader and CSVRecordSetWriter doesn't consi...

Re: Jolt spec to flatten the nested JSON

Re: CSVReader and CSVRecordSetWriter doesn't consi...

Re: Converting Nested JSON to Flat JSON using JOLT

Re: NIfi: javax.security.auth.login.LoginExceptio...

Re: [Nifi] How do I split comma separrated text f...

Re: Remove Duplicate Record values without cache s...

Re: [Nifi] How do I split comma separrated text f...

Unknown user with identity 'CN=nifi_admin, OU=NIFI...

Re: Json Jolt to Remove All Nulls from Json

Json Jolt to Remove All Nulls from Json

Re: How to schedule process to fetch only new file...

Re: How to schedule process to fetch only new file...

Re: How to use putSQL in nifi

Re: How to use putSQL in nifi