About SAMSAL

SAMSAL · ‎09-01-2022

Hi , you can use QueryRecord Processor. For more information please see: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.12.1/org.apache.nifi.processors.standard.QueryRecord/additionalDetails.html If you find this helpful please accept solution. Thanks

SAMSAL · ‎08-31-2022

Hi , Not sure if this is possible with out of the box processor. I can think of ReplaceText first to replace different delimiters like (-) or white-space (\s) to common delimiter like (,) however if there is a white space before or after other delimiters like (-) or (,) its not going to work. Another option is to use ExecuteScript processor where you try to read each line (after the header) from the flowfile content and then use string split function and try it with different delimiter, once you get two array elements you construct your new string with the new column header and delimiter and transfer to the success relationship.

SAMSAL · ‎08-31-2022

Hi , You can use JoltJsonTransform Processor for that. So lets assume we have the following input: [ { "_id": "5d55246b9ac36012c14b5e7c", "gtin": "4009602235038", "articleNumber": "59218-376", "styleGroupId": "59218", "colorGroupId": "376", "brand": { "_id": "57f75950a56ab89d1973ee36" } } ] Add JoltTranformJson processor and set the Jolt Specification property to the following, notice this property allows you to use Expression Language therefore you can reference attributes in the flowfile: [ { "operation": "modify-default-beta", //for modify-overwrite-beta "spec": { "*": { "target.sku": "${target.sku}" } } } ] This will produce the following Json: [ { "_id" : "5d55246b9ac36012c14b5e7c", "gtin" : "4009602235038", "articleNumber" : "59218-376", "styleGroupId" : "59218", "colorGroupId" : "376", "brand" : { "_id" : "57f75950a56ab89d1973ee36" }, "target.sku" : "someValue" } ] If you find this helpful please accept solution. Thanks

SAMSAL · ‎08-26-2022

Hi , Is not every record you pull through the GenerateTableFetch will have the max value for the max column?

SAMSAL · ‎08-24-2022

Hi, Thanks for providing the diagram. Not sure if you can have both InvokeHttp in one group where one comes after the other instead of using two groups and input\output ports, but if you can then you can take advantage of the ForkEnrichment\JoinEnrichment processors (available in 1.16 and higher) using the following pattern: If both invokehttp output have the same order for the records then you can use the Wrapper or Insert Enrichment strategy, if the records are not in the same order you can use SQL strategy. For more information check the JoinEnrichment user manual : https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.17.0/org.apache.nifi.processors.standard.JoinEnrichment/additionalDetails.html Hope that helps. If it does please accept solution.

SAMSAL · ‎08-23-2022

Hi, The full picture is not clear on how your flow works, for example where do you get the json that goes through the jolt processor and input port from? Is there a correlation between getting the json from the different sources where one json is generated before the other or the two json sources are independent of each other? If they are independent of each other then how do you know when to merge , for example what if the json from the input port did not come? Can you explain more on how your flow works and if there is a dependency where one json input drives the other or not?

SAMSAL · ‎08-18-2022

Hi, In the ExecuteSQL or ExecuteSQLRecord you have Pre Query, Select Query and Post Query properties. In the Pre Query can you declare variables to store the output parameters, run the stored proc passing those parameter and then insert them into a temp table which then you can use the Select Query property to read the values from the temp table and that will translate to flowfiles. If you are using the ExecuteSQLRecord you can define in which format you want the flowfile in by defining the record writer property. Hope that helps.

SAMSAL · ‎08-17-2022

Hi, Try the following Expression: ${since:toDate('yyyy-MM-dd'):toNumber():plus(86400000):format('yyyy-MM-dd')} If you find this helpful please accept solution. Thanks

SAMSAL · ‎08-08-2022

The lookupRecrod processor allows you to specify multiple lookup columns in the DatabaseRecordLookupService incase the id is not enough. I had a similar sitution and I usually defer this kind of check to the DB, so my workflow will call stored proc - with the record parameters - that will check if the record exist or not and based on that decide wither to update or insert. This way Im making only one connection to the DB.

SAMSAL · ‎08-05-2022

Hi , What is the flowfile content format? Is there an Id you can check using the LookupRecord processor to see if the record already exists or not?

Online	Offline
Last Visited	‎05-08-2025 03:43 AM

Member Since	‎07-29-2020 02:31 PM
Last Visited	‎05-08-2025 03:43 AM
Posts	574
Kudos received	323

Cloudera Community

Re: CSVReader and CSVRecordSetWriter doesn't consi...

Re: Jolt spec to flatten the nested JSON

Re: CSVReader and CSVRecordSetWriter doesn't consi...

Re: Converting Nested JSON to Flat JSON using JOLT

Re: NIfi: javax.security.auth.login.LoginExceptio...

Re: Extract a column from csv

Re: Separate CSV column by delimiter or whitespace

Re: how do Add attributes to a json file

Re: Extracting state from GenerateTableFetch proce...

Re: combining the Json data from two different pro...

Re: combining the Json data from two different pro...

Re: Execute Oracle stored procedure returning a cu...

Re: Date plus one day with update attribute

Re: Proof whether flowfile content already exists ...

Re: Proof whether flowfile content already exists ...