Member since
08-16-2019
32
Posts
0
Kudos Received
0
Solutions
07-25-2018
08:33 PM
@Shu I used couple of replace text processor to fix it. All good. Thanks
... View more
07-25-2018
04:09 PM
@Shu One last thing. I just noticed My queries doesn't like [] at the end of each line. This is created by update record. How can I remove /avoid them ? Please let me know. Thanks for all your help
... View more
07-25-2018
02:57 PM
Thanks @Shu . For some reason, I was earlier caught up that some text needs to be entered.It didn't strike in my mid that an empty line can be used. I tried above and it works totally fine. Thanks a Lot.You are awesome
... View more
07-25-2018
05:02 AM
Thanks @Shu. I tried Merge Content processor with delimiter strategy as text then demarcator as shift+enter. Shift+Enter string is being added after every record. Here is the sample Purchase":"1363.95"}]}}}]shift+enter[{"key":{"A Ami doing something wrong. I am just using all the default options in the MergeContent except mentioned above
... View more
07-24-2018
09:22 PM
@Shu Thanks a lot, Split text is working. One last thing, Now , I am trying to merge the files back after UpdateRecord is done.All the records in the merge is merging into one single line. I want them to be in the seperate line. Please let me know. Thanks
... View more
07-24-2018
12:15 AM
Thanks @Shu for promptly responding. My issue is slightly different. I have number of records (10) in the same file due to mergeJson for example,My file has [{"account":{"id":1}},{"account":{"id":2}}]
[{"account":{"id":3}},{"account":{"id":4}}]
[{"account":{"id":5}},{"account":{"id":6}}]
It replace 1,2 succesfully but not 3,4,5,5
Please assist. Thanks in advance
... View more
07-24-2018
12:12 AM
Thanks @Shu for promptly responding. My issue is slightly different It has various records in the same file because merging few Json files. For example, [{"account":{"id":1}},{"account":{"id":2}}]
[{"account":{"id":3}},{"account":{"id":4}}]
[{"account":{"id":5}},{"account":{"id":6}}]
It works for the first line 1,2 but not for 3,4 ,5,6.
Appreciate your helpcapture.jpg. Screenshot attached as well
... View more
07-23-2018
11:06 PM
@Shu Thanks for the information. I tried the first approach mentioned by you.It works fine. But, the problem is,it is applied to only first line of my Json file and skips the rest. I am applying this logic on the Merg Json file which has many records.But, for some reason,it applies to the first line My reg expression is something like this replaceRegex(/account/id, '(^.*$)', '99999999999'). Please help! Thanks
... View more
07-20-2018
09:12 PM
I have to migrate data from Prod to test .But, My prod data has sensitive information in the Json file. I want to replace values of dozen sensitive fields with random data. How can I accomplish that using NIFI For example the following SSN value should be replaced with 11111, etc ,"ssn":"5010040000022626666666", "name":"john" should be replaced with bob , etc Your help is appreciated Thanks
... View more
Labels:
- Labels:
-
Apache NiFi
07-12-2018
11:12 PM
Hi Matt, Thanks for the information. The queries i have written would take care of delta load. But i have to execute couple of queries at the same time. I want a processor that can run multiple queries at the same time. Below is how my query looks like ---------------------------------------------------------- with max_row_id as( select max(row_id) as MAX from target table) insert into dc_transdetail_orc select * from staging table join target table where row_id > max_row_id
... View more