About ahmedalsaidi

ahmedalsaidi · ‎04-09-2023

I am consuming a messages from IBM MQ using processor (ConsumeJMS), then once you explore as a "List queue" you will see the following type and format: Hence, I added a following processor (ExtractText 1.16.1) in order to search for some texts using regular expression as following: (ACT.A.EMS..ST...AIR|ACT.X.EMS..ST...AIR) Finally, Sometimes the results of regular expression are valid and sometimes it satisfies a half of my condition because: 1) if it does not match anything hence it match only the part of my condition. 2) or if the half of my condition is valid; hence it will match! Is there something wrong I am doing in my regular expression or something else? or I need to change type, format, or content type (application/octet-stream) to text so that I can search correctly instead of viewed as a hex? I hope my explanation was fine and clear for everyone. Thanks!

ahmedalsaidi · ‎03-27-2023

Thanks @SAMSAL , everything it works fine....

ahmedalsaidi · ‎03-26-2023

Hi @SAMSAL , it gives the following number of flow files (forever), although the source flow file as provided in the question around 3 ACT.As and 2 ACT.Xs. I hope my explanation was fine and ok.

ahmedalsaidi · ‎03-23-2023

Once I d SplitJson processor, it give so many flow files, how to limit to the number of input flow file. For example, in my example here: we have 5 ACTs (means we have 5 records in the target database table)

ahmedalsaidi · ‎03-23-2023

Ignore my statement, it is ok now, but I did not finish the pipeline yet, I will let you know back again once I done

ahmedalsaidi · ‎03-23-2023

Hi, I think the jolt spec is incorrect because one of parentheses are more or less at 5th line. If you can help me on this I appreciate it.

ahmedalsaidi · ‎03-19-2023

Hi All, Greetings! Assume that I have a data flow, and the final result is inserting to the SQL database (Microsoft), but the step before! I have the following JSON format for each flow file content as following: { "sbrActivityType" : { "1" : "ACT+A", "3" : "ACT+A", "2" : "ACT+X", "5" : "ACT+X", "4" : "ACT+X" }, "sbrDateTime" : "Sun Mar 19 13:45:15 AST 2023" } Then, my desired output format look like the following: INSERT INTO sbrTestNifiData (sbrActivityType, sbrDateTime) VALUES (?, ?) So, it does not insert correctly to my database table which is looks like the following: CREATE TABLE [dbo].[sbrTestNifiData]( [sbrId] [int] IDENTITY(1,1) NOT NULL primary key, [sbrActivityType] [varchar](50) NULL, [sbrDateTime] [varchar](50) NULL ); So, it should inserted to my database table as a five records: sbrId sbrActivityType sbrDateTime 1 ACT+A Sun Mar 19 11:56:40 AST 2023 2 ACT+A Sun Mar 19 11:56:40 AST 2023 3 ACT+X Sun Mar 19 11:56:40 AST 2023 4 ACT+X Sun Mar 19 11:56:40 AST 2023 5 ACT+X Sun Mar 19 11:56:40 AST 2023

ahmedalsaidi · ‎02-05-2020

Dears, I have to two different databases and the data inside them are identical: MemSql DB Postgre DB Frequently data changed In future, I would like to sync the data between those DBs to capture the data when its changed in the main DB which is the PostgreDB and reflect that changes in the memSql DB. Is there a way using Nifi to capture data changed in the Postgre DB and move the data changed to MemSql DB? I look forward to hearing from you soon. Regards, Ahmed

Online	Offline
Last Visited	‎05-03-2023 02:14 AM

Member Since	‎02-03-2020 11:19 PM
Last Visited	‎05-03-2023 02:14 AM
Posts	11
Kudos received	2

Cloudera Community

Issue in Regular expression in nifi

Re: Convert json to multiple insert sql format

Re: Convert json to multiple insert sql format

Re: Convert json to multiple insert sql format

Re: Convert json to multiple insert sql format

Re: Convert json to multiple insert sql format

Convert json to multiple insert sql format

Change Data Capture in Databases Using Apache Nifi