Member since
01-26-2022
82
Posts
2
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
703 | 09-08-2022 04:02 AM | |
1665 | 07-27-2022 03:29 AM | |
1228 | 06-28-2022 09:43 PM | |
1229 | 06-27-2022 08:42 AM | |
12751 | 06-16-2022 10:29 PM |
09-08-2022
04:08 AM
Thanks for your reply, I checked CDC processor but it is specific to MySQL db. My source db is Oracle. ID is not the incremental column in the tables. There is a modifiedtime column in both table_a and table_b that shows the updated time of the row. For now I used modifiedtime column in table_a as Maximum-value Columns in QueryDatabase processor, but when modifiedtime column updated on table_b (eg. column_1 table value updated in table_b) I can't track the change in this table. Should I use another QueryDatabase processor and set modifiedtime column in table_b as Maximum-value Columns?
... View more
09-08-2022
04:02 AM
After fetching from the first DB, you can convert each record to json, the use evaluatejsonpath to extract the timestamp as attribute. then use updateAttribute processor to update timestamp attribute you extracted earlier: Let's say on evaluatejsonpath, the extracted timestamp attribute is "dTime". Then , on updateAttribute, you create same atttribute and set dTime value to ${dTime:toDate("yyyy-MM-dd hh:mm:ss"):format("yyyy-MM-dd hh:mm:ss.SSSSSS")}
... View more
09-06-2022
03:24 PM
@rafy , Same approach. Just create the processor(s) and let the files flow through it 🙂 Cheers, André
... View more
09-04-2022
01:08 PM
Thanks Mr @SAMSAL for the insight. I learned from it because i was even thinking of telling him to use EvaluateJsonPath & ReplaceText processor.
... View more
07-27-2022
03:29 AM
Thanks everyone. I have solved the problem by including dependency on the pom.xml files of nifi-custom-processors & nifi-custom-nar. The dependency is like this. <dependency> <groupId>commons-io</groupId> <artifactId>commons-io</artifactId> <version>2.11.0</version> </dependency>
... View more
07-19-2022
10:48 AM
Hi , I have modified Sql statement using replace text processor but still getting below error when I alter a table and add new column. PutDatabaseRecord processor input json: { "type" : "ddl", "timestamp" : 1658252209000, "binlog_gtidset" : "e75d07af-eb37-11ec-9d1d-a86daa745b08:1-147", "database" : "nrpsubscriptiondb2306", "table_name" : null, "table_id" : null, "query" : "ALTER TABLE `nrpreportdb`.`user_org_status` ADD COLUMN `is_test` VARCHAR(255) NULL AFTER `code`" } Error log: Record had no (or null) value for Field Containing SQL: query, FlowFile StandardFlowFileRecord[uuid=bc7d51b3-e71f-4eb2-834b-fecbcff572be,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1658226664320-3, container=default, section=3], offset=37727, length=277],offset=0,name=bc7d51b3-e71f-4eb2-834b-fecbcff572be,size=277]
... View more
07-18-2022
01:01 PM
Thanks for your help. I also chatted with one of Streamnative dev advocates & he directed me to tons of info. Unfortunately, the nars are & didn't work with on prem Nifi 1.16.3. Also, i tried to build from source files but encountered lot of errors.
... View more
07-14-2022
09:33 AM
Thank you sir. I was able to generate more users/client certificates by specifying multiple "-C CN=user1, OU=nifi" in addition to the initial command i have.
... View more