Member since
07-30-2019
2906
Posts
1442
Kudos Received
844
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
51 | 04-17-2024 11:30 AM | |
55 | 04-16-2024 05:36 AM | |
34 | 04-15-2024 05:31 AM | |
119 | 04-03-2024 05:59 AM | |
132 | 04-02-2024 01:22 PM |
04-08-2024
02:09 AM
1 Kudo
@Adhitya, Did the response assist in resolving your query? If it did, kindly mark the relevant reply as the solution, as it will aid others in locating the answer more easily in the future.
... View more
04-04-2024
05:07 AM
3 Kudos
Connecting Salesforce with Hortonworks Data Flow (powered by Apache NiFi) unlocks powerful data integration. Here's how: NiFi Processors: Utilize processors like "InvokeHTTP" to call Salesforce APIs and retrieve data. Real-Time or Batch: Move data bi-directionally (Salesforce to NiFi or vice versa) in real-time or batches. Data Transformation: Cleanse, transform, and enrich data using NiFi's processors before storing it in your data lake. This salesforce integration helps you leverage valuable Salesforce data for analytics, reporting, and deeper customer insights.
... View more
04-02-2024
09:34 AM
Yes the controller service was working before aks version upgrade
... View more
04-01-2024
06:48 AM
1 Kudo
@ALWOSABY This looks related to the driver version you may be using in the processor. Perhaps trying a different driver version may resolve you issue. Perhaps try ojdbc6 version 11.1.0.7.0? Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more
04-01-2024
02:44 AM
1 Kudo
Thanks a lot @MattWho
... View more
03-30-2024
03:33 AM
1 Kudo
I have try something like below which worked. Once Dim1 is completed Dim2:- 1: Attribute to capture StartDate - UpdateAttribute 2: Create Log table in database which will maintain the LastRunTime 3: Custom SQL where updateddate>=$LastRunTime using ExecuteSQL 4: Insert the records in database 5: Update the log file with StartTime attribute from step one1
... View more
03-29-2024
10:23 AM
1 Kudo
@jame1997 Not much to look at from a NiFi side. NiFi is writing to the network successfully and there is some loss then happening between NiFi and your syslog server. Resource usage affecting your NiFi would only slow down processing but not result in dataloss within NiFi. So the PutSyslog would successfully write all bytes to the network before passing the FlowFile to the "success" relationship. Using TCP of course would allow NiFi to confirm successful delivery thus allowing NiFi to appropriately retry, or route to either failure or success relationships. You could look at the data rate NiFi is writing from the putSyslog by looking at the stats on the processor. Then maybe you could experiment with: 1. netstat - nsu to check for UDP packet loss. 2. using a network monitoring tool Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more
03-29-2024
07:06 AM
1 Kudo
@DeepakDonde https://issues.apache.org/jira/browse/NIFI-12513 does not mention GetHTTP processor, so you could certainly try that processor to see if you experience the same issue. Downgrade would lose all improvements and bug fixes introduced in Apache NiFi 1.25. Otherwise you could wait until 1.26 is released that contains the fix. The InvokeHTTP processor is part of the NiFi Standard nar which includes a lot of NiFi components. You could also try Downloading just the 1.24.0 standard nar from the maven central repository and adding it the extensions folder of your 1.25.0 NiFi. This would make both the 1.24 and 1.25 versions of many components available in your NiFi. You could then use the 1.24 version of the invokeHTTP over the 1.25 version that has issue. This would allow you to continue to use 1.25 version for all other components. While i have added multiple version of the same nar to my NiFi installations in the past, I have not done so with the standard nar. If you have issues, you can stop your NiFi, remove the added nar and restart so thing go back to previous. https://mvnrepository.com/artifact/org.apache.nifi/nifi-standard-shared-nar/1.24.0 https://repo1.maven.org/maven2/org/apache/nifi/nifi-standard-shared-nar/1.24.0/nifi-standard-shared-nar-1.24.0.nar Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more
03-28-2024
08:30 AM
Thank you @MattWho . You are awesome!
... View more