Member since
03-29-2023
55
Posts
32
Kudos Received
3
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3082 | 04-05-2024 12:26 PM | |
| 4198 | 03-05-2024 10:53 AM | |
| 22194 | 04-03-2023 12:57 AM |
06-05-2024
12:31 AM
1 Kudo
hi SAMSAL, i send you message. Can you check it please ?
... View more
05-21-2024
12:57 AM
1 Kudo
How to Resolve SNI issue when upgrading to NiFi 2.0 https://medium.com/@chnzhoujun/how-to-resolve-sni-issue-when-upgrading-to-nifi-2-0-907e07d465c5#:~:text=Due%20to%20the%20upgrade%20to,400%3A%20Invalid%20SNI%20will%20occur
... View more
04-15-2024
09:34 AM
1 Kudo
@Ytch All components on the NiFi canvas are executed as the NiFi service user and not as the user currently authenticated into the NiFi service. So what you should do is from each host in your NiFi cluster (do on every host since any one of the hosts can be elected as the primary node at any given time), open a command prompt window/console window, become the user that owns the NiFi process, and manually ssh/sftp to the target SFTP server. You will likely be prompted to add the target SFTP server to your known_hosts file for the NiFi service user. NiFi SFTP processor has no way of doing this interactive step. After successfully adding the SFTP to the known_hosts file for the NiFi service user, go back and try to start the GetSFTP or ListSFTP processors again to see if your issue is resolved. If not, please share your GetSFTP and ListSFTP processor component configurations. Also check the nifi-app.log for any exceptions or log output related to these processors. If no log output, you could also try enabling debug in the NiFi logback.xml for these processor classes to see what additional log output may be produced that could be useful here. classes for these processors are: org.apache.nifi.processors.standard.GetSFTP
org.apache.nifi.processors.standard.ListSFTP new log lines would look like this that you would add to logback.xml: <logger name="org.apache.nifi.processors.standard.GetSFTP" level="DEBUG"/>
<logger name="org.apache.nifi.processors.standard.ListSFTP" level="DEBUG"/> Simply add them in logback.xml where you see similar lines already. Please help our community thrive. If you found any of the suggestions/solutions provided helped you with solving your issue or answering your question, please take a moment to login and click "Accept as Solution" on one or more of them that helped. Thank you, Matt
... View more
04-08-2024
08:43 AM
@darkcoffeelake Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.
... View more
04-05-2024
12:26 PM
1 Kudo
Hi @Nicanor , Let's take a below example: Json Input: [
{
"cloud_base": [
"3500",
"15000"
],
"cloudType": [
"Stratocumulus",
"Altocumulus"
]
}
] Jolt Spec: [
{
"operation": "shift",
"spec": {
"*": {
"cloud_base": {
"*": {
"*": {
"@1": "cloud_base_&"
}
}
},
"cloudType": {
"*": {
"*": {
"@1": "cloudType_&"
}
}
}
}
}
}
] Output: {
"cloud_base_3500" : "3500",
"cloud_base_15000" : "15000",
"cloudType_Stratocumulus" : "Stratocumulus",
"cloudType_Altocumulus" : "Altocumulus"
} "Accept as Solution" if its work for you.
... View more
04-04-2024
12:13 AM
1 Kudo
I got the Solution. Use UpdateAttribute processor and Expression Language. Here "SignedURL" is the attribute (containing complex Json) and from that I fetch particular Key value using Expression Language (JSONPATH)
... View more
03-30-2024
03:33 AM
1 Kudo
I have try something like below which worked. Once Dim1 is completed Dim2:- 1: Attribute to capture StartDate - UpdateAttribute 2: Create Log table in database which will maintain the LastRunTime 3: Custom SQL where updateddate>=$LastRunTime using ExecuteSQL 4: Insert the records in database 5: Update the log file with StartTime attribute from step one1
... View more
03-05-2024
10:53 AM
Hello @MattWho , Thank you for the reply. Initially, I thought it would be best to include all the details in the ticket to avoid any confusion. Here's what I discovered: When the API was first executed, it fetched 100 records. Let's consider that all issues in JIRA contain different types of information, such as packages, bugs, epics, stories, and modules and they will have different columns . When fetching a small number of rows, the data appeared consistent, but when fetching data for 4-5 months, the data structure changed. For example, a bug might have 3 columns, a story might have 8, and epic might have 3. Consequently, all records had missing columns filled with null values. Here's an example: Bug 1: Columns A, B, C
Story 2: Columns A, B, C, D, E, F, G
Epic 3: Columns A, B As a result, the final records looked like this: {
A: Value,
B: Value,
C: Value,
D.:null,
E: null,
F: null,
G: null
},
{
A: Value,
B: Value,
C: Value,
D.:Value,
E: Value,
F: Value,
G: Value
},
{
A: Value,
B: Value,
C: null,
D.:null,
E: null,
F: null,
G: null
} To address this issue, I used the SplitJSON processor to split the records and process them individually . This resolved the issue. However, after implementing this solution, I encountered another issue where the choice list was not inserting records. I managed to handle this issue as well, and now everything is working fine.
... View more
03-02-2024
07:55 AM
1 Kudo
Hi @saquibsk , The UpdateRecord processor uses the Nifi Record Path syntax to traverse record structure : https://nifi.apache.org/docs/nifi-docs/html/record-path-guide.html When your Replacement Value Strategy is set to Record Path Value then the path has to adhere to the record path syntax as explained in the link. The record path allows you to update structured data even if you have more than one record in an array of records. Please see the documentation here as well for more help: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.7.1/org.apache.nifi.processors.standard.UpdateRecord/additionalDetails.html If you are having more issues it would help to provide sample input and the expected output result alongside the relevant processors configuration screenshot. This will enable the community to help you better and resolve your issue faster. If you find this is helpful please accept solution. Thanks
... View more
- « Previous
-
- 1
- 2
- Next »