Member since
09-02-2020
26
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2333 | 09-02-2020 11:24 PM |
04-25-2022
02:59 AM
I'm having difficulty with this processor and making sure I get all the security stuff correct. I've got no problem with everything downstream, but when it comes to Keystore/Truststore stuff I'm like a potato in a forgotten cellar. For now, just to test, I have this (nifi 1.15.3): And the SSL Context: Where my jks was generated using (with testing values) keytool -genkey -alias nifi-ftps -keyalg RSA -keypass MyKeyPass312 -storepass MyStorePass312 -keystore nftp.jks When I log on with Filezilla it gets to this point: Status: Connecting to my.server.ip... Status: Using username "nifitest". Status: Access denied Error: Authentication failed. Error: Critical error: Could not connect to server Which I assume means the ports etc are all good and it can connect to the Processor - but I'm missing something in my SSL settings. I have tried changing FileZilla to use a key file but it only uses PPK or PEM files. This is my java version: sudo java -version
openjdk version "1.8.0_312"
OpenJDK Runtime Environment (build 1.8.0_312-8u312-b07-0ubuntu1~20.04-b07)
OpenJDK 64-Bit Server VM (build 25.312-b07, mixed mode)
... View more
Labels:
- Labels:
-
Apache NiFi
08-03-2021
11:12 PM
Hi @DennisJaheruddi I managed to speak to some devs on Slack and we found a related issue, posted below. https://issues.apache.org/jira/projects/NIFI/issues/NIFI-8749 Hopefully it gets fixed soon so that we can upgrade to 1.14.0 +
... View more
07-30-2021
02:07 AM
Hi @DennisJaheruddi Unfortunately seems I cannot access the support ticket area - not enough privileges. All I need to know if this is a bug (in which case I stay with 1.12.1) or if this is a new "feature" in which case I need to update all my flows when upgrading to 1.14.0.
... View more
07-20-2021
11:11 PM
Is there any way to reach the Devs to know if this is intentional or not? I need to upgrade a bunch of servers from 1.12.2 to 1.14.0, but I also need to know if we first have to add a bunch of processors to deal with this timezone change from PutDatabaseRecord.
... View more
07-19-2021
11:10 PM
My data source is not QueryDatabaseTable, it is json received from another source. Do I need to convert JSON to AVRO now before using PutDatabaseRecord? Also, if I do add a new ConvertRecord processor for every PutDatabaseRecord I have, these do not have the "Use Avro Logical Types: TRUE" option either.
... View more
07-19-2021
07:42 AM
I live in a GMT +2 timezone but we collect all our data as GMT. My PutDatabaseRecord processor receives JSON with one field being the timestamp, e.g.: 2021-07-19 14:52:39 If I look at the flowfile just before the PutDatabaseRecord processor this timestamp is correct. However it gets inserted into the database as 2021-07-19 16:52:39 I can't find any documentation on how to prevent this in 1.14.0. Any idea what to do? Currently I'm subtracting an additional 2 hours to make up for this but that's not a good permanent fix. Edit: Is this perhaps related to this issue? @mburgess : if not and this is a bug then I can give more info. https://issues.apache.org/jira/browse/NIFI-8768?jql=text%20~%20%22time%20zone%20JsonTreeReader%22 Edit 2: this worked previously in 1.12.2
... View more
Labels:
- Labels:
-
Apache NiFi
07-12-2021
07:28 AM
The only fix I've found so far is to update the Record Reader of this processor: * Make sure it is not inferred * Write the schema with the order of the record fields matching the order of the table fields. I'm not sure if there was a reason this was changed or of this is a bug?
... View more
07-12-2021
07:03 AM
Did you find a fix? Just upgraded from 1.12.2 to 1.13.2 and got a lot of these errors. PutDatabaseRecord[id=af45e8dc-985b-3f7a-5959-539aa4e7fe9d] Failed to put Records to database for StandardFlowFileRecord[uuid=a398eafb-1fba-441c-81bc-c50509b74ed4,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1626097496241-29, container=default, section=29], offset=171430, length=172],offset=0,name=a398eafb-1fba-441c-81bc-c50509b74ed4,size=172]. Routing to failure.: Operand type clash: int is incompatible with datetime2 PutDatabaseRecord[id=08642c9d-0ce6-3277-79ec-fd5dc8990ba9] Failed to put Records to database for StandardFlowFileRecord[uuid=47f06505-9a47-40c2-b708-21c76466a555,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1626097496241-29, container=default, section=29], offset=174092, length=433],offset=0,name=50e9f73b-c3ee-4d22-8bde-4c2ec306400a,size=433]. Routing to failure.: For input string: "nifi2" PutDatabaseRecord[id=3287e964-c2fb-3cff-345a-d0c11af60271] Failed to put Records to database for StandardFlowFileRecord[uuid=5d060b61-93ef-497b-983c-ef51596202cd,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1626097434922-28, container=default, section=28], offset=683211, length=377],offset=0,name=177de348-4f8c-4ce1-b450-c0eb45b51c9e,size=377]. Routing to failure.: The conversion from String to DECIMAL is unsupported. An exact copy of this flow on 1.12.2 works perfectly well.
... View more
06-11-2021
04:01 AM
Just to add to the above, I am getting a lot of the below errors. All the devices sending data via http POSTS are on cellular networks with some having bad signal. Could this be causing the difference between posts the HandleHttpRequest processor receives vs the amount of flowfiles it creates? ERROR POST from HandleHttpRequest[id=da9f6288-5359-38e9-cb70-1c832b186f63] Failed to receive content from HTTP Request from 10.0.2.2 due to java.util.concurrent.TimeoutException: Idle timeout expired: 60000/60000 ms: java.io.IOException: java.util.concurrent.TimeoutException: Idle timeout expired: 60000/60000 ms Sorry about the bump but I'm really struggling to get to the bottom of this.
... View more