Member since
02-12-2021
10
Posts
0
Kudos Received
0
Solutions
11-30-2021
02:05 AM
Hey, we are running a Nifi cluster that connects to a Hive database to pull some data. After a period of time we get the below error.
: java.net.SocketException: Broken pipe (Write failed).: java.sql.SQLException: org.apache.thrift.transport.TTransportException: java.net.SocketException: Broken pipe (Write failed)
Our current solution is to restart the Hive Controller services and this refresh's the connection and the process works again, this is obviously not ideal for a production implementation. We have also set the Kerberos user's timeout to be a large number of days in the hive-site.xml but the issue still persists. We are running Nifi version 1.12.1. Any help is very much appreciated.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
-
Kerberos
08-13-2021
08:23 AM
Hi Matt, Thank you for your response. If I am reading the issues correctly this fix will not be deployed until version 1.15 is released?
... View more
08-11-2021
02:44 AM
Hi, We have recently upgraded Nifi to 1.14 and are now receiving this error when trying to write to HDFS. "Failed to write to HDFS due to java.lang.NoClassDefFoundError: com/fasterxml/jackson/annotation/JsonIncludeProperties: java.lang.ClassNotFoundException: com.fasterxml.jackson.annotation.JsonIncludeProperties ↳ causes: java.lang.NoClassDefFoundError: com/fasterxml/jackson/annotation/JsonIncludeProperties" I have checked and all the jackson libraries are there. If anyone has any ideas it would be very much appreciated .
... View more
Labels:
- Labels:
-
Apache NiFi
-
HDFS
02-22-2021
07:08 AM
Hi turns out it was a permissions issue, so I had created a policy to allow the user to view the data provenance inside the Process Group but for that to work you need to add a global policy to allow that user to view the data provenance. Seems like a bit of a hack to me but thats what I had to do to get it working. Thanks for your help
... View more
02-18-2021
09:13 AM
Hi, I am having trouble getting the data provenance displaying in a clustered environment in Nifi. I have set all the required access policies and still the data provenance is empty. Any suggestions at this point is very much appreciated.
... View more
Labels:
- Labels:
-
Apache NiFi
02-12-2021
01:24 AM
Hi, Could you provide a link to the Hortonworks hive nar file. The one provided in your answer seems to be broken. I am having a similar issue with NIFI and zookeeper and would like to test your solution out. Thank you in advance.
... View more