Support Questions
Find answers, ask questions, and share your expertise

Intermittent HDFS Processor Issues


HI, So we are having issues with some of our HDFS processors in Nifi. For our dataflow we are using PutHDFS, MoveHDFS and DeleteHDFS. From time to time the processors fail with two different errors

  • Input Directory or File does not exist in HDFS
  • Authentication Required

There is no real pattern as to when these errors happen. The file does reach HDFS but sometimes the move or delete will fail. We are using Nifi 1.12.1 and connect to HDFS using Kerberos authentication. Has anyone seen similar behavior or able to shed some light on the issue.

Thank you in advance.