question Re: putHDFS processor errors in Nifi in Support Questions

putHDFS processor errors in Nifi

aliyesami — Sun, 18 Aug 2019 07:27:30 GMT

I want to write the kafa topics to hdfs , I am getting the messages in the nifi queue (I can view them in nifi) but the putHDFS processor is not writing them and throwing an error (see the attached screenshot)

Re: putHDFS processor errors in Nifi

Shu_ashu — Sun, 18 Aug 2019 07:27:22 GMT

@Sami Ahmad, make sure you having you have given

hive-site.xml,core-site.xml,hdfs-site.xml

Paths in Hadoop Configuration Resources property and if you are using kerberos then you need to specify Kerberos Principal, Kerberos Keytab properties in PutHDFS processor.

Example:-

Re: putHDFS processor errors in Nifi

aliyesami — Thu, 21 Sep 2017 03:02:20 GMT

thanks ..that fixed it .

Re: putHDFS processor errors in Nifi

diego_ayala — Sun, 13 May 2018 01:12:53 GMT

Hi,

I did the same thing that you mentionned here, but I'm still having the same error, can you help me, I have two EC2 machine the first one is HDF machine and the another one is HDP machine, I could put data into hbase in HDP, but is not possible to putHDFS into the HDP server, see below you will see the error that I'm having and my configuration

errorlog.png

puthdfsconfiguration.png

thanks you for your help

Re: putHDFS processor errors in Nifi

Rolexim — Tue, 02 Jun 2020 12:14:32 GMT

Hi,

Would you please elaborate on why Hive configuration is needed?

Thanks