Support Questions

Find answers, ask questions, and share your expertise

putHDFS processor errors in Nifi

avatar
Super Collaborator

39434-pushhdfs-processor-error.jpg

I want to write the kafa topics to hdfs , I am getting the messages in the nifi queue (I can view them in nifi) but the putHDFS processor is not writing them and throwing an error (see the attached screenshot)
1 ACCEPTED SOLUTION

avatar
Master Guru

@Sami Ahmad, make sure you having you have given

hive-site.xml,core-site.xml,hdfs-site.xml

Paths in Hadoop Configuration Resources property and if you are using kerberos then you need to specify Kerberos Principal, Kerberos Keytab properties in PutHDFS processor.

Example:-

40435-puthdfs-configs.png

View solution in original post

4 REPLIES 4

avatar
Master Guru

@Sami Ahmad, make sure you having you have given

hive-site.xml,core-site.xml,hdfs-site.xml

Paths in Hadoop Configuration Resources property and if you are using kerberos then you need to specify Kerberos Principal, Kerberos Keytab properties in PutHDFS processor.

Example:-

40435-puthdfs-configs.png

avatar
Super Collaborator

thanks ..that fixed it .

avatar
New Contributor

Hi,

Would you please elaborate on why Hive configuration is needed?

 

Thanks

avatar
Explorer

Hi,

I did the same thing that you mentionned here, but I'm still having the same error, can you help me, I have two EC2 machine the first one is HDF machine and the another one is HDP machine, I could put data into hbase in HDP, but is not possible to putHDFS into the HDP server, see below you will see the error that I'm having and my configuration

errorlog.png

puthdfsconfiguration.png

thanks you for your help