Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

GETFILE processor fails with the error "processor administratively yielded 1 sec due to processing failure " in NIFI(HDF).Kindly help me out.

avatar

Hi All

Transferring a file by using GETFILE processor to HDFS by using PUTHDFS, i could see the error.What are the configurations i must do to make it successful.I have added core-site.xml and hdfs-site.xml to work PUTHDFS.

Suggesions are welcome.


screenshot-12.pngconfiguration-getfile.pngconf-getfile.pngscreenshot-10.pngconfi-getfilr.png
4 REPLIES 4

avatar
Master Guru

It appears you are trying to get files from the /temp folder on the local filesystem, and that folder is not readable by the OS user running NiFi. Can you verify for the owner of the NiFi process that you can read from that folder?

avatar

Thanks for the response @matt burgess

Input directory verified the against the path and can able to read the folder,can you please mention to transfer a file is there particular directory or structure or formate file should be in.I have created a /temp/nifi to read in the local.

avatar
Master Guru

For GetFile it does not matter the structure or format of the file, but it does appear that the NiFi process cannot read from that folder.

avatar

you have to go to path where nifi is installed.and that will be hdf folder which will not be found under root or your user.

follow the steps to find go to cmd and hit this command ---> sudo docker exec -it sandbox-hdf /bin/bash

then go to path /usr/hdf/3.1.2.0-7/nifi you will see nifi related folders.

Now, create you input directory mkdir - inputdir mkdir -outputdir

that's it !

use this directories in your getfile and putfile processor.

Note: all folder permission should be NIFI as well as input data as well .

Happy Learning! let me know if any issue

posted on :Mon.Oct 22,2018