Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created on 05-11-2017 10:21 AM - edited 08-17-2019 06:20 PM
I am trying to copy a file from Sandbox to HDFS using NIFI. File is succesfully picked up from NIFI using GetFile Processor but PutHDFS is not getting finished and its in progress for long time.
Let me share the configuration for the GetFile and PutHDFS:
GetFile
PutHDFS
I have placed the core-site.xml and hdfs-site.xml into NIFI root. And also I have created a folder MyData in HDFS (hadoop fs -mkdir /MyData) to output the file.
Created 05-11-2017 12:00 PM
Try providing the absolute path to your core-site.xml and hdfs-site.xml files in the putHDFS processor. Make sure these two files are readable by the user running your NiFi. Tail your nifi-app.log before staring the processor to see if it throws any error or warn log messages.
Thanks,
Matt
Created 05-11-2017 12:00 PM
Try providing the absolute path to your core-site.xml and hdfs-site.xml files in the putHDFS processor. Make sure these two files are readable by the user running your NiFi. Tail your nifi-app.log before staring the processor to see if it throws any error or warn log messages.
Thanks,
Matt
Created 05-17-2017 03:16 PM
Did changing to absolute paths resolve your issue here?
If so, please mark answer as accepted.
Thank you,
Matt