Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Unable to copy file from NIFI to HDFS

Solved Go to solution
Highlighted

Unable to copy file from NIFI to HDFS

I am trying to copy a file from Sandbox to HDFS using NIFI. File is succesfully picked up from NIFI using GetFile Processor but PutHDFS is not getting finished and its in progress for long time.

Let me share the configuration for the GetFile and PutHDFS:

GetFile

15295-getfile.png

PutHDFS

15296-puthdfs.png

I have placed the core-site.xml and hdfs-site.xml into NIFI root. And also I have created a folder MyData in HDFS (hadoop fs -mkdir /MyData) to output the file.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Unable to copy file from NIFI to HDFS

Master Guru
@Muhammad Umar

Try providing the absolute path to your core-site.xml and hdfs-site.xml files in the putHDFS processor. Make sure these two files are readable by the user running your NiFi. Tail your nifi-app.log before staring the processor to see if it throws any error or warn log messages.

Thanks,

Matt

View solution in original post

2 REPLIES 2
Highlighted

Re: Unable to copy file from NIFI to HDFS

Master Guru
@Muhammad Umar

Try providing the absolute path to your core-site.xml and hdfs-site.xml files in the putHDFS processor. Make sure these two files are readable by the user running your NiFi. Tail your nifi-app.log before staring the processor to see if it throws any error or warn log messages.

Thanks,

Matt

View solution in original post

Highlighted

Re: Unable to copy file from NIFI to HDFS

Master Guru

@Muhammad Umar

Did changing to absolute paths resolve your issue here?

If so, please mark answer as accepted.

Thank you,

Matt

Don't have an account?
Coming from Hortonworks? Activate your account here