Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

NiFi PutHDFS & create missing directories

avatar
Expert Contributor

Hello,

From using the NiFi's PutHDFS processor, it seems it creates missing directories in HDFS by default, but documentation doesn't specify whether it would or would not create missing directories and there are no properties related to it (like there is one for PutFile I believe). Does anyone know anything more about this "undocumented" feature, if I can call that.

My only concern is, if this is not a documented feature, does this feature (creating missing directories) work reliably in a Production environment.

Did i miss this in the documentation ?

Thanks.

1 ACCEPTED SOLUTION

avatar
Master Guru

PutHDFS will always create the directory if it does not exist:

https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-hadoop-bundle/nifi-hdfs-processors/...

I don't see any concerns about this working any differently in production.

View solution in original post

2 REPLIES 2

avatar
Master Guru

PutHDFS will always create the directory if it does not exist:

https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-hadoop-bundle/nifi-hdfs-processors/...

I don't see any concerns about this working any differently in production.

avatar
Expert Contributor

Thanks @Bryan Bende for confirming, good to know; since I didn't see it in the documentation, I was concerned.