Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

NiFi PutHDFS & create missing directories

avatar
Expert Contributor

Hello,

From using the NiFi's PutHDFS processor, it seems it creates missing directories in HDFS by default, but documentation doesn't specify whether it would or would not create missing directories and there are no properties related to it (like there is one for PutFile I believe). Does anyone know anything more about this "undocumented" feature, if I can call that.

My only concern is, if this is not a documented feature, does this feature (creating missing directories) work reliably in a Production environment.

Did i miss this in the documentation ?

Thanks.

1 ACCEPTED SOLUTION

avatar
Master Guru

PutHDFS will always create the directory if it does not exist:

https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-hadoop-bundle/nifi-hdfs-processors/...

I don't see any concerns about this working any differently in production.

View solution in original post

2 REPLIES 2

avatar
Master Guru

PutHDFS will always create the directory if it does not exist:

https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-hadoop-bundle/nifi-hdfs-processors/...

I don't see any concerns about this working any differently in production.

avatar
Expert Contributor

Thanks @Bryan Bende for confirming, good to know; since I didn't see it in the documentation, I was concerned.