Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Input Port to ListFile/GetFile/FetchFile Processor

avatar
New Member

Hello

I have a flow which reads certain parameters and decide if it is a database ingestion or file ingestion. DB ingestions are working fine but for file ingestions i am not able to connect the flow with FetchFile/GetFile/List file processors Looks like these processors does not allow input port to connect. Is there any way or processor to get this done...? My File Ingestion templates is designed to take the input from different folders/files based on input parameters from outerflow.

1 ACCEPTED SOLUTION

avatar
Master Guru

@OS

FetchFile processor accepts incoming connections but we need to pass fully qualified filename to this processor to fetch files from the directory.

To get fully qualified filename we need to use ExecuteStreamCommand processor to run shell commands.

Refer to this link i have given in detailed answer how to get fully qualified name in middle of the flow.

Let us know if you have any issues..!!

View solution in original post

2 REPLIES 2

avatar
Master Guru

@OS

FetchFile processor accepts incoming connections but we need to pass fully qualified filename to this processor to fetch files from the directory.

To get fully qualified filename we need to use ExecuteStreamCommand processor to run shell commands.

Refer to this link i have given in detailed answer how to get fully qualified name in middle of the flow.

Let us know if you have any issues..!!

avatar
New Member

@shu, Thanks for the solution. It worked for me.