Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Input Port to ListFile/GetFile/FetchFile Processor

Solved Go to solution
Highlighted

Input Port to ListFile/GetFile/FetchFile Processor

New Contributor

Hello

I have a flow which reads certain parameters and decide if it is a database ingestion or file ingestion. DB ingestions are working fine but for file ingestions i am not able to connect the flow with FetchFile/GetFile/List file processors Looks like these processors does not allow input port to connect. Is there any way or processor to get this done...? My File Ingestion templates is designed to take the input from different folders/files based on input parameters from outerflow.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Input Port to ListFile/GetFile/FetchFile Processor

Super Guru

@OS

FetchFile processor accepts incoming connections but we need to pass fully qualified filename to this processor to fetch files from the directory.

To get fully qualified filename we need to use ExecuteStreamCommand processor to run shell commands.

Refer to this link i have given in detailed answer how to get fully qualified name in middle of the flow.

Let us know if you have any issues..!!

2 REPLIES 2

Re: Input Port to ListFile/GetFile/FetchFile Processor

Super Guru

@OS

FetchFile processor accepts incoming connections but we need to pass fully qualified filename to this processor to fetch files from the directory.

To get fully qualified filename we need to use ExecuteStreamCommand processor to run shell commands.

Refer to this link i have given in detailed answer how to get fully qualified name in middle of the flow.

Let us know if you have any issues..!!

Re: Input Port to ListFile/GetFile/FetchFile Processor

New Contributor

@shu, Thanks for the solution. It worked for me.