Support Questions

Find answers, ask questions, and share your expertise

How to ingest Avro file from ftp location to HDFS through NIFI.What processors are required?

Explorer

How to ingest Avro file from ftp location to HDFS through NIFI.What processors are required? I have to create a hive table on top of it

1 REPLY 1

Super Guru

@Sudheer K

Use ListFTP processor will generate zero bytes files then use Remote Processor group for distributing the work

Flow:

1.ListFtp
2.RemoteProcessorGroup
3.InputPort
4.FetchFtp
5.PutHDFS

78439-flow.png

Refer to this, this and this link to configure RemoteProcessor groups and this and this links for more references regarding list/fetch processors in nifi.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.