Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to ingest large scale bigdata using nifi cluster?

How to ingest large scale bigdata using nifi cluster?

New Contributor

Hi I'm joon as a junior bigdata engineer. I wanna ingest very large scale bigdata using Nifi. but I don't know how to design nifi clustering architecture and nifi processors. so, if you know how to design, let me know how to do. datasource? target source? everything is ok. plz give me your know-how. thanks :)

3 REPLIES 3

Re: How to ingest large scale bigdata using nifi cluster?

Guru

Hi @YoungJoon Ji

There is a good article here explaining NiFi's zero-master clustering: https://hortonworks.com/blog/apache-nifi-1-0-0-zero-master-clustering/

You may want to look at the tutorials online to get familiar with NiFi and the processors:

https://hortonworks.com/tutorial/realtime-event-processing-in-hadoop-with-nifi-kafka-and-storm/

Re: How to ingest large scale bigdata using nifi cluster?

New Contributor

Thanks @Sonu Sahi

I will read it. and If you have another things or idea, plz write your opinions you have. then I will appreciate you.

Highlighted

Re: How to ingest large scale bigdata using nifi cluster?

Cloudera Employee

Hey @YoungJoon Ji,

I've just created this article to help you on this thread.

https://community.hortonworks.com/articles/135337/nifi-sizing-guide-deployment-best-practices.html

I hope it helps!

Cheers,

Thiago Santiago