Support Questions
Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.

Why it costs about 2 hours when we start nifi with 2000 process groups.

New Contributor

Our project use kylo which based on nifi to ETL data from database to hive,but we find that nifi start more and more slow with the feed in kylo more and more . Now it costs 2 hours which kylo has 2000 feeds.

1 ACCEPTED SOLUTION

Hi @joh snow
The version of NiFi used under Kylo is a bit different from the Apache version, but I might be able to give some advice.
Can you tell me which version of Kylo / NiFi you are using, and how many cluster nodes of what kind of hardware you are running on?

View solution in original post

2 REPLIES 2

Hi @joh snow
The version of NiFi used under Kylo is a bit different from the Apache version, but I might be able to give some advice.
Can you tell me which version of Kylo / NiFi you are using, and how many cluster nodes of what kind of hardware you are running on?

New Contributor

Hi @Dan Chaffelson

Thanks very much. The nifi version which we using is 1.3.0 . The kylo version which we useing is 0.8.4. Our cluster is standalone.

We run it in Linux which have 200G disk and 64G memory.