Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Why it costs about 2 hours when we start nifi with 2000 process groups.

Solved Go to solution
Highlighted

Why it costs about 2 hours when we start nifi with 2000 process groups.

New Contributor

Our project use kylo which based on nifi to ETL data from database to hive,but we find that nifi start more and more slow with the feed in kylo more and more . Now it costs 2 hours which kylo has 2000 feeds.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Why it costs about 2 hours when we start nifi with 2000 process groups.

Hi @joh snow
The version of NiFi used under Kylo is a bit different from the Apache version, but I might be able to give some advice.
Can you tell me which version of Kylo / NiFi you are using, and how many cluster nodes of what kind of hardware you are running on?

View solution in original post

2 REPLIES 2

Re: Why it costs about 2 hours when we start nifi with 2000 process groups.

Hi @joh snow
The version of NiFi used under Kylo is a bit different from the Apache version, but I might be able to give some advice.
Can you tell me which version of Kylo / NiFi you are using, and how many cluster nodes of what kind of hardware you are running on?

View solution in original post

Highlighted

Re: Why it costs about 2 hours when we start nifi with 2000 process groups.

New Contributor

Hi @Dan Chaffelson

Thanks very much. The nifi version which we using is 1.3.0 . The kylo version which we useing is 0.8.4. Our cluster is standalone.

We run it in Linux which have 200G disk and 64G memory.

Don't have an account?
Coming from Hortonworks? Activate your account here