Support Questions

Find answers, ask questions, and share your expertise

I'm new to NIFI .I want to combine several tables by union and want to fetch huge data from MySQL database tried ExecuteSQL processor but not able to fetch the huge data. Can anyone suggest how to fix this?

Explorer

I'm new to NIFI .I want to combine several tables by union and want to fetch huge data from MySQL database tried ExecuteSQL processor but not able to fetch the huge data. Can anyone suggest how to fix this?

2 REPLIES 2

Expert Contributor

Hello

 

You can try to create a db view in MySQL, and use NiFi to pull from the view instead

Super Guru

Add more RAM and CPU to your NiFi server

Add more NiFi servers to your cluster.

 

How much is HUGE DATA?    You will need some amount of RAM to process it.

 

Make sure minimum JVM RAM on each node is a good size for big workloads.   32G at least.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.