Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

I'm new to NIFI .I want to combine several tables by union and want to fetch huge data from MySQL database tried ExecuteSQL processor but not able to fetch the huge data. Can anyone suggest how to fix this?

avatar
Explorer

I'm new to NIFI .I want to combine several tables by union and want to fetch huge data from MySQL database tried ExecuteSQL processor but not able to fetch the huge data. Can anyone suggest how to fix this?

2 REPLIES 2

avatar
Expert Contributor

Hello

 

You can try to create a db view in MySQL, and use NiFi to pull from the view instead

avatar
Master Guru

Add more RAM and CPU to your NiFi server

Add more NiFi servers to your cluster.

 

How much is HUGE DATA?    You will need some amount of RAM to process it.

 

Make sure minimum JVM RAM on each node is a good size for big workloads.   32G at least.