Support Questions
Find answers, ask questions, and share your expertise

Oversize queue

Oversize queue

New Contributor

hi i am working on simple scenario where i need to transfer json data to RDBMS table. so i used jsontosql --> putsql. For POC, initially I used only 100 records and everything is working as expected.

when i increased my data size to 25000. data is struck in between. I increased queue size from default 10000 to 100000. in Putsql batch size increased from 100 to 1000. but data is not inserting at all. But my expectation data size is more than billion records to process. Please suggest me, how to solve this problem. Meanwhile i faced one more issue of out memory when i increasded my json data file size to GB. My ram size is 8GB, and i configure 4gb in Nifi conf.

 

Thanks in Advance