About Sipping1n0s

Sipping1n0s · ‎11-16-2023

Thank you, I am thankful for all of your tips and hints. I'm going to accept this as a solution. I'll create a new ones, as needed. Again, thank you.

Sipping1n0s · ‎11-15-2023

@SAMSAL , I am impress with the details. Thank you. I am learning and not sure how some details will work, yet. For example, if I have plan on having 20 concurrent Put*Record and it will need to repeat for many times to cover 200 million rows in the table. When there are 19 of Puts, what is needed to do to start a new Put and the total Puts will not be over 20, concurrently? Secondly, I have a one NiFi server. Can I have 20 Puts concurrently running? It would have been fine executing 20 curls from terminals from that one single NiFi Server. On a different topic, if I Accept, how can I follow up with questions?

Sipping1n0s · ‎11-14-2023

good questions. The other system is liked elasticsearch/solr. it has api to allow multiple concurrent curl commands to bulk insert csv files.

Sipping1n0s · ‎11-14-2023

I have a source table with 200 million of rows, which needs to fetch to another system. The other system offer a batch insert. Is there an NiFi example I can follow that will read a source table and split the data into to 20 chucks and make 20 batch inserts, concurrently?

Sipping1n0s · ‎10-19-2021

Hi, I would like to know which platform I should download to try Cloudera on my desktop (16GB/1TB SSD). I would prefer a docker solution which would allow me to test the docker on multiple clouds.

Online	Offline
Last Visited	‎11-16-2023 09:47 PM

Member Since	‎10-19-2021 03:42 PM
Last Visited	‎11-16-2023 09:47 PM
Posts	5

Cloudera Community

Re: how to split and batch insert

Re: how to split and batch insert

Re: how to split and batch insert

how to split and batch insert

is there docker image for multi-clouds deployment