03-26-2018 03:40 AM - edited 03-26-2018 03:41 AM
I'am trying to insert 200,000 records into hive text table using jdbc driver and sql insert statements.
I use Statement.addBatch method and executeBatch per 9000 rows.
Now it takes 60 seconds for every 9000 rows insertion. I've tried to use 15 000 or 20 000 batch size - but i can't get a response from hive using this batch size - it hangs.
Is this batch functionality supported by the driver or i have to use something else?