you can try below set parameters set hive.vectorized.execution.reduce.enabled=false; and  set hive.vectorized.execution.enabled=true; ... View more

The malformed rows are so random it is very difficult to find them in number of large files . Is there a way to skip to those malformed data wile inserting . I have used 'ignore.malformed.json'='true' , But it did not work ... View more

Below is my select statement . I am actually loading avro data into a table1(all the files are loaded properly in to the table) and inserting the table's data to a different table2 . I have been getting vertex failed error while inserting the data some files , but some are loading fine during the insert. If file is the reason for this error (corrupted file) How can I skip the corrupted data during the insert . Below is the insert statement ADD jar <jar_path>; ADD jar <jar path>; CREATE TEMPORARY FUNCTION keyvalue as 'com.abc.GetKeyValuesUdf'; set hive.execution.engine=tez; set hive.exec.dynamic.partition=true; insert into DB.<table_name> partition(data) ... View more