I have a hive table created with OpenCSVSerde. When I upload the CSV to hive with
load data local inpath 'final.csv' OVERWRITE into table etltemp.table_staging;
There are some NULL rows (all fields are null) found. I sampled check and "grep" the CSV, and did not spot any exceptional rows nor empty line. Have spent some time to google and docs, and I can't find any method to debug/investigate on NULL row issue in hive.
Do we have any ways to identify which rows in the "final.csv" have issues? Or what kind of data issue will make Serde to treat it as null? Thanks