Created 06-25-2018 04:58 PM
hive-logs.txtHello Everyone,
Hive Insert query to table(have partitions) failing with vectorization enabled . It was working fine till last week.However it is running fine with vectorization disabled. Can someone help in identifying the issue.
please find the logs with vectorization enabled and disabled/turned off.
Created 06-26-2018 04:50 AM
Hi @Jalender!
Looking at your logs, it seems that Hive with Vectorization cannot process a date value.
Guess you're hitting this -> https://issues.apache.org/jira/browse/HIVE-9862
A clearly and further explanation below (on Limitations part):
https://cwiki.apache.org/confluence/display/Hive/Vectorized+Query+Execution
Could you confirm if there is any date out of the bounds?
Hope this helps!
Created 06-26-2018 04:50 AM
Hi @Jalender!
Looking at your logs, it seems that Hive with Vectorization cannot process a date value.
Guess you're hitting this -> https://issues.apache.org/jira/browse/HIVE-9862
A clearly and further explanation below (on Limitations part):
https://cwiki.apache.org/confluence/display/Hive/Vectorized+Query+Execution
Could you confirm if there is any date out of the bounds?
Hope this helps!
Created 06-26-2018 02:50 PM
@Vinicius Higa Murakami Thanks for your reply.
if we enable vectorization it corrupts timestamp values every time or it's intermittent ? because with vectorization enabled it was working fine, we are started to see this happening recently.
Created 06-26-2018 03:12 PM
Hey @Jalender!
Actually, it should work fine indeed.
Basically, you will face issues only when your datetime value is out of the range specified on that link, 1677-09-20 and 2262-04-11. So if you have any datetime more or less of this range, you'll certainly hit that fail msg.
Hope this helps!
Created 06-26-2018 03:13 PM
You don't really need to turn off the vectorization, just need to clean any date outside of the range specified for vectorization 🙂