Check, if columns have the same data type

laanajar · ‎02-15-2018

Hi All, I am trying to automatise the testing of the data in Impala. Is there a way to check, if two columns from the different tables have the same data type? Currently we are doing this check manually, by describe formatted a; describe formatted b; but I would like to see result in the way: select case when a.type = b.type then "TRUE" else "FALSE" end from (describe formatted x.column1 as type) a, (describe formatted y.column1 as type) b; Can you please advise, if there is a way to implement second example? Thanks, Anastasia

laanajar · ‎02-05-2018

Thank you a lot for quick response! -------EDIT---------- Also, I have found a possible walk around with using split_part() function instead of substr() - it will work for my particular case

laanajar · ‎02-05-2018

Hi, I've upgraded Impala from 2.7.0 to 2.9.0 and one of my queries stopped working after that. On running this query: select first_value(transxref) over (partition by substr(gbm.transxref,1,(instr(gbm.transxref,'/'))-1) order by substr(gbm.transxref,1,(instr(gbm.transxref,'/'))-1), reportdate) from gbm_partition gbm I receive error: "IllegalStateException: null" But if I will change order by clause and will run query below - it will work. select first_value(transxref) over (partition by substr(gbm.transxref,1,(instr(gbm.transxref,'/'))-1) order by transxref, reportdate) from gbm_partition gbm 1. Can anybody please suggest, if there are any incompatibilities between 2.7.0 and 2.9.0 (I haven't found anything in Release Notes)? 2. If there are - can anybody please suggest a workaround for this issue? Thanks in advance, Anastasiia

Online	Offline
Last Visited	‎02-16-2018 04:31 AM

Date Registered	‎02-05-2018 08:57 AM
Last Visited	‎02-16-2018 04:31 AM
Total Messages Posted	3
Total Kudos Received	1

Check, if columns have the same data type

Re: IllegalStateException: null using first_value ...

IllegalStateException: null using first_value func...