Created 07-06-2017 05:14 PM
set mapred.max.split.size=67108864; set mapred.min.split.size=1024; set hive.execution.engine=tez; insert overwrite table bdd.signal_hte partition(cvdt36_year,cvdt36_mon,cvdt36_day) select * from cv.signal_hte where cvdt36_year= "2015" and cvdt36_mon =05;
Created 07-06-2017 05:22 PM
For tez, you need to use below parameter to set min and max splits of data:
Increase min and max split size to reduce the number of mappers.
Created 07-06-2017 05:22 PM
For tez, you need to use below parameter to set min and max splits of data:
Increase min and max split size to reduce the number of mappers.
Created 07-06-2017 05:56 PM
1003608529
still the size remain same
Created 07-06-2017 05:58 PM
if I do it for one day record it is working If I do for entire one year it still remain same.
Created 07-06-2017 06:02 PM
insert overwrite table Mynewtable partition(cvdt36_year,cvdt36_mon,cvdt36_day) select * from MainTable where cvdt36_year= "2015" and cvdt36_mon =05 and cvdt36_day=16;
If I run this query it is working fine
insert overwrite table Mynewtable partition(cvdt36_year,cvdt36_mon,cvdt36_day) select * from MainTable where cvdt36_year= 2015; it is not working can you suggest me with correct query.
Created 07-06-2017 06:10 PM
There is no syntax issue with query, could you please share the issue you are facing?