question Re: Hive in HDP 2.4 and ALTERs in Support Questions

Hive in HDP 2.4 and ALTERs

davide1 — Thu, 11 Aug 2016 15:06:37 GMT

Hello

we are currently running HDP-2.3.4.0-3485 with Hive ACID and, after upgrading in our staging env to HDP-2.4.2.0-258, we cannot ALTER tables with partitions anymore.

Here is an example of a query and the error

ALTER TABLE clicks_new CHANGE COLUMN billing billing STRUCT<

Error: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Changing from type struct<cost:float,originalCost:float,currency:string,currencyExchangeRate:float,bid:struct<id:string,amount:float,originalAmount:float,currency:string,currencyExchangeRate:float>,revenue:float,revenueCurrency:string,publisherRevenue:float> to struct<cost:float,originalCost:float,currency:string,currencyExchangeRate:float,bid:struct<id:string,amount:float,originalAmount:float,currency:string,currencyExchangeRate:float>,revenue:float,revenueCurrency:string,publisherRevenue:float,revenueCurrencyExchangeRate:float> is not supported for column billing. SerDe may be incompatible (state=08S01,code=1)

This used to work with HDP-2.3, and I know it's something disabled on purpose and that will come back with HDP-2.5 and Hive 2.0, but my question is: is there some setting to re-enable the old feature (with all its limits) as in HDP-2.3?

Re: Hive in HDP 2.4 and ALTERs

cstanca — Thu, 11 Aug 2016 20:26:03 GMT

@Davide Ferrari

Unfortunately, no. This issue is fixed in Hive 1.3/2.0. See: https://issues.apache.org/jira/browse/HIVE-11421

Re: Hive in HDP 2.4 and ALTERs

davide1 — Tue, 16 Aug 2016 16:44:02 GMT

Thanks for you answer @Constantin Stanca even if I'm sorry to hear it 😞 Well, we'll update to latest 2.3 and wait eagerly for 2.5. Do you have a more or less estimate on when 2.5 will be released as stable?

Re: Hive in HDP 2.4 and ALTERs

cstanca — Thu, 18 Aug 2016 10:07:32 GMT

HDP 2.5 will be released end of August, beginning of September. Just a few weeks...

Re: Hive in HDP 2.4 and ALTERs

TimothySpann — Fri, 23 Dec 2016 00:24:44 GMT

HDP 2.5 is out now