Member since
04-04-2019
2
Posts
1
Kudos Received
0
Solutions
04-08-2019
05:16 PM
any help?
... View more
04-05-2019
05:13 AM
1 Kudo
a 'create table ..' command in HDP 3.x results in the table becoming transactional/insert-only table. +----------------------------------------------------+ | createtab_stmt | +----------------------------------------------------+ | CREATE TABLE `ytemp.emps`( | | `empid` int, | | ROW FORMAT SERDE | | 'org.apache.hadoop.hive.ql.io.orc.OrcSerde' | | STORED AS INPUTFORMAT | | 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' | | OUTPUTFORMAT | | 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat' | | LOCATION | | 'hdfs://xxxx/ytemp.db/emps' | | TBLPROPERTIES ( | | 'bucketing_version'='2', | | 'transactional'='true', | | 'transactional_properties'='insert-only', | | 'transient_lastDdlTime'='1554244939') | +----------------------------------------------------+ tables created by 'create table .' command did not have the 'transactional'='true', 'transactional_properties'='insert-only', in HDP 2.x. These types of tables (transactional) are not readable by Spark or Presto. I understand, that this is the default behavior in HDP 3.x. But this breaks backward compatibility with HDP 2.x (where Hive managed tables were not transactional tables by default). Can someone please recommend a way to disable hive managed tables becoming transactional?, as this is a big impediment for migrating to HDP 3.x from HDP 2.x Note: I don't want to create 'external tables'
... View more
Labels:
- Labels:
-
Apache Spark