Member since
08-24-2016
2
Posts
0
Kudos Received
0
Solutions
08-26-2016
07:17 AM
partition is two types, 1.static, 2.dynamic, splitting the data concept, see this blog for more good example to learn hive partition and bucketing
... View more
08-24-2016
07:33 AM
hive doesn't support DML queries,
if create a ACID property to do this,
set this properties SET hive.support.concurrency=true; SET hive.enforce.bucketing=true; SET hive.exec.dynamic.partition.mode=nonstrict; SET hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager; SET hive.compactor.initiator.on=true;
SET hive.compactor.worker.threads=1; SET hive.support.concurrency=true; SET hive.enforce.bucketing=true; then create a hive table using bucketing and stored as ORC file format,
then do the update and delete queries in hive,
for more information on hive DML go this blog for step by step process http://www.geoinsyssoft.com/hive-dml-update-delete-operations/ , hive doesn't support DML queries,
if create a ACID property to do this,
set this properties
SET hive.support.concurrency=true;
SET hive.enforce.bucketing=true;
SET hive.exec.dynamic.partition.mode=nonstrict;
SET hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
SET hive.compactor.initiator.on=true;
SET hive.compactor.worker.threads=1;
SET hive.support.concurrency=true;
SET hive.enforce.bucketing=true;
then create a hive table using bucketing and stored as ORC file format,
then do the update and delete queries in hive,
for more information on hive DML go this blog for step by step process
http://www.geoinsyssoft.com/hive-dml-update-delete-operations/
... View more