Reply
Explorer
Posts: 20
Registered: ‎05-02-2017

HIVE - transactions not working - any help is highly appreciable

We have the following

 

HiveServer2

HiveMetaStoreServer

We using postgresl Database as metastore (shared )

both for hive / impala .

Hue server  - for data analysts

 

Right know we are using ORC table format.

I understand  all the necessary prequist for hive delete update operations

we are managing the cluster using Clouldera Manager . My only question is where does the below configuration go in Safety valve . When they service and Client side . I am confused any help is highly appreciable man

 

we fire query from Hue web interface .

 

Client Side

    hive.support.concurrency – true
    hive.enforce.bucketing – true (Not required as of Hive 2.0)
    hive.exec.dynamic.partition.mode – nonstrict
    hive.txn.manager – org.apache.hadoop.hive.ql.lockmgr.DbTxnManager
Server Side (Metastore)

    hive.compactor.initiator.on – true (See table below for more details)
    hive.compactor.worker.threads – a positive number on at least one instance of the Thrift metastore service

 

 

Posts: 519
Topics: 14
Kudos: 92
Solutions: 45
Registered: ‎09-02-2016

Re: HIVE - transactions not working - any help is highly appreciable

@MattPatt

 

There are two options

 

1. Temporary setup. Go to Hue -> Hive query editor and set up your configuration

Ex: 

set hive.support.concurrency=true;
set hive.enforce.bucketing=true;

 

To get the current value, you can run it before & after setup

set hive.support.concurrency;

set hive.enforce.bucketing;

 

2. Permanent setup: As your admin to Go to Cloudera Manager -> Hive -> Configuration -> search for HiveServer2 Advanced Configuration Snippet (Safety Valve) and update the rqeuired properties as follows

 

Ex:

<property>

<name>hive.support.concurrency</name>

<value>true</value>

</property>

 

Note: The Temporary setup will influence only your scripts but Permanent setup will influence all the script executions. so think twice and take the necessary action