Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Enabling ACID properties in Hive without Ambari

Highlighted

Enabling ACID properties in Hive without Ambari

Explorer

How to enable ACID properties in Hive without Ambari ?

7 REPLIES 7
Highlighted

Re: Enabling ACID properties in Hive without Ambari

Mentor

@Vinit Mahiwal

Are you running an HDP cluster not managed by Ambari? I don't think its simply toggling a property from OFF to ON in the hive-site.xml or any related file because in the background it enables many other properties.

You will really need to do a deep analysis to achieve your goal.

Highlighted

Re: Enabling ACID properties in Hive without Ambari

Explorer

I am running an HDP cluster on sandbox but not able to open Ambari but able to open other application's like zeplin, port 8888

Highlighted

Re: Enabling ACID properties in Hive without Ambari

Contributor

In general i wouldn't recommend to turn on ACID transaction because it has a lot of open issue. We had problems with lock manager, compactors and others.

Highlighted

Re: Enabling ACID properties in Hive without Ambari

Explorer

I want to load data incrementally in Hive. As per Hortonworks recommendation ACID needs to be turn on. Is there any way to load data incrementally without turning it on.

Highlighted

Re: Enabling ACID properties in Hive without Ambari

Super Guru

If you cannot get to ambari or don't have enough RAM, don't try to run ACID. it takes some extra RAM.

https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_data-access/content/creating-hive-acid-t...

https://hortonworks.com/tutorial/using-hive-acid-transactions-to-insert-update-and-delete-data/

64742-acid.png

search the /etc/hive/conf tables for Transaction manager, concurrency, acid, tx

Highlighted

Re: Enabling ACID properties in Hive without Ambari

Explorer

I am able to resolve the issue by changing virtualbox network settings. Changed network setting from NAT to Bridge
Then opened to Ambari using IPaddressOfSandbox:8080. Then Turned On ACID property.

Re: Enabling ACID properties in Hive without Ambari

Rising Star

@Vinit Mahiwal You can alternatively modify below configs (/etc/hive/conf) on the host where Hiveserver2 is running (and restart HS2)

'hive.txn.manager': 'org.apache.hadoop.hive.ql.lockmgr.DbTxnManager',
'hive.support.concurrency': 'true',

+ . (To disable authorization add below params)

'hive.security.authorization.enabled': 'false',
'hive.security.authorization.manager': 'org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAuthorizerFactory',
'hive.server2.enable.doAs':'false',
Don't have an account?
Coming from Hortonworks? Activate your account here