ACID table transactions fails

Question

Hi Team,

I am trying to connect the hive table from CDSW data science workbench using python. i am able to connect the hive from python using impala, when i try to execute the query i am getting below error,

SemanticException [Error 10265]: This command is not allowed on an ACID table default.atlastest with a non-ACID transaction manager. Failed command: SELECT * FROM `default`.`table_name`'), operationHandle=None)

PFB code ref:

import os
import pandas
from impala.dbapi import connect
from impala.util import as_pandas

# Specify HIVE_HS2_HOST host name as an environment variable in your project settings
HIVE_HS2_HOST='1.1.1.1'

# This connection string depends on your cluster setup and authentication mechanism
conn = connect(host=HIVE_HS2_HOST,
port=10000,
user = 'username',
password = 'password',
auth_mechanism='PLAIN',
kerberos_service_name='hive')

cursor = conn.cursor()
res = cursor.execute('SELECT * FROM `default`.`table_name`')

Kindly help me to close this issue

GangWar · Answer

@sur I believe you have to run the queries over Impala not Hive. I have tested below and it works several time in the past.

# Install Libraries !pip3 install impyla==0.13.8 !pip3 install thrift_sasl==0.2.1 !pip3 install thrift==0.9.3 !pip3 install sasl==0.2.1 # Connect to Impala from impala.dbapi import connect conn = connect(host='host', port=21050, auth_mechanism='GSSAPI', use_ssl=True, kerberos_service_name='impala') # Execute Query sql = "select * from table" cursor = conn.cursor() cursor.execute(sql) results = cursor.fetchall()

You can refer the below doc: https://docs.cloudera.com/cdsw/1.9.1/import-data/topics/cdsw-running-queries-on-impala-tables.html

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.