Member since
02-19-2016
34
Posts
1
Kudos Received
0
Solutions
04-07-2025
03:46 PM
Hi @LDAP , since you mentioned that the same query is working fine on Hue, could you try to set UseNativeQuery=1 on your driver configuration and retry the query. Reference: https://docs.cloudera.com/documentation/other/connectors/hive-jdbc/2-6-26/Cloudera-JDBC-Connector-for-Apache-Hive-Install-Guide.pdf (page 109)
... View more
01-17-2025
10:19 AM
@Kalpit What stacktrace do you get on Hive 3.1.3? Have you tried installing Apache hive 4.0.1 We tested and did not get any errors [hive@ccycloud ~]$ beeline -e "CREATE TABLE demo (name string); INSERT INTO demo (name) VALUES ('Dean'); SELECT * FROM demo;" ... !connect jdbc:hive2://localhost:10000/default hive [passwd stripped] Connecting to jdbc:hive2://localhost:10000/default Connected to: Apache Hive (version 4.0.1) Driver: Hive JDBC (version 4.0.1) Transaction isolation: TRANSACTION_REPEATABLE_READ Executing command: CREATE TABLE demo (name string); INSERT INTO demo (name) VALUES ('Dean'); going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=hive_20250117101442_d8c29cd4-dc66-4e86-bfc3-acfcda4dbf6d): CREATE TABLE demo (name string) INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=hive_20250117101442_d8c29cd4-dc66-4e86-bfc3-acfcda4dbf6d); Time taken: 0.057 seconds INFO : Operation CREATETABLE obtained 1 locks INFO : Executing command(queryId=hive_20250117101442_d8c29cd4-dc66-4e86-bfc3-acfcda4dbf6d): CREATE TABLE demo (name string) INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=hive_20250117101442_d8c29cd4-dc66-4e86-bfc3-acfcda4dbf6d); Time taken: 0.411 seconds No rows affected (0.6 seconds) going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2): INSERT INTO demo (name) VALUES ('Dean') INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2); Time taken: 0.225 seconds INFO : Operation QUERY obtained 0 locks INFO : Executing command(queryId=hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2): INSERT INTO demo (name) VALUES ('Dean') INFO : Query ID = hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2 INFO : Total jobs = 1 INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2 INFO : Tez session hasn't been created yet. Opening session INFO : Dag name: INSERT INTO demo (name) VALUES ('Dean') (Stage-1) INFO : HS2 Host: [ccycloud.database.root.comops.site], Query ID: [hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2], Dag ID: [dag_1737137683361_0001_1], DAG Session ID: [application_1737137683361_0001] INFO : Status: Running (Executing on YARN cluster with App id application_1737137683361_0001) INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table default.demo from file:/tmp/warehouse/demo/.hive-staging_hive_2025-01-17_10-14-43_081_2234726835117592123-3/-ext-10000 INFO : Starting task [Stage-3:STATS] in serial mode INFO : Executing stats task INFO : Table default.demo stats: [numFiles=1, numRows=1, totalSize=5, rawDataSize=4, numFilesErasureCoded=0] INFO : Completed executing command(queryId=hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2); Time taken: 0.955 seconds printed operations logs Getting log thread is interrupted, since query is done! 1 row affected (1.196 seconds) INFO : Compiling command(queryId=hive_20250117101722_7e3b0555-950a-401c-8cca-34c08582d8b3): SELECT * FROM demo INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:demo.name, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=hive_20250117101722_7e3b0555-950a-401c-8cca-34c08582d8b3); Time taken: 0.09 seconds INFO : Operation QUERY obtained 0 locks INFO : Executing command(queryId=hive_20250117101722_7e3b0555-950a-401c-8cca-34c08582d8b3): SELECT * FROM demo INFO : Completed executing command(queryId=hive_20250117101722_7e3b0555-950a-401c-8cca-34c08582d8b3); Time taken: 0.0 seconds +------------+ | demo.name | +------------+ | Dean | +------------+ 1 row selected (0.171 seconds) Beeline version 4.0.1 by Apache Hive Closing: 0: jdbc:hive2://localhost:10000/default [hive@ccycloud ~]$
... View more
10-16-2024
06:28 PM
1 Kudo
Hi everyone, Thank you all for your responses. I am using Spark 3, and I’ve discovered that the issue is due to the improper configuration of the spark_shuffle settings in the yarn-site.xml file. Thanks again!
... View more
10-16-2024
08:00 AM
hi @NagendraKumar , You can use puthiveql as described in this article https://community.cloudera.com/t5/Support-Questions/how-to-use-puthiveql-in-NIFI/td-p/204542
... View more
10-02-2024
07:12 AM
@NagendraKumar were you able to truncate the data with the processor that my colleague Smruti mentioned?
... View more
04-23-2018
06:09 PM
1 Kudo
Hi @Andrey Ne The following solution worked for me. I added these two properties on my customized %spark2py3 interpreter. PYSPARK_DRIVER_PYTHON /usr/local/anaconda3/bin/python3 PYSPARK_PYTHON /usr/local/anaconda3/bin/python3
... View more