@leopetr In the Oozie world, Spark3 actions are a different animal than HiveServer2 ones. Spark actions need to specify the files and as long Hive on TEZ GW role is deployed to all NODEMANAGER nodes, that should work for you ... View more

@mikecolux Adding to what @MGreen explained.  Make sure the Hive on TEZ Gateway role is deployed to the nodes where hive-site.xml is needed ... View more

@Kalpit  What stacktrace do you get on Hive 3.1.3? Have you tried installing Apache hive 4.0.1 We tested and did not get any errors [hive@ccycloud ~]$ beeline -e "CREATE TABLE demo (name string); INSERT INTO demo (name) VALUES ('Dean'); SELECT * FROM demo;" ... !connect jdbc:hive2://localhost:10000/default hive [passwd stripped] Connecting to jdbc:hive2://localhost:10000/default Connected to: Apache Hive (version 4.0.1) Driver: Hive JDBC (version 4.0.1) Transaction isolation: TRANSACTION_REPEATABLE_READ Executing command: CREATE TABLE demo (name string); INSERT INTO demo (name) VALUES ('Dean'); going to print operations logs printed operations logs Getting log thread is interrupted, since query is done! INFO : Compiling command(queryId=hive_20250117101442_d8c29cd4-dc66-4e86-bfc3-acfcda4dbf6d): CREATE TABLE demo (name string) INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=hive_20250117101442_d8c29cd4-dc66-4e86-bfc3-acfcda4dbf6d); Time taken: 0.057 seconds INFO : Operation CREATETABLE obtained 1 locks INFO : Executing command(queryId=hive_20250117101442_d8c29cd4-dc66-4e86-bfc3-acfcda4dbf6d): CREATE TABLE demo (name string) INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=hive_20250117101442_d8c29cd4-dc66-4e86-bfc3-acfcda4dbf6d); Time taken: 0.411 seconds No rows affected (0.6 seconds) going to print operations logs printed operations logs going to print operations logs INFO : Compiling command(queryId=hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2): INSERT INTO demo (name) VALUES ('Dean') INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2); Time taken: 0.225 seconds INFO : Operation QUERY obtained 0 locks INFO : Executing command(queryId=hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2): INSERT INTO demo (name) VALUES ('Dean') INFO : Query ID = hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2 INFO : Total jobs = 1 INFO : Launching Job 1 out of 1 INFO : Starting task [Stage-1:MAPRED] in serial mode INFO : Subscribed to counters: [] for queryId: hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2 INFO : Tez session hasn't been created yet. Opening session INFO : Dag name: INSERT INTO demo (name) VALUES ('Dean') (Stage-1) INFO : HS2 Host: [ccycloud.database.root.comops.site], Query ID: [hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2], Dag ID: [dag_1737137683361_0001_1], DAG Session ID: [application_1737137683361_0001] INFO : Status: Running (Executing on YARN cluster with App id application_1737137683361_0001) INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode INFO : Starting task [Stage-0:MOVE] in serial mode INFO : Loading data to table default.demo from file:/tmp/warehouse/demo/.hive-staging_hive_2025-01-17_10-14-43_081_2234726835117592123-3/-ext-10000 INFO : Starting task [Stage-3:STATS] in serial mode INFO : Executing stats task INFO : Table default.demo stats: [numFiles=1, numRows=1, totalSize=5, rawDataSize=4, numFilesErasureCoded=0] INFO : Completed executing command(queryId=hive_20250117101443_db567dbe-f0dd-4e5a-bbce-89de35c306f2); Time taken: 0.955 seconds printed operations logs Getting log thread is interrupted, since query is done! 1 row affected (1.196 seconds) INFO : Compiling command(queryId=hive_20250117101722_7e3b0555-950a-401c-8cca-34c08582d8b3): SELECT * FROM demo INFO : Semantic Analysis Completed (retrial = false) INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:demo.name, type:string, comment:null)], properties:null) INFO : Completed compiling command(queryId=hive_20250117101722_7e3b0555-950a-401c-8cca-34c08582d8b3); Time taken: 0.09 seconds INFO : Operation QUERY obtained 0 locks INFO : Executing command(queryId=hive_20250117101722_7e3b0555-950a-401c-8cca-34c08582d8b3): SELECT * FROM demo INFO : Completed executing command(queryId=hive_20250117101722_7e3b0555-950a-401c-8cca-34c08582d8b3); Time taken: 0.0 seconds +------------+ | demo.name | +------------+ | Dean | +------------+ 1 row selected (0.171 seconds) Beeline version 4.0.1 by Apache Hive Closing: 0: jdbc:hive2://localhost:10000/default [hive@ccycloud ~]$ ... View more

Hello, Please gather the PID of HiveServer2 and run this command: lsof -Pn -p <PID> | egrep TCP It should return something like this: [root@ccycloud apache]# lsof -Pn -p 426744 | egrep TCP java 426744 hive 680u IPv6 1426885630 0t0 TCP 127.0.0.1:46404->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 682u IPv6 1426605725 0t0 TCP 127.0.0.1:46420->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 683u IPv6 1426958951 0t0 TCP 127.0.0.1:46422->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 684u IPv6 1427031052 0t0 TCP 127.0.0.1:46426->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 685u IPv6 1427031053 0t0 TCP 127.0.0.1:46436->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 686u IPv6 1426956920 0t0 TCP 127.0.0.1:46444->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 687u IPv6 1426956921 0t0 TCP 127.0.0.1:46452->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 688u IPv6 1426847703 0t0 TCP 127.0.0.1:46466->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 692u IPv6 1426847704 0t0 TCP *:10000 (LISTEN) java 426744 hive 693u IPv6 1427016047 0t0 TCP *:10002 (LISTEN) java 426744 hive 704u IPv6 1427016054 0t0 TCP 127.0.0.1:46476->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 705u IPv6 1427037042 0t0 TCP 127.0.0.1:57868->127.0.0.1:9083 (ESTABLISHED) java 426744 hive 706u IPv6 1427549483 0t0 TCP 127.0.0.1:10000->127.0.0.1:54610 (ESTABLISHED)  Connections to Hive Metastore must be setup first before HS2 starts listening on port 10000 Hope this helps ... View more

Hello, These are NOT ERRORS: INFO conf.Configuration: resource-types.xml not found. INFO resource.ResourceUtils: Unable to find 'resource-types.xml'. As for this: INFO mapreduce.Job: map 0% reduce 0% How many mappers were specified for the IMPORT? Try locating the running containers in YARN and take a few JSTACKs to find out if the mapper is stuck waiting from your source database, if so make sure there are no firewall/network rules preventing the flow of data. Are you able to execute SQOOP EVAL on the source DB? If so, try using options: -jt local -m 1 --verbose If the job completes, that would confirm a communication issue from your NodeManagers to the source DB ... View more

Are you able to reproduce at will? If so, provide the Cloudera Runtime version and the associated DDL/DML ... View more

@hanumanth  Your Python code is throwing this:  OSError: [Errno 2] No such file or directory The stack is not enough to determine what is happening Please look at the following items: * job.properties / workflow.xml    Is this being setup as a Shell Action?    Are all the necessary files being provided?    The action needs to setup the Python environment within a YARN container * Oozie launcher log    Is Python code starting to execute and then hit a snag or it does fail from the get-go? ... View more

@zhaiziha  Are you running this query on DataHub or Hive VW? Please try your SELECT statement on Beeline from DataHub as follows and let us know how it works for you SET hive.server2.logging.operation.level=VERBOSE; SET hive.input.format = org.apache.hadoop.hive.ql.io.HiveInputFormat; SET fs.s3a.experimental.input.fadvise=random; SET fs.s3a.readahead.range=1024K; SET parquet.enable.dictionary=false; SELECT * FROM small; Should that fail, can you provide the beeline output and simple repro steps? Seems like some form of HADOOP-16109 ... View more