@Choolake Try : entries=$((count2-count1)) This should work provided we have valid values on both variables. ... View more

@xiamu this error could appear if the data nodes are not healthy. Does the job fail repeatedly, or it succeeds at times? Have you tried running it with a different user?  This is where it is failing:   private void setupPipelineForAppendOrRecovery() throws IOException { // Check number of datanodes. Note that if there is no healthy datanode, // this must be internal error because we mark external error in striped // outputstream only when all the streamers are in the DATA_STREAMING stage if (nodes == null || nodes.length == 0) { String msg = "Could not get block locations. " + "Source file \"" + src + "\" - Aborting..." + this; LOG.warn(msg); lastException.set(new IOException(msg)); streamerClosed = true; return; } setupPipelineInternal(nodes, storageTypes, storageIDs); }   ... View more

@mwblee I am not sure if you are using any Cloudera Hive distribution, if you are, consider upgrading to latest CDP version where we have fixed many issues around compactor initiator/worker/cleaner.  e.g. For initiator:  upstream Jiras - HIVE-21917, HIVE-22568, HIVE-22081   For this specific issue, you may check take a look at multiple factors, such as Hive metastore being overloaded, slow/large(certain txn related tables) metastore database. You may enable DEBUG logging in Hive metastore, and this will provide more information on why/where the compactor is stuck. If you are using opensource Hive, upgrade to Hive 4.x; you will have much better experience w.r.t. compaction. ... View more

@dmharshit It will not be easy to tell you what could be causing this from this error message alone. Maybe if you could share the query EXPLAIN PLAN as well as HS2 logs, that will give us a better idea. Else, just try the following config change in Hive metastore, and in my experience this should help: CDP > Hive > Configuration > Hive Metastore Server Advanced Configuration Snippet (Safety Valve) for hive-site.xml 1# property: hive.metastore.event.listener Value:<leave it blank> Note: do not add anyting in the Value field 2# Property: hive.metastore.transactional.event.listeners Value: < leave it blank> Note: do not add anyting in the Value field ... View more

@ArtG001 Have you enabled SSL/TLS for Hiveserver2 as per the doc you have shared above, else we should see a valid result here? Do confirm.   I tried the openssl command on a non SSL Hive endpoint and I got similar response. ... View more

Could you please share screenshots of the Instance tab from both Hive and Hive on Tez services? Based on our experience, the following action should resolve the issue.   Stop and delete the "HiveServer2" and "WebHCat" instances from Cloudera Manager > Hive > Instances Check that the role "HiveServer2" is present in Cloudera Manager > Hive on Tez > Instances Verify the Configuration page for 'Hive on Tez'; ensure that 'Hive Metastore Connector' is pointed at the Hive service that is running the Hive Metastore Restart the stale services ... View more

@anjel Thank you! I can see that Support has reached out to the ODBC driver team. We'll wait for their response. ... View more