You can use any JDBC client to test whether the JDBC connection URL is proper, for example: http://jdbcsql.sourceforge.net/ or http://squirrel-sql.sourceforge.net/   Have you tried to use the fully qualified domain name of the host instead of localhost? (make sure to allow the connection for the sentry user for the FQDN too on MySQL side) ... View more

When you can't submit Hive on Spark queries, you need to review what is in the HiveServer2 logs. From client end (beeline) it is unfortunately not obvious. In any case you need to make sure that: - Spark service has been enabled as a dependency in Hive service > Configuration - Review Spark related settings in Hive service > Configuration - you have enough resources on the cluster and can submit YARN jobs   Do you have error messages from the HS2 logs?   Thanks  Miklos ... View more

Hi, The message "java.net.ConnectException: Connection refused" is quite clear, the backend database has refused the connection request. Check that your DB is is up and running and that you can connect to it from the localhost. Haven't you moved the Sentry role or the database to another host?Or do you have SSL enabled/required for the backend database? ... View more

Hello Harsha,   Based on the stacktrace: 1. HMS fails to start up when it tries to initialize it's token store ("Hive Metastore Delegation Token Store" -> org.apache.hadoop.hive.thrift.ZooKeeperTokenStore). If you do not need this, you may change it to DBTokenStore, but I would go with the next item rather. 2. The "java.lang.NoSuchMethodError" suggests that there is a jar conflict, and multiple versions of a jar exists on the classpath, and org/apache/curator/framework/imps/CreateBuilderImpl is not compiled with the actually loaded org/apache/curator/utils/ThreadUtils class. Please check in which jars do you have these classes   for i in $(find . -name '*.jar') ; do /usr/java/latest/bin/jar tf $i | grep org/apache/curator/framework/imps/CreateBuilderImpl.class && echo $i ; done   for i in $(find . -name '*.jar') ; do /usr/java/latest/bin/jar tf $i | grep org/apache/curator/utils/ThreadUtils.class && echo $i ; done   and try to find which of these are (mistakenly?) included in the HMS's classpath, use jinfo to get the classpath of HMS:   <java_home_of_hms>/bin/jinfo <pid_of_hms> | grep java.class.path   What Hive/CDH/HDP version are you using? ... View more

Since CDH 5.8 you can use  set PARQUET_FALLBACK_SCHEMA_RESOLUTION=1; to look up columns within Parquet files by column name. For more, see: https://www.cloudera.com/documentation/enterprise/latest/topics/impala_parquet_fallback_schema_resolution.html     ... View more

Hi,   If you see the same for Hive/MapReduce jobs, then please can you confirm that the table in question has many partitions? We have seen similar problems for tables where it contained over thousand or ten thousands of partitions. ... View more

Hello Rakesh,   Unfortunately s3n filesystem scheme is not supported by Impala: http://www.cloudera.com/documentation/enterprise/latest/topics/impala_s3.html#s3_restrictions   If you set up s3a, please look at the recommended settings at "Best Practices for Using Impala with S3" section on the same page.   Regards Miklos Szurap Customer Operations Engineer ... View more

Hi,   Thrift protocol is used for communication inside impala, as well as from impala (and catalog daemon) to hive metastore. If you see socket timeouts withing this context, most probably one service is not in good health, you should check whether the impala service instances are up-and-running: hive metastore, impala daemon, catalog daemon and impala statestore.   Regards  Miklos Szurap Customer Operations Engineer ... View more