@Maurice Knopp Great news if you are on Centos and kerberized environment I am just wondering how the Kerberos have you tried regenerating the specific keytab? About you hql scripts you should realize there has been a lot of changes between HDP 2.3 with hive 1.2.1 and HDP 3.1 with hive version 3.1.0 About your MariaDB database and running the below version with HDP 3.1 "resource_management.core.exceptions.Fail: JDBC driver 'org.mariadb.jdbc.Driver' not supported." Welcome to the MariaDB monitor.  Commands end with ; or \g. Your MariaDB connection id is 30 Server version: 5.5.60-MariaDB MariaDB Serv Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and other Type 'help;' or '\h' for help. Type '\c' to clear the current input statemen MariaDB [(none)]> Please did you run the steps I mentioned in http://community.hortonworks.com/answers/245833/view.html Please revert ... View more

@Michael Bergamini Can you compare the values of hive.heapsize on both clusters that seem to be the issue? Please adjust them depending on the memory the HiveServer2 Heap Size automatically shows you the memory available to the cluster so i.e on my 24 GB single node I dedicated 8 GB for hive.heapsize and it fires up! Ambari-->hive-->Configs-->{hive.heapsize} Please adjust that and revert ... View more

@Adil BAKKOURI Most production HDP clusters run on Ubuntu so I don't see why yours should fail. Ping on LinkedIn! If your database MySQL version 5.6 please can you check the database engine SELECT table_name, table_schema, engine FROM information_schema.tables; For all HDP products, it should show InnoDB like below for hive | PARTITION_KEYS                               | hive               | InnoDB             | | PARTITION_KEY_VALS                           | hive               | InnoDB             | | PARTITION_PARAMS                             | hive               | InnoDB             | | PART_COL_PRIVS                               | hive               | InnoDB             | | PART_COL_STATS                               | hive               | InnoDB             | | PART_PRIVS                                   | hive               | InnoDB             | | ROLES                                        | hive               | InnoDB             | | ROLE_MAP                                     | hive               | InnoDB             | Please revert ... View more

@Adil BAKKOURI What's your OS and Version? I have done hundreds of HDP installation never got this blockage!! What's the current error? Can you share the below logs? hivemetastore.log hiveserver2.log This should be a driver issue please share any error ... View more

@Adil BAKKOURI Have you seen my latest update? ... View more

@Adil BAKKOURI You have done everything correctly but you are not selecting the existing database you created 🙂 See attached screenshot all should work !!! Please use the values of the hive DB created previously it should pick the correct URL and host !! ... View more

@Adil BAKKOURI The attached /var/log/ambari-server/ambari-server-check-database.log shows you are trying to connect to postgres which is the embedded database. My guess is your ambari Server is using the embedded postgres database and NOT MySQL so what you need to do after installing and configuring MySQL and Hive is Install the mySQL driver adapt the commands according to your OS yum install -y mysql-connector-java Make the jars available for hive etc this won't effect the Postgres installation ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar Now continue with the Ambari hive setup it should succeed NOW!!!! ... View more

@Adil BAKKOURI Can you firstly stop/ re-run ambari with the below command ambari-server stop Then ambari-server start --skip-database-check Your Ambari database has many orphaned config please see this Jira how to clean you Ambari database though it would be faster to start with a clean installation but it good to get your hands dirty !!! https://issues.apache.org/jira/browse/AMBARI-20875 CREATE TEMPORARY TABLE IF NOT EXISTS orphaned_configs AS (SELECT cc.config_id, cc.type_name, cc.version_tag FROM clusterconfig cc, clusterconfigmapping ccm WHERE cc.config_id NOT IN (SELECT scm.config_id FROM serviceconfigmapping scm) AND cc.type_name != 'cluster-env' AND cc.type_name = ccm.type_name AND cc.version_tag = ccm.version_tag); Followed by DELETE FROM clusterconfigmapping WHERE EXISTS (SELECT 1 FROM orphaned_configs WHERE clusterconfigmapping.type_name = orphaned_configs.type_name AND clusterconfigmapping.version_tag = orphaned_configs.version_tag); Followed by DELETE FROM clusterconfig WHERE clusterconfig.config_id IN (SELECT config_id FROM orphaned_configs); Followed by SELECT * FROM orphaned_configs; Then DROP TABLE orphaned_configs; Now you Ambari db should be clean to proceed with the hive setup ... View more

@Adil BAKKOURI The below error tells me 2 things you are either using a MySQL server which is not supported or your jdbc driver version is not correct can you validate your Mysql database against the HXW support matrix 2019-04-16 15:55:44,477 - Check db_connection_check was unsuccessful. Exit code: 1. Message: Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary. ERROR: Unable to connect to the DB. Please check DB connection properties. com.mysql.cj.jdbc.exceptions.CommunicationsException: Communications link failure The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server. Command failed after 1 tries I filtered the above for HDP 2.6 ... View more