i got the same problem. When I reinstalled hive, everything worked. ... View more

@er_sharma_shant @jsensharma Can you guys please tell me how to resolve hiveserver2 start issue by adding the znode name for hiveserver2 in zkcli shell?.. I have hiveserver2 instance created in zkcli shell, but it does not have znode name because of which hiveserver2 is failing to start. Welcome to ZooKeeper! 2022-02-03 02:31:36,504 - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1013] - Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) JLine support is enabled 2022-02-03 02:31:36,592 - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@856] - Socket connection established, initiating session, client: /127.0.0.1:36762, server: localhost/127.0.0.1:2181 2022-02-03 02:31:36,609 - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1273] - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x27ebd79aecc014c, negotiated timeout = 30000 WATCHER:: WatchedEvent state:SyncConnected type:None path:null [zk: localhost:2181(CONNECTED) 0] ls / [cluster, registry, controller, brokers, storm, infra-solr, zookeeper, hbase-unsecure, hadoop-ha, tracers, admin, isr_change_notification, log_dir_event_notification, accumulo, controller_epoch, hiveserver2, hiveserver2-leader, druid, rmstore, atsv2-hbase-unsecure, consumers, ambari-metrics-cluster, latest_producer_id_block, config] [zk: localhost:2181(CONNECTED) 1] ls /hiveserver2 [] [zk: localhost:2181(CONNECTED) 2] Any help would be much appreciated!!!. Thank you ... View more

Try to clean your metadata with ./hbase-cleanup.sh --cleanAll command and restart your services. If you get "Regionservers  are not expired. Exiting without cleaning hbase data" stop Hbase service before running the command. ... View more

HDP 3.0 has different way of integrating Apache Hive with Apache Spark using Hive Warehouse Connector. Below article explains the steps: https://community.hortonworks.com/content/kbentry/223626/integrating-apache-hive-with-apache-spark-hive-war.html ... View more

@Shantanu Sharma I was not aware of that, thank you very much for sharing this ... View more

Hi, I am trying to run spark application which will need access to Hive databases. But Hive databases like FOODMART are not visible in spark session. I did spark.sql("show databases").show(); it is not showing Foodmart database, though spark session is having enableHiveSupport. Below i've tried: 1) cp /etc/hive/conf/hive-site.xml /etc/spark2/conf 2) Changed spark.sql.warehouse.dir in spark UI from /apps/spark/warehouse to /warehouse/tablespace/managed/hive Even though it is not working. Please let me know what configuration changes would be required to have this. Please note - Above is working in HDP2.6.5. ... View more