@Amit Dass - I'm assuming you have installed cluster with Ambari, Please go to the ambari server UI and check on which host hive metostore is installed, you can go to the hive services and click on metastore service to check the same. If Ambari shows metastore as down then you need to start it. ... View more

@Amit Dass ... View more

Sorry I have corrected port number, please try the steps given above and let me know how it goes ... View more

@Amit Dass From hive client (from where you are running hive command) check if you are able to run below command telnet <hive-metastore-hostname/ip-address> 9083 On metastore: try running below command to check is metstore process is running ps aux|grep HiveMetaStore try running below command to ensure that metastore process is listening on 9038 root@sandbox ~]# netstat -tulpn|grep 9083 tcp 0 0 0.0.0.0:9083 0.0.0.0:* LISTEN 2115/java [root@sandbox ~]# ... View more

@Amit Dass - Looks like your HiveMetastore process is not running, I can see connection refused from the logs Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.thrift.transport.TSocket.open(TSocket.java:185) Or there might be some connection issues with hive client and hive metastore machine. Can you please check connectivity as well ? ... View more

@Kevin Sievers - According to official apache document By default number of reducers is set to 1, you can change/overwrite it according to answer given by Laurent above.How Many Reduces? The right number of reduces seems to be 0.95 or 1.75 multiplied by (<no. of nodes> * <no. of maximum containers per node>). With 0.95 all of the reduces can launch immediately and start transferring map outputs as the maps finish. With 1.75 the faster nodes will finish their first round of reduces and launch a second wave of reduces doing a much better job of load balancing. Increasing the number of reduces increases the framework overhead, but increases load balancing and lowers the cost of failures. The scaling factors above are slightly less than whole numbers to reserve a few reduce slots in the framework for speculative-tasks and failed tasks. ... View more

@Amit Tewari Is netstat working? please paste output of netstat command here ... View more

@Sadek M Please first configure KMS for Kerberos authentication. Use second link you have mentioned in your question. Regarding point 6b Add values for the following properties in the "Custom kms-site" section. These properties allow the specified system users ( hive , oozie , and others) to proxy on behalf of other users when communicating with Ranger KMS. This helps individual services (such as Hive) use their own keytabs, but retain the ability to access Ranger KMS as the end user (use access policies associated with the end user). hadoop.kms.proxyuser.hive.users hadoop.kms.proxyuser.oozie.users hadoop.kms.proxyuser.HTTP.users hadoop.kms.proxyuser.ambari.users hadoop.kms.proxyuser.yarn.users hadoop.kms.proxyuser.hive.hosts hadoop.kms.proxyuser.oozie.hosts hadoop.kms.proxyuser.HTTP.hosts hadoop.kms.proxyuser.ambari.hosts hadoop.kms.proxyuser.yarn.hosts These properties are for user impersonation ... View more

@Jinling Li - I'm not much familiar with oozie installation on Windows but did you check if oozie user has correct permission to modify oozie_db? can you please double check that? If its new installation then you can just remove oozie_db and recreate blank one with appropriate permissions and oozie-server daemon will take care of other things. ... View more