I have INSERT OVERWRITE queries in HQL file which sometimes do not get the required locks because an end user could be querying data in the same table.   The scheduled query just fails in such cases breaking the workflow. Is there a way to fix this?   if I just UNLOCK TABLE everytime, it results in an error that lock does not exist. Can I unlock it if the lock exists so that my scheduled query is always successful?     Heart beat Heart beat Heart beat Heart beat 6712698 [main] ERROR org.apache.hadoop.hive.ql.Driver - FAILED: Error in acquiring locks: Locks on the underlying objects cannot be acquired. retry after some time org.apache.hadoop.hive.ql.lockmgr.LockException: Locks on the underlying objects cannot be acquired. retry after some time at org.apache.hadoop.hive.ql.lockmgr.DummyTxnManager.acquireLocks(DummyTxnManager.java:164) at org.apache.hadoop.hive.ql.Driver.acquireLocksAndOpenTxn(Driver.java:1025) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1301) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1120) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1108) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:218) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:170) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:381) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:316) at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:414) at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:430) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:724) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:691) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:626) at org.apache.oozie.action.hadoop.HiveMain.runHive(HiveMain.java:325) at org.apache.oozie.action.hadoop.HiveMain.run(HiveMain.java:302) at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:49) at org.apache.oozie.action.hadoop.HiveMain.main(HiveMain.java:69) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:236) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1693) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)    ... View more

I have a single node cluster so far.The new host I am going to be adding is located in a different data-center than the existing host. I see: Using a text editor, open the hosts file on every host in your cluster. For example: vi /etc/hosts Add a line for each host in your cluster. The line should consist of the IP address and the FQDN. For example: 1.2.3.4 <fully.qualified.domain.name> 1.2.3.4 here is a public IP or a private IP? The new host I am trying to add is hosted with AWS . Existing node ona dedicated server hosted with some other company. What should I add in /etc/hosts of the 1. existing node 2. new node AWS node (new one) has -> a public DNS, a private DNS, a public IP , a private IP. (Private DNS is the hostname). In all your examples, you have added private IP and hostname (private DNS). But how does adding private IP help if it's not a part of network? Please help! ... View more