@Naga Yamini Polepeddi I am not sure what happens here but i just resolved my issue by placing "if else" case if partitions are zero then again it will automatically load the last file again , i know that this is not proper solution but for temporally i enable, i am still working on this with export ... View more

Thanks @ Vinicius Higa Murakami my cluster hive.exec.max.dynamic.partitions = 5000 i have checked the hivemetastore.log but i could not find any locks in hive log. no i have not running MSCK repair table after my batch load this is second time i am facing this issue in row, i resolved this issue by reload the files again, once i reload file all partitions are properly added.but i worried about recurring this issue. Please note one point i forgot to mention, after i load the file it will check the if partitions are existed or not if partitioned already exist it will drop the old one and add the new parititons, BUT here the complete partitions are not visible. EX: I have partitions based on key and month, i have keys A,B,C and months 01,02,03 and if i load a new file with key=A and month=03 , it is drooping only and key=A and month=03 and adding the new partitions but after process complete i could not see data for entire Key=A for all months in hive tables. After some time if reload the file , i could see entire data. I have bellow error message on my hivemetastore.log is this causing the any issue? and related to this? .IOException Scope named api_alter_partitions is not closed, cannot be opened. java.io.IOException: Scope named api_alter_partitions is not closed, cannot be opened. ... View more

HI @Paul Hernandez I am not triggering MSCK REPAIR TABLE <tablename>, i hope which may works here i will do it but my quick question till now we have not use MSCK REPAIR, why should we need this now only. i am using external table using azure blob storage . ... View more

Thanks @djaiswal for your response i could not find any logs for query..at initial stage only it got failed i hope its not giving any job/Application id..while i execute from Ambari HIVE view i am getting below error and i attached completed error message meta-execption.txt org.apache.ambari.view.hive.client.HiveInvalidQueryException: Error while compiling statement: FAILED: SemanticException MetaException(message:Exception thrown when executing query) [ERROR_STATUS] org.apache.ambari.view.hive.client.HiveInvalidQueryException: Error while compiling statement: FAILED: SemanticException MetaException(message:Exception thrown when executing query) [ERROR_STATUS] at org.apache.ambari.view.hive.client.Utils.verifySuccess(Utils.java:46) at org.apache.ambari.view.hive.client.Connection.execute(Connection.java:614) at org.apache.ambari.view.hive.client.Connection.executeAsync(Connection.java:625) at org.apache.ambari.view.hive.resources.jobs.ConnectionController.executeQuery(ConnectionController.java:67) at org.apache.ambari.view.hive.resources.jobs.viewJobs.JobControllerImpl.submit(JobControllerImpl.java:109) at org.apache.ambari.view.hive.resources.jobs.JobService.create(JobService.java:414) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60) at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205) at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75) at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137) at ... View more

Thanks @Sindhu It was working fine with hive --hiveconf hive.execution.engine=mr". but why should we use this? instead "hive" which i was using since starting? ... View more

Thanks you @Sagar Morakhia I have try above query but no luck still it is running since 4 hours ... View more