Member since
10-30-2016
33
Posts
4
Kudos Received
0
Solutions
10-05-2018
05:09 AM
Hi @Jay Kumar SenSharma @Madhura Mhatre else You can delete requested services directly from CLI by using API call.
It will list components of services
curl -u admin -H "X-Requested-By:ambari" -X GET http://<ambari-server_host>/api/v1/clusters/<clustername>/hosts/<fqdn_of_requested_node_to_delete_service>;
EX:
curl -u admin -H "X-Requested-By:ambari" -X GET http://<ambari-server_host>/api/v1/clusters/<clustername>/hosts/fdlslr7v211.pwcccorp.net
To Delete service:
curl -u admin -H "X-Requested-By:ambari" -X DELETE http://<ambari-server_host>/api/v1/clusters/<clustername>/hosts/<fqdn_of_requested_node_to_delete_service>/<SERVICE_NAME>;
Example to delete HST_AGENT:
curl -u admin -H "X-Requested-By:ambari" -X GET http://<ambari-server_host>/api/v1/clusters/<clustername>/hosts/fdlslr7v211.pwcccorp.net/HST_AGENT
... View more
10-04-2018
09:38 AM
can you check all the functions in hive , before going to use with "show funcitons" cmd in hive CLI
... View more
10-04-2018
09:33 AM
Hi @Kunal Agarwal, else you can kill that yarn application with process ID. ps -ef | grep <application_id> [it gives process id] Kill -9 <process Id> Thanks, Anji
... View more
10-04-2018
06:25 AM
Hi Can you post your job.properties as well, There will be several reasons for Null Pointer exception it is not a actual exception , could you please check in /var/log/oozie for actual exception. and this is my workflow..please try this <?xml version="1.0" encoding="UTF-8" standalone="no"?><workflow-app xmlns="uri:oozie:workflow:0.5" name="anji_test">
<start to="hive"/>
<action name="hive">
<hive xmlns="uri:oozie:hive-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<script>${nameNode}/sample/hive.hql</script>
</hive>
<ok to="end"/>
<error to="kill"/>
</action>
<kill name="kill">
<message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name="end"/>
</workflow-app>
... View more
10-04-2018
06:16 AM
what is your execution engine ..? can you run analyse statistics command and check ..? analyze table <table name> compute statistics https://community.hortonworks.com/content/supportkb/49639/hiveautoconvertjoin-true.html
... View more
04-27-2018
09:47 AM
here is the complete log 18/04/26 23:33:06 [main]: ERROR exec.DDLTask: org.apache.hadoop.hive.ql.metadata.HiveException: Exception while processing at org.apache.hadoop.hive.ql.exec.DDLTask.truncateTable(DDLTask.java:4718) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:516) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:162) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:89) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1756) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1497) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1294) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1161) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1151) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:217) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:169) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:380) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:740) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:685) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:Got exception: java.io.IOException Failed to move to trash: hdfs:<> at org.apache.hadoop.hive.ql.metadata.Hive.truncateTable(Hive.java:1139) at org.apache.hadoop.hive.ql.exec.DDLTask.truncateTable(DDLTask.java:4716) ... 20 more Caused by:MetaException(message:Got exception: java.io.IOException Failed to move to trash: hdfs:<> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$truncate_table_result$truncate_table_resultStandardScheme.read(ThriftHiveMetastore.java:41936) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$truncate_table_result$truncate_table_resultStandardScheme.read(ThriftHiveMetastore.java:41922) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$truncate_table_result.read(ThriftHiveMetastore.java:41872) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_truncate_table(ThriftHiveMetastore.java:1198) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.truncate_table(ThriftHiveMetastore.java:1183) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.truncateTable(HiveMetaStoreClient.java:1065) at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.truncateTable(SessionHiveMetaStoreClient.java:132) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:178) at com.sun.proxy.$Proxy5.truncateTable(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.truncateTable(Hive.java:1137) ... 21 more 18/04/26 23:33:06 [main]: INFO hooks.ATSHook: Created ATS Hook 18/04/26 23:33:06 [main]: INFO log.PerfLogger: <PERFLOG method=FailureHook.org.apache.hadoop.hive.ql.hooks.ATSHook from=org.apache.hadoop.hive.ql.Driver> 18/04/26 23:33:06 [main]: INFO log.PerfLogger: </PERFLOG method=FailureHook.org.apache.hadoop.hive.ql.hooks.ATSHook start=1524803586604 end=1524803586604 duration=0 from=org.apache.hadoop.hive.ql.Driver> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Exception while processing
... View more
04-27-2018
09:42 AM
here is the complete log 18/04/26 23:33:06 [main]: ERROR exec.DDLTask: org.apache.hadoop.hive.ql.metadata.HiveException: Exception while processing at org.apache.hadoop.hive.ql.exec.DDLTask.truncateTable(DDLTask.java:4718) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:516) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:162) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:89) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1756) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1497) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1294) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1161) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1151) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:217) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:169) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:380) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:740) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:685) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:Got exception: java.io.IOException Failed to move to trash: hdfs:<> at org.apache.hadoop.hive.ql.metadata.Hive.truncateTable(Hive.java:1139) at org.apache.hadoop.hive.ql.exec.DDLTask.truncateTable(DDLTask.java:4716) ... 20 more Caused by:MetaException(message:Got exception: java.io.IOException Failed to move to trash: hdfs:<> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$truncate_table_result$truncate_table_resultStandardScheme.read(ThriftHiveMetastore.java:41936) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$truncate_table_result$truncate_table_resultStandardScheme.read(ThriftHiveMetastore.java:41922) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$truncate_table_result.read(ThriftHiveMetastore.java:41872) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:86) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_truncate_table(ThriftHiveMetastore.java:1198) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.truncate_table(ThriftHiveMetastore.java:1183) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.truncateTable(HiveMetaStoreClient.java:1065) at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.truncateTable(SessionHiveMetaStoreClient.java:132) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:178) at com.sun.proxy.$Proxy5.truncateTable(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.truncateTable(Hive.java:1137) ... 21 more 18/04/26 23:33:06 [main]: INFO hooks.ATSHook: Created ATS Hook 18/04/26 23:33:06 [main]: INFO log.PerfLogger: <PERFLOG method=FailureHook.org.apache.hadoop.hive.ql.hooks.ATSHook from=org.apache.hadoop.hive.ql.Driver> 18/04/26 23:33:06 [main]: INFO log.PerfLogger: </PERFLOG method=FailureHook.org.apache.hadoop.hive.ql.hooks.ATSHook start=1524803586604 end=1524803586604 duration=0 from=org.apache.hadoop.hive.ql.Driver> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Exception while processing
... View more
11-14-2016
03:24 PM
Hi Amit, what is that sparkUber.jar i copied spark-assembly jar to /oozie/share/lib/spark folder please let me know about that sparkUber.jar
... View more