About zhe

zhe · ‎02-17-2017

Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "dispatcher-event-loop-0" Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "IPC Client (724929395) connection to /172.22.103.121:39927 from job_1471597554341_0133" Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "main" Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "LeaseRenewer:hrt_qa@nat-r7-movs-oozie-1-5.openstacklocal:8020" Halting due to Out Of Memory Error ... Exception : java.lang.OutOfMemory Error thrown from the Uncaught Exception Handler in thread "shuffle-server-0" End of LogType:stderr

zhe · ‎02-17-2017

hadoop-lzo jar file is missing for spark service during the cluster setup rpm -qa| grep hadoop hadoop_XXX-mapreduce-XXX.x86_64 hadoop_XXX-client-XXX.el6.x86_64 hadoop_XXX-libhdfs-XXX.el6.x86_64 hadoop_XXX-yarn-XXX.el6.x86_64 hadoop_XXX-hdfs-XXX.el6.x86_64 ambari-metrics-hadoop-sink-XXX.x86_64 How to enable it during deployment?

zhe · ‎02-16-2017

Hi, I am unable to start hiveserver2 in my cluster. I checked the hs2.log file and found the following exception. 2017-02-14 23:10:24,479 ERROR [Thread-24]: util.PolicyRefresher (PolicyRefresher.java:loadPolicyfromPolicyAdmin(282)) - PolicyRefresher(serviceName=xxx): failed to refresh policies. Will continue to use last known version of policies (-1) java.lang.IllegalArgumentException: Illegal character in path at index 0: {{policymgr_mgr_url}}/service/plugins/secure/policies/download/OOZIE-CLUSTER

zhe · ‎10-31-2016

Thanks for sharing! whenever there is a change in the source directory, is there a corresponding update on the target directory? @Murali Ramasami

zhe · ‎10-31-2016

@Ayub Khan you can grep "ExternalStatu" or "Status" in the log with workflow id.

zhe · ‎10-31-2016

do you have detailed log for this job? @kevin shen

Online	Offline
Last Visited	‎04-05-2017 11:20 PM

Date Registered	‎06-17-2016 05:49 PM
Last Visited	‎04-05-2017 11:20 PM
Total Messages Posted	11
Total Kudos Received	16

spark yarn-client mode failed due to OutOfMemoryEr...

hadoop-lzo jar file is missing for spark service

FAILED TO START HIVE SERVER2 Illegal character in ...

Re: HDFS Snapshots Based Replication Using Apache ...

Re: [RESOLVED] OOZIE : workflow log

Re: Run Oozie Shell Action instead of Oozie Spark ...