I'm trying to assess an issue within a native library (called from RDD Transformation). I've followed the instructions by enabling "core dumping" on all executor nodes, but I'm still getting notified that core dumping is disabled. I tried to access the hs_err_pid.log file, at the specified path, but the file doesn't exist. Could anyone guide me in properly enabling core dumping and where to locate the resulting file for each executor?
The application is run on yarn in cluster mode.
Enabled core dumping with "ulimit -c unlimited" on each node.
# # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x00007f1e7ba52bea, pid=33953, tid=139768496908032 # # JRE version: Java(TM) SE Runtime Environment (7.0_67-b01) (build 1.7.0_67-b01) # Java VM: Java HotSpot(TM) 64-Bit Server VM (24.65-b04 mixed mode linux-amd64 compressed oops) # Problematic frame: # C [native_lib.so.1.0+] NativeClass::ClassMethod7x7(int, int)+ # # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again # # An error report file with more information is saved as: # /diskb/yarn/nm/usercache/name/appcache/application_1479757503967_1103/container_1479757503967_1103_01_000007/hs_err_pid33953.log # # If you would like to submit a bug report, please visit: # http://bugreport.sun.com/bugreport/crash.jsp