Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

HDFS NFS gateway stopped working after upgrading to CDH 5.11.1

avatar
New Contributor

Does anyone have any ideas ?

 

Here is the error:

 

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGBUS (0x7) at pc=0x00007f0884d18ebc, pid=17840, tid=0x00007f0895565700
#
# JRE version:  (8.0_131-b11) (build )
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.131-b11 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# j  java.lang.Object.<clinit>()V+0
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
#

---------------  T H R E A D  ---------------

Current thread (0x0000000000926800):  JavaThread "Unknown thread" [_thread_in_Java, id=17840, stack(0x00007ffca9730000,0x00007ffca9830000)]

siginfo: si_signo: 7 (SIGBUS), si_code: 2 (BUS_ADRERR), si_addr: 0x00007ffca9827400

Registers:
RAX=0x00007f0881fa5a68, RBX=0x00007f0881ef7ca8, RCX=0x0000000000000008, RDX=0x00007f0895324f30
RSP=0x00007ffca982b400, RBP=0x00007ffca982b440, RSI=0x0000000000000004, RDI=0x0000000000926800
R8 =0x0000000000000000, R9 =0x0000000000000003, R10=0x0000000000000000, R11=0x0000000000000002
R12=0x0000000000000000, R13=0x00007f0881ef7c98, R14=0x00007ffca982b448, R15=0x0000000000926800
RIP=0x00007f0884d18ebc, EFLAGS=0x0000000000010202, CSGSFS=0x0000000000000033, ERR=0x0000000000000006
  TRAPNO=0x000000000000000e

Top of Stack: (sp=0x00007ffca982b400)
0x00007ffca982b400:   00007ffca982b400 00007f0881ef7c98
0x00007ffca982b410:   00007ffca982b448 00007f0881fa1040
0x00007ffca982b420:   0000000000000000 00007f0881ef7ca8
0x00007ffca982b430:   0000000000000000 00007ffca982b450
0x00007ffca982b440:   00007ffca982b4b0 00007f0884d067a7
0x00007ffca982b450:   00007ffc00001fa0 0000000000000000
0x00007ffca982b460:   0000000000926800 00007ffca982b530
0x00007ffca982b470:   00007f0881ef7ca8 00007ffca982b4f0
0x00007ffca982b480:   00007ffca982b4f0 00007ffca982b6c8
0x00007ffca982b490:   00007f080000000a 00007f0881ef7ca8
0x00007ffca982b4a0:   00007f0884d18c80 00007ffca982b638
0x00007ffca982b4b0:   00007ffca982b620 00007f08949f4d16
0x00007ffca982b4c0:   0000000000000000 0000000000926800
0x00007ffca982b4d0:   00007ffca982b630 00007ffca982b6c0
0x00007ffca982b4e0:   00007f0884d18c80 00007f080000000a
0x00007ffca982b4f0:   0000000000926800 0000000000928320
0x00007ffca982b500:   00007f0881ef7ca8 0000000000000000
0x00007ffca982b510:   0000000000000000 0000000000000000
0x00007ffca982b520:   0000000000000000 00007ffca982b6c0
0x00007ffca982b530:   0000000000926800 0000000000927650
0x00007ffca982b540:   0000000000927690 00000000009276b0
0x00007ffca982b550:   0000000000927778 00000000000000d8
0x00007ffca982b560:   00007ffca982b810 0000000000926800
0x00007ffca982b570:   00007f0881ef7ca8 0000000000926800
0x00007ffca982b580:   0000000000927330 00007f0881ef9648
0x00007ffca982b590:   00007f0881ef7ca8 0000000000926800
0x00007ffca982b5a0:   00007ffca982b700 00007f0894b35043
0x00007ffca982b5b0:   0000000000926800 00007f0894c16e67
0x00007ffca982b5c0:   00007f0881ef7ca8 0000000000926800
0x00007ffca982b5d0:   00007ffca982b6b0 0000000000000000
0x00007ffca982b5e0:   00007f0881ef7ca8 0000000000926800
0x00007ffca982b5f0:   0000000000927690 00007ffca982b630 

Instructions: (pc=0x00007f0884d18ebc)
0x00007f0884d18e9c:   e1 f8 03 00 00 0f 84 bc 01 00 00 89 84 24 00 f0
0x00007f0884d18eac:   ff ff 89 84 24 00 e0 ff ff 89 84 24 00 d0 ff ff
0x00007f0884d18ebc:   89 84 24 00 c0 ff ff 89 84 24 00 b0 ff ff 89 84
0x00007f0884d18ecc:   24 00 a0 ff ff 89 84 24 00 90 ff ff 89 84 24 00 

Register to memory mapping:

RAX=0x00007f0881fa5a68 is pointing into metadata
RBX={method} {0x00007f0881ef7ca8} '<clinit>' '()V' in 'java/lang/Object'
RCX=0x0000000000000008 is an unknown value
RDX=0x00007f0895324f30: <offset 0xfc1f30> in /usr/java/jdk1.8.0_131/jre/lib/amd64/server/libjvm.so at 0x00007f0894363000
RSP=0x00007ffca982b400 is pointing into the stack for thread: 0x0000000000926800
RBP=0x00007ffca982b440 is pointing into the stack for thread: 0x0000000000926800
RSI=0x0000000000000004 is an unknown value
RDI=0x0000000000926800 is a thread
R8 =0x0000000000000000 is an unknown value
R9 =0x0000000000000003 is an unknown value
R10=0x0000000000000000 is an unknown value
R11=0x0000000000000002 is an unknown value
R12=0x0000000000000000 is an unknown value
R13=0x00007f0881ef7c98 is pointing into metadata
R14=0x00007ffca982b448 is pointing into the stack for thread: 0x0000000000926800
R15=0x0000000000926800 is a thread


Stack: [0x00007ffca9730000,0x00007ffca9830000],  sp=0x00007ffca982b400,  free space=1005k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
j  java.lang.Object.<clinit>()V+0
v  ~StubRoutines::call_stub
V  [libjvm.so+0x691d16]  JavaCalls::call_helper(JavaValue*, methodHandle*, JavaCallArguments*, Thread*)+0x1056
V  [libjvm.so+0x643ad7]  InstanceKlass::call_class_initializer_impl(instanceKlassHandle, Thread*)+0xd7
V  [libjvm.so+0x6460ec]  InstanceKlass::initialize_impl(instanceKlassHandle, Thread*)+0x1ac
V  [libjvm.so+0x6464b1]  InstanceKlass::initialize(Thread*)+0x41
V  [libjvm.so+0x64632d]  InstanceKlass::initialize_impl(instanceKlassHandle, Thread*)+0x3ed
V  [libjvm.so+0x6464b1]  InstanceKlass::initialize(Thread*)+0x41
V  [libjvm.so+0xa74114]  Threads::create_vm(JavaVMInitArgs*, bool*)+0x414
V  [libjvm.so+0x6d2ce4]  JNI_CreateJavaVM+0x74
C  [jsvc.exec+0x606e]


---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
=>0x0000000000926800 JavaThread "Unknown thread" [_thread_in_Java, id=17840, stack(0x00007ffca9730000,0x00007ffca9830000)]

Other Threads:
  0x00000000009b2800 VMThread [stack: 0x00007f086be54000,0x00007f086bf55000] [id=17859]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap:
 PSYoungGen      total 917504K, used 15728K [0x0000000780000000, 0x00000007c0000000, 0x00000007c0000000)
  eden space 786432K, 2% used [0x0000000780000000,0x0000000780f5c298,0x00000007b0000000)
  from space 131072K, 0% used [0x00000007b8000000,0x00000007b8000000,0x00000007c0000000)
  to   space 131072K, 0% used [0x00000007b0000000,0x00000007b0000000,0x00000007b8000000)
 ParOldGen       total 2097152K, used 0K [0x0000000700000000, 0x0000000780000000, 0x0000000780000000)
  object space 2097152K, 0% used [0x0000000700000000,0x0000000700000000,0x0000000780000000)
 Metaspace       used 774K, capacity 4480K, committed 4480K, reserved 1056768K
  class space    used 75K, capacity 384K, committed 384K, reserved 1048576K

Card table byte_map: [0x00007f0884345000,0x00007f0884946000] byte_map_base: 0x00007f0880b45000

Marking Bits: (ParMarkBitMap*) 0x00007f0895328f60
 Begin Bits: [0x00007f086e000000, 0x00007f0871000000)
 End Bits:   [0x00007f0871000000, 0x00007f0874000000)

Polling page: 0x00007f089556c000

CodeCache: size=245760Kb used=356Kb max_used=356Kb free=245404Kb
 bounds [0x00007f0884d06000, 0x00007f0884f76000, 0x00007f0893d06000]
 total_blobs=71 nmethods=0 adapters=48
 compilation: enabled

Compilation events (0 events):
No events

GC Heap History (0 events):
No events

Deoptimization events (0 events):
No events

Internal exceptions (0 events):
No events

Events (10 events):
Event: 0.033 loading class java/lang/Short done
Event: 0.033 loading class java/lang/Integer
Event: 0.033 loading class java/lang/Integer done
Event: 0.033 loading class java/lang/Long
Event: 0.033 loading class java/lang/Long done
Event: 0.034 loading class java/lang/NullPointerException
Event: 0.034 loading class java/lang/NullPointerException done
Event: 0.034 loading class java/lang/ArithmeticException
Event: 0.034 loading class java/lang/ArithmeticException done
Event: 0.036 Thread 0x0000000000926800 Thread added: 0x0000000000926800


Dynamic libraries:
00400000-0040a000 r-xp 00000000 08:04 46006628                           /opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/bigtop-utils/jsvc
0060a000-0060b000 rw-p 0000a000 08:04 46006628                           /opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/bigtop-utils/jsvc
008fb000-0091c000 rw-p 00000000 00:00 0 
0091c000-009c1000 rw-p 00000000 00:00 0 
700000000-7c0060000 rw-p 00000000 00:00 0 
7c0060000-800000000 ---p 00000000 00:00 0 
3368800000-3368820000 r-xp 00000000 08:04 2883586                        /lib64/ld-2.12.so
3368a20000-3368a21000 r--p 00020000 08:04 2883586                        /lib64/ld-2.12.so
3368a21000-3368a22000 rw-p 00021000 08:04 2883586                        /lib64/ld-2.12.so
3368a22000-3368a23000 rw-p 00000000 00:00 0 
3368c00000-3368d8a000 r-xp 00000000 08:04 2883590                        /lib64/libc-2.12.so
3368d8a000-3368f8a000 ---p 0018a000 08:04 2883590                        /lib64/libc-2.12.so
3368f8a000-3368f8e000 r--p 0018a000 08:04 2883590                        /lib64/libc-2.12.so
3368f8e000-3368f90000 rw-p 0018e000 08:04 2883590                        /lib64/libc-2.12.so
3368f90000-3368f94000 rw-p 00000000 00:00 0 
3369000000-3369017000 r-xp 00000000 08:04 2883592                        /lib64/libpthread-2.12.so
3369017000-3369217000 ---p 00017000 08:04 2883592                        /lib64/libpthread-2.12.so
3369217000-3369218000 r--p 00017000 08:04 2883592                        /lib64/libpthread-2.12.so
3369218000-3369219000 rw-p 00018000 08:04 2883592                        /lib64/libpthread-2.12.so
3369219000-336921d000 rw-p 00000000 00:00 0 
3369400000-3369402000 r-xp 00000000 08:04 2883711                        /lib64/libdl-2.12.so
3369402000-3369602000 ---p 00002000 08:04 2883711                        /lib64/libdl-2.12.so
3369602000-3369603000 r--p 00002000 08:04 2883711                        /lib64/libdl-2.12.so
3369603000-3369604000 rw-p 00003000 08:04 2883711                        /lib64/libdl-2.12.so
3369800000-3369807000 r-xp 00000000 08:04 2883659                        /lib64/librt-2.12.so
3369807000-3369a06000 ---p 00007000 08:04 2883659                        /lib64/librt-2.12.so
3369a06000-3369a07000 r--p 00006000 08:04 2883659                        /lib64/librt-2.12.so
3369a07000-3369a08000 rw-p 00007000 08:04 2883659                        /lib64/librt-2.12.so
336a000000-336a083000 r-xp 00000000 08:04 2883616                        /lib64/libm-2.12.so
336a083000-336a282000 ---p 00083000 08:04 2883616                        /lib64/libm-2.12.so
336a282000-336a283000 r--p 00082000 08:04 2883616                        /lib64/libm-2.12.so
336a283000-336a284000 rw-p 00083000 08:04 2883616                        /lib64/libm-2.12.so
7f086bbcc000-7f086be54000 rw-p 00000000 00:00 0 
7f086be54000-7f086be55000 ---p 00000000 00:00 0 
7f086be55000-7f0874000000 rw-p 00000000 00:00 0 
7f0874000000-7f0874021000 rw-p 00000000 00:00 0 
7f0874021000-7f0878000000 ---p 00000000 00:00 0 
7f0878000000-7f0878021000 rw-p 00000000 00:00 0 
7f0878021000-7f087c000000 ---p 00000000 00:00 0 
7f087c000000-7f087c021000 rw-p 00000000 00:00 0 
7f087c021000-7f0880000000 ---p 00000000 00:00 0 
7f08800d5000-7f0881c25000 rw-p 00000000 00:00 0 
7f0881c25000-7f0881dfe000 r--s 03cf8000 08:04 55838459                   /usr/java/jdk1.8.0_131/jre/lib/rt.jar
7f0881dfe000-7f08822f7000 rw-p 00000000 00:00 0 
7f08822f7000-7f08826f7000 ---p 00000000 00:00 0 
7f08826f7000-7f0882d33000 rw-p 00000000 00:00 0 
7f0882d33000-7f0882d34000 ---p 00000000 00:00 0 
7f0882d34000-7f0882e34000 rw-p 00000000 00:00 0 
7f0882e34000-7f0882e35000 ---p 00000000 00:00 0 
7f0882e35000-7f0882f35000 rw-p 00000000 00:00 0 
7f0882f35000-7f0882f36000 ---p 00000000 00:00 0 
7f0882f36000-7f0883036000 rw-p 00000000 00:00 0 
7f0883036000-7f0883037000 ---p 00000000 00:00 0 
7f0883037000-7f0883137000 rw-p 00000000 00:00 0 
7f0883137000-7f0883138000 ---p 00000000 00:00 0 
7f0883138000-7f0883238000 rw-p 00000000 00:00 0 
7f0883238000-7f0883239000 ---p 00000000 00:00 0 
7f0883239000-7f0883339000 rw-p 00000000 00:00 0 
7f0883339000-7f088333a000 ---p 00000000 00:00 0 
7f088333a000-7f088343a000 rw-p 00000000 00:00 0 
7f088343a000-7f088343b000 ---p 00000000 00:00 0 
7f088343b000-7f088353b000 rw-p 00000000 00:00 0 
7f088353b000-7f088353c000 ---p 00000000 00:00 0 
7f088353c000-7f088363c000 rw-p 00000000 00:00 0 
7f088363c000-7f088363d000 ---p 00000000 00:00 0 
7f088363d000-7f088373d000 rw-p 00000000 00:00 0 
7f088373d000-7f088373e000 ---p 00000000 00:00 0 
7f088373e000-7f088383e000 rw-p 00000000 00:00 0 
7f088383e000-7f088383f000 ---p 00000000 00:00 0 
7f088383f000-7f088393f000 rw-p 00000000 00:00 0 
7f088393f000-7f0883940000 ---p 00000000 00:00 0 
7f0883940000-7f0883a40000 rw-p 00000000 00:00 0 
7f0883a40000-7f0883a41000 ---p 00000000 00:00 0 
7f0883a41000-7f0883b41000 rw-p 00000000 00:00 0 
7f0883b41000-7f0883b42000 ---p 00000000 00:00 0 
7f0883b42000-7f0883c42000 rw-p 00000000 00:00 0 
7f0883c42000-7f0883c43000 ---p 00000000 00:00 0 
7f0883c43000-7f0883d43000 rw-p 00000000 00:00 0 
7f0883d43000-7f0883d44000 ---p 00000000 00:00 0 
7f0883d44000-7f0883e44000 rw-p 00000000 00:00 0 
7f0883e44000-7f0883e45000 ---p 00000000 00:00 0 
7f0883e45000-7f0884950000 rw-p 00000000 00:00 0 
7f0884950000-7f0884d06000 ---p 00000000 00:00 0 
7f0884d06000-7f0884f76000 rwxp 00000000 00:00 0 
7f0884f76000-7f0893d06000 ---p 00000000 00:00 0 
7f0893d06000-7f0893d20000 r-xp 00000000 08:04 55838441                   /usr/java/jdk1.8.0_131/jre/lib/amd64/libzip.so
7f0893d20000-7f0893f20000 ---p 0001a000 08:04 55838441                   /usr/java/jdk1.8.0_131/jre/lib/amd64/libzip.so
7f0893f20000-7f0893f21000 rw-p 0001a000 08:04 55838441                   /usr/java/jdk1.8.0_131/jre/lib/amd64/libzip.so
7f0893f21000-7f0893f29000 rw-s 00000000 08:02 1703938                    /tmp/hsperfdata_hdfs/17840
7f0893f29000-7f0893f54000 r-xp 00000000 08:04 55838405                   /usr/java/jdk1.8.0_131/jre/lib/amd64/libjava.so
7f0893f54000-7f0894153000 ---p 0002b000 08:04 55838405                   /usr/java/jdk1.8.0_131/jre/lib/amd64/libjava.so
7f0894153000-7f0894155000 rw-p 0002a000 08:04 55838405                   /usr/java/jdk1.8.0_131/jre/lib/amd64/libjava.so
7f0894155000-7f0894162000 r-xp 00000000 08:04 55838440                   /usr/java/jdk1.8.0_131/jre/lib/amd64/libverify.so
7f0894162000-7f0894361000 ---p 0000d000 08:04 55838440                   /usr/java/jdk1.8.0_131/jre/lib/amd64/libverify.so
7f0894361000-7f0894363000 rw-p 0000c000 08:04 55838440                   /usr/java/jdk1.8.0_131/jre/lib/amd64/libverify.so
7f0894363000-7f0895032000 r-xp 00000000 08:04 55838445                   /usr/java/jdk1.8.0_131/jre/lib/amd64/server/libjvm.so
7f0895032000-7f0895232000 ---p 00ccf000 08:04 55838445                   /usr/java/jdk1.8.0_131/jre/lib/amd64/server/libjvm.so
7f0895232000-7f089530b000 rw-p 00ccf000 08:04 55838445                   /usr/java/jdk1.8.0_131/jre/lib/amd64/server/libjvm.so
7f089530b000-7f0895356000 rw-p 00000000 00:00 0 
7f0895356000-7f0895363000 r-xp 00000000 08:04 2883615                    /lib64/libnss_files-2.12.so
7f0895363000-7f0895562000 ---p 0000d000 08:04 2883615                    /lib64/libnss_files-2.12.so
7f0895562000-7f0895563000 r--p 0000c000 08:04 2883615                    /lib64/libnss_files-2.12.so
7f0895563000-7f0895564000 rw-p 0000d000 08:04 2883615                    /lib64/libnss_files-2.12.so
7f0895564000-7f0895568000 rw-p 00000000 00:00 0 
7f089556b000-7f089556c000 rw-p 00000000 00:00 0 
7f089556c000-7f089556d000 r--p 00000000 00:00 0 
7f089556d000-7f0895571000 rw-p 00000000 00:00 0 
7ffca9719000-7ffca9730000 rw-p 00000000 00:00 0 
7ffca9730000-7ffca9733000 ---p 00000000 00:00 0 
7ffca9833000-7ffca9830000 rw-p 00000000 00:00 0                          [stack]
7ffca99b9000-7ffca99ba000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]

VM Arguments:
jvm_args: -Dproc_nfs3 -Xmx1000m -Xms3221225472 -Xmx3221225472 -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/var/log/hadoop-hdfs -Dhadoop.log.file=hadoop-cmf-hdfs3-NFSGATEWAY-nn05.int01.theadex.com.log.out -Dhadoop.home.dir=/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop -Dhadoop.id.str=hdfs -Dhadoop.root.logger=INFO,RFA -Djava.library.path=/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Dhadoop.id.str=hdfs -Xms3221225472 -Xmx3221225472 -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh -Dhadoop.security.logger=INFO,RFAS -Dcommons.daemon.process.id=17840 -Dcommons.daemon.process.parent=17753 -Dcommons.daemon.version=1.0.10 abort 
java_command: <unknown>
java_class_path (initial): /var/run/cloudera-scm-agent/process/32386-hdfs-NFSGATEWAY:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/api-util-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/avro.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/aws-java-sdk-core-1.10.6.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/aws-java-sdk-dynamodb-1.10.6.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/aws-java-sdk-kms-1.10.6.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/aws-java-sdk-s3-1.10.6.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/aws-java-sdk-sts-1.10.6.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/azure-data-lake-store-sdk-2.1.4.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/commons-beanutils-1.9.2.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/commons-collections-3.2.2.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/commons-configuration-1.6.jar:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/commons-digester-1.8.
Launcher Type: generic

Environment Variables:
JAVA_HOME=/usr/java/jdk1.8.0_131
CLASSPATH=/var/run/cloudera-scm-agent/process/32386-hdfs-NFSGATEWAY:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/*:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/.//*:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop-hdfs/./:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop-hdfs/lib/*:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop-hdfs/.//*:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop-yarn/lib/*:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop-yarn/.//*:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop-mapreduce/lib/*:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop-mapreduce/.//*:/usr/share/cmf/lib/plugins/event-publish-5.11.1-shaded.jar:/usr/share/cmf/lib/plugins/tt-instrumentation-5.11.1.jar:/usr/share/cmf/lib/plugins/navigator/cdh57/audit-plugin-cdh57-2.10.1-shaded.jar
PATH=/sbin:/usr/sbin:/bin:/usr/bin
LD_LIBRARY_PATH=:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/lib/hadoop/lib/native:/usr/java/jdk1.8.0_131/jre/lib/amd64/server:/usr/java/jdk1.8.0_131/jre/lib/amd64
SHELL=/bin/bash

Signal Handlers:
SIGSEGV: [libjvm.so+0xac8af0], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGBUS: [libjvm.so+0xac8af0], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGFPE: [libjvm.so+0x921dd0], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGPIPE: [libjvm.so+0x921dd0], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGXFSZ: [libjvm.so+0x921dd0], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGILL: [libjvm.so+0x921dd0], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGUSR1: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none
SIGUSR2: [libjvm.so+0x923610], sa_mask[0]=00000000000000000000000000000000, sa_flags=SA_RESTART|SA_SIGINFO
SIGHUP: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none
SIGINT: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none
SIGTERM: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none
SIGQUIT: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none


---------------  S Y S T E M  ---------------

OS:CentOS release 6.9 (Final)

uname:Linux 2.6.32-696.3.2.el6.x86_64 #1 SMP Tue Jun 20 01:26:55 UTC 2017 x86_64
libc:glibc 2.12 NPTL 2.12 
rlimit: STACK 10240k, CORE 0k, NPROC 65536, NOFILE 32768, AS infinity
load average:0.00 0.03 0.01

/proc/meminfo:
MemTotal:       65938472 kB
MemFree:        58382448 kB
Buffers:          144164 kB
Cached:          5945676 kB
SwapCached:            0 kB
Active:          2995968 kB
Inactive:        3753360 kB
Active(anon):     660104 kB
Inactive(anon):     1692 kB
Active(file):    2335864 kB
Inactive(file):  3751668 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:       4196348 kB
SwapFree:        4196348 kB
Dirty:               148 kB
Writeback:             0 kB
AnonPages:        658848 kB
Mapped:            45560 kB
Shmem:              2300 kB
Slab:             376640 kB
SReclaimable:     320968 kB
SUnreclaim:        55672 kB
KernelStack:       10064 kB
PageTables:         8036 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    37165584 kB
Committed_AS:    5323768 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      385968 kB
VmallocChunk:   34323773840 kB
HardwareCorrupted:     0 kB
AnonHugePages:      8192 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        5736 kB
DirectMap2M:     2058240 kB
DirectMap1G:    65011712 kB


CPU:total 24 (initial active 24) (6 cores per cpu, 2 threads per core) family 6 model 45 stepping 7, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, aes, clmul, ht, tsc, tscinvbit, tscinv

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 0
siblings	: 12
core id		: 0
cpu cores	: 6
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 0
siblings	: 12
core id		: 1
cpu cores	: 6
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 0
siblings	: 12
core id		: 2
cpu cores	: 6
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 0
siblings	: 12
core id		: 3
cpu cores	: 6
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 0
siblings	: 12
core id		: 4
cpu cores	: 6
apicid		: 8
initial apicid	: 8
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 0
siblings	: 12
core id		: 5
cpu cores	: 6
apicid		: 10
initial apicid	: 10
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 1
siblings	: 12
core id		: 0
cpu cores	: 6
apicid		: 32
initial apicid	: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 1
siblings	: 12
core id		: 1
cpu cores	: 6
apicid		: 34
initial apicid	: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 1
siblings	: 12
core id		: 2
cpu cores	: 6
apicid		: 36
initial apicid	: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 1
siblings	: 12
core id		: 3
cpu cores	: 6
apicid		: 38
initial apicid	: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 1
siblings	: 12
core id		: 4
cpu cores	: 6
apicid		: 40
initial apicid	: 40
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 1
siblings	: 12
core id		: 5
cpu cores	: 6
apicid		: 42
initial apicid	: 42
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 0
siblings	: 12
core id		: 0
cpu cores	: 6
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 0
siblings	: 12
core id		: 1
cpu cores	: 6
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 0
siblings	: 12
core id		: 2
cpu cores	: 6
apicid		: 5
initial apicid	: 5
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 0
siblings	: 12
core id		: 3
cpu cores	: 6
apicid		: 7
initial apicid	: 7
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 0
siblings	: 12
core id		: 4
cpu cores	: 6
apicid		: 9
initial apicid	: 9
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2420 0 @ 1.90GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 0
siblings	: 12
core id		: 5
cpu cores	: 6
apicid		: 11
initial apicid	: 11
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 1
siblings	: 12
core id		: 0
cpu cores	: 6
apicid		: 33
initial apicid	: 33
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 1
siblings	: 12
core id		: 1
cpu cores	: 6
apicid		: 35
initial apicid	: 35
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 1
siblings	: 12
core id		: 2
cpu cores	: 6
apicid		: 37
initial apicid	: 37
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 1
siblings	: 12
core id		: 3
cpu cores	: 6
apicid		: 39
initial apicid	: 39
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 1
siblings	: 12
core id		: 4
cpu cores	: 6
apicid		: 41
initial apicid	: 41
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 45
model name	: Intel(R) Xeon(R) CPU E5-2440 0 @ 2.40GHz
stepping	: 7
microcode	: 1808
cpu MHz		: 1899.860
cache size	: 15360 KB
physical id	: 1
siblings	: 12
core id		: 5
cpu cores	: 6
apicid		: 43
initial apicid	: 43
fpu		: yes
fpu_exception	: yes
cpuid level	: 13
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 3799.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 46 bits physical, 48 bits virtual
power management:



Memory: 4k page, physical 65938472k(58382448k free), swap 4196348k(4196348k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (25.131-b11) for linux-amd64 JRE (1.8.0_131-b11), built on Mar 15 2017 01:23:40 by "java_re" with gcc 4.3.0 20080428 (Red Hat 4.3.0-8)

time: Sat Jun 24 04:10:00 2017
elapsed time: 0 seconds (0d 0h 0m 0s)
1 ACCEPTED SOLUTION

avatar
New Contributor

We ran into that symptom after patching our hosts - it eventually emerged that we got a kernel upgrade that doesn't play nice with jsvc.  Apparently there are newer kernel versions that address the issue, but there's also a configuration workaround.

 

https://issues.apache.org/jira/browse/DAEMON-363

 

-Xss2m in the 'Java Configuration Options for NFS Gateway' setting did the trick, but check out the discussion thread in the ticket where they discuss the optimal setting.

View solution in original post

2 REPLIES 2

avatar
New Contributor

We ran into that symptom after patching our hosts - it eventually emerged that we got a kernel upgrade that doesn't play nice with jsvc.  Apparently there are newer kernel versions that address the issue, but there's also a configuration workaround.

 

https://issues.apache.org/jira/browse/DAEMON-363

 

-Xss2m in the 'Java Configuration Options for NFS Gateway' setting did the trick, but check out the discussion thread in the ticket where they discuss the optimal setting.

avatar
New Contributor
Thanks a lot for your detailed explanation! I wasn't able to find this one while researching what could be the cause, and since we upgraded both Cloudera and OS, I thought there's something wrong in Cloudera Hadoop distribution itself.