Import via Thrift leads to Hive Crahs

[#1]

Hi,

we are importing data via thrift into the hive. After a while we see in ambari that the hive gets marked red an we have to restart the hive service to get it working

the log directo empty.

are there any hints why hive keeps crashing?

SystemInfo:

Rack:

/default-rack

OS:

redhat7 (x86_64)

Cores (CPU):

56 (56)

Disk:

27.79GB/271.33GB (10.24% used)

Memory:

125.63GB

Load Avg:

0.29

Heartbeat:

less than a minute ago

Current Version:

2.6.0.3-8

HDP-2.6

thx

[#2]

@Gerhard Neuhofer

can you share the command used to import the data to Hive.

Also, I do not understand "the log directo empty", does this mean no logs in Hive Metastore? Id yes, it seems like a process crash.

Check your /var/log/messages for any errors at the time.

Do confirm if core limit is set to unlimited in "ulimit -a" output, this shall generate a core file for analysis of the crash.

[#3]

Hi @Rohit Rai Malhotra,

output of unlimit -a is:

core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 514475
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 4096
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

i'll check the messages log today.

thx for the info.

best