Support Questions
Find answers, ask questions, and share your expertise

ColumnStatsTask failed on one big and wide table

I'm running a hive POC. We have a combined big table which has > 2300 columns and 44million rows. I submitted the command "analyze table TABXXX COMPUTE STATISTICS for COLUMNS;" It failed with below messages in the end:

Map 1: 79(+1)/80 Reducer 2: 0(+1)/1

Map 1: 79(+1)/80 Reducer 2: 0(+1)/1

Map 1: 79(+1)/80 Reducer 2: 0(+1)/1

Map 1: 79(+1)/80 Reducer 2: 0(+1)/1

Map 1: 80/80 Reducer 2: 0(+1)/1

Map 1: 80/80 Reducer 2: 1/1

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exe

Anybody can give me some hint how to make it work ?

2 REPLIES 2

Cloudera Employee

You may have to check the yarn app log and hivemetastore.log for more detail regarding the error/failure. Please post the error stack from hivemetastore.log

@thussain,

It does logged some java error in hivemetastore.log. Please ese attachment hivemetastore.txt

; ;