Support Questions
Find answers, ask questions, and share your expertise

Hive CLI taking long time to start

Explorer

After launching hive command, it is taking more than 2-3 hours to start the Hive CLI.

The screen will have below output for about 2-3 hours and then Hive CLI will start:

[hdfs@hdp-m0 ~]$ hive
log4j:WARN No such property [maxFileSize] in org.apache.log4j.DailyRollingFileAppender.
Logging initialized using configuration in file:/etc/hive/2.6.4.5-2/0/hive-log4j.properties
3 REPLIES 3

Super Mentor

@Tejaswi Chandra
Can you try running the following commands to run the hive cli in DEBUG mode to see where it it hanging? if it is hanging on any specific engine mode?
Example:

# su - hive
# hive --hiveconf hive.execution.engine=tez  --hiveconf hive.root.logger=DEBUG,console

AND

# su - hive
# hive --hiveconf hive.execution.engine=mr  --hiveconf hive.root.logger=DEBUG,console

.

Also when it hangs then please collect thread dumps (5-6) as mentioned in the article: https://community.hortonworks.com/articles/72319/how-to-collect-threaddump-using-jcmd-and-analyse-i....

Thread dumps will tell us exactly where the threads are stuck.

Explorer

@Jay Kumar SenSharma

Thank you for the response.

I have run the script threaddump_cpu_with_cmd.sh to collect threaddump.

Attached are the two files which are generated by this script:

top-highcpu.txt

jcmd-threaddump.txt

Explorer

@Tejaswi Chandra check your queue resource utilization from RM UI