question Re: HiveMetaStore and HiveServer2 didn't log the pool thread in Archives of Support Questions (Read Only)

HiveMetaStore and HiveServer2 didn't log the pool thread

teng — Fri, 16 Sep 2022 10:37:53 GMT

I have 2 clusters both are in CDH 5.4.7

First cluster when I see the log file

In HiveMetastore log, I see [pool-3-thread-xxx] every line in the log and

In HiveServer2 log, I also see [HiveServer2-Handler-Pool: Thread-xxxxxx] every line in the log

But in the second cluster

In HiveMetastore log, It didn't print [pool-3-thread-xxx] and

In HiveServer2 log, It didn't print [HiveServer2-Handler-Pool: Thread-xxxxxx]

So I want to see the pool thread in the log, I don't know why the first cluster show pool thread and second cluster didn't show

please suggest, Any kind of help is appreciated.

Thanks,

Teng

Re: HiveMetaStore and HiveServer2 didn't log the pool thread

EricL — Mon, 05 Sep 2016 10:37:29 GMT

Hi Teng,

This sounds like that you are using different thrift service class, can you please copy and paste some sample HS2 and HMS logs that do not have thread information here? I would like to confirm which class you are using.

Thanks

Re: HiveMetaStore and HiveServer2 didn't log the pool thread

teng — Mon, 05 Sep 2016 12:53:59 GMT

I figure out that it uses different log4j configuration

The first one there is [%t] in conversionPattern

Re: HiveMetaStore and HiveServer2 didn't log the pool thread

EricL — Tue, 06 Sep 2016 03:50:17 GMT

Hi Teng,

I am glad that you have figured out the cause.

Re: HiveMetaStore and HiveServer2 didn't log the pool thread

NaveenGangam — Tue, 06 Sep 2016 12:26:48 GMT

Yes, HMS and HS2 have separate log4j.properties files.

However, I find it odd that one cluster has the threadname in the log records while the other does not (both CDH5.4.7). The defaults should be exactly the same on both the clusters.

Perhaps, you could confirm that you have not overridden the configuration in a safety valve.

To add a threadname to the log records for the HMS,

Select Hive Service --> Instances --> Hive Metastore Server --> Configuration
then type in log4j and look for
"Hive Metastore Server Logging Advanced Configuration Snippet (Safety Valve)" This is where I would set it to something like this ..
log4j.appender.RFA.layout.ConversionPattern=%d{ISO8601} %-5p [%t]: %c{2} (%F:%M(%L)) - %m%n
or just
%d{ISO8601} %p [%t]: %c: %m%n

the %t is what adds the thread name to the log records.

Hope this helps. Thanks