Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

CDH 5.4 impala timezone problems

CDH 5.4 impala timezone problems

New Contributor

Hello cloudera community.

I have a timezone problem which seems to be similar to this:

https://community.cloudera.com/t5/Support-Questions/CM-does-not-show-Impala-all-queries-Service-moni...

 

Since about  a month or longer I have no more impala queries in the query monitor section, which makes it hard to optimize statements

 

The log of the management host has a lot of entries like that:

tail -f /var/log/cloudera-scm-firehose/mgmt-cmf-mgmt-SERVICEMONITOR-`hostname -f`.log.out

 

2019-11-19 18:25:43,536 WARN com.cloudera.cmon.firehose.ImpalaQueryManager: Impala query: c8476c1bdfa67dac:d50e6e5b940d6bba with endTime 2019-11-19T19:25:41.826Z is outside acceptance window.

 

It looks like the log timestamp is at least an hour past the query endtime timestamp

server time was

Di 19. Nov 19:18:25 CET 2019

I wrote a Java snippet to get the Java system time

result example:

 

# java TimeTest
Current time in milliseconds = 1574123366996 => Tue Nov 19 01:29:26 MEZ 2019
Current time zone: Europe/Berlin

# date
Di 19. Nov 01:29:26 CET 2019

Which looks good to me.

In the above mentioned post the solution was:

 

"After further investigation, I found out that the timezone "seen" by Java was different than in OS. I added this startup parameter to the service monitor configuration which configures the timezone

-Duser.timezone=Europe/Bratislava"

 

The question is: if I want to add teh needed timezon -Duser.timezone=Europe/Berlin where should I configure it?

We tried in /etc/default/cloudera-scm-agent.

CMF_AGENT_ARGS=""
CMF_JAVA_OPTS="-Duser.timezone=Europe/Berlin"

 

But after a restart of server & manager there was noc change

Still the same problem

 

Would appreciate any help!

 

Christian

 

3 REPLIES 3
Highlighted

Re: CDH 5.4 impala timezone problems

Explorer

I have the same problem. Have you found any solution?

Re: CDH 5.4 impala timezone problems

Cloudera Employee

@slowrocket 

 

There is perhaps a difference in localtime configured in your impala daemon nodes and management service nodes which is causing these issues.

 

You can change the system localtime on the impala daemons hosts using below steps: 

1) delete the /etc/localtime file. 2) Link the time CET the /usr/share/zoneinfo folder to /etc/localtime with this command:

#ln -s /usr/share/zoneinfo/CET /etc/localtime

 

2.a) If you don't want to link it you can copy and rename it to localtime:

#cp /usr/share/zoneinfo/CET /etc/localtime

After you did this on the hosts where the timezone is wrong, please execute the queries and check if there are still discrepancies observed

Re: CDH 5.4 impala timezone problems

Cloudera Employee

An easier approach would be to change timezone of your service monitor host/CM server. You can follow the same steps to have the same timezone as the Impala daemon nodes. Restart the Cm server for changes to take effect on the CM web UI

Don't have an account?
Coming from Hortonworks? Activate your account here