Skip to main content
Tomas79
Tomas79
Platinum ⭐️
May 16, 2019
Solved

Impala cannot read via short circuit

Hi Cloudera, 

I see a lot of these warnings in Impala Daemon logs:

 

W0516 07:12:24.227567 1049 ShortCircuitCache.java:826] ShortCircuitCache(0x119fb869): could not load 1399296933_BP-76826636-10.197.31.86-1501521881839 due to InvalidToken exception.

Does it indicate some bad configuration? What can I do to eliminate these warnings?

Thanks

 

EricL
EricLAnswer
Platinum ⭐️⭐️
May 19, 2019
Hi Tomas,

This message is normal behaviour and expected to happen when the Datanode's security key manager rolls its keys.

It will cause clients to print this whenever they use the older cached keys, but the post-action of printing this message is that the client refetches the new key and the job completes.

Since Impala is a client of HDFS, there is no concern or worry about this message, as it is part of normal operation. We also see this from HBase logs, which is again, normal.

Hope above helps.

Cheers
Eric
View in thread

1 reply

EricL
Platinum ⭐️⭐️
EricLAnswer
Platinum ⭐️⭐️
May 19, 2019
Hi Tomas,

This message is normal behaviour and expected to happen when the Datanode's security key manager rolls its keys.

It will cause clients to print this whenever they use the older cached keys, but the post-action of printing this message is that the client refetches the new key and the job completes.

Since Impala is a client of HDFS, there is no concern or worry about this message, as it is part of normal operation. We also see this from HBase logs, which is again, normal.

Hope above helps.

Cheers
Eric
Translate
Terms & ConditionsAccessibility statement