What does mean AverageThreadTokens in impala's query profile

[#1]

Hi dear experts!

does anybodu know what does mean AverageThreadTokens in Impala's query profile?

thanks!

[#2 · Accepted solution]

I found in source code:

https://github.com/boorad/impala/blob/master/be/src/runtime/plan-fragment-executor.h

// Average number of thread tokens for the duration of the plan fragment execution.

// Fragments that do a lot of cpu work (non-coordinator fragment) will have at

// least 1 token.  Fragments that contain a hdfs scan node will have 1+ tokens

// depending on system load.  Other nodes (e.g. hash join node) can also reserve

// additional tokens.

// This is a measure of how much CPU resources this fragment used during the course

// of the execution.

RuntimeProfile::Counter* average_thread_tokens_;

[#3]

I am happy to see that you found your answer. Thanks for sharing it. 🙂