Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

What does mean AverageThreadTokens in impala's query profile

Solved Go to solution

What does mean AverageThreadTokens in impala's query profile

Rising Star

Hi dear experts!

 

does anybodu know what does mean AverageThreadTokens in Impala's query profile?

 

thanks!

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: What does mean AverageThreadTokens in impala's query profile

Rising Star

I found in source code:

 

https://github.com/boorad/impala/blob/master/be/src/runtime/plan-fragment-executor.h

 

// Average number of thread tokens for the duration of the plan fragment execution.

// Fragments that do a lot of cpu work (non-coordinator fragment) will have at

// least 1 token.  Fragments that contain a hdfs scan node will have 1+ tokens

// depending on system load.  Other nodes (e.g. hash join node) can also reserve

// additional tokens.

// This is a measure of how much CPU resources this fragment used during the course

// of the execution.

RuntimeProfile::Counter* average_thread_tokens_;

View solution in original post

2 REPLIES 2
Highlighted

Re: What does mean AverageThreadTokens in impala's query profile

Rising Star

I found in source code:

 

https://github.com/boorad/impala/blob/master/be/src/runtime/plan-fragment-executor.h

 

// Average number of thread tokens for the duration of the plan fragment execution.

// Fragments that do a lot of cpu work (non-coordinator fragment) will have at

// least 1 token.  Fragments that contain a hdfs scan node will have 1+ tokens

// depending on system load.  Other nodes (e.g. hash join node) can also reserve

// additional tokens.

// This is a measure of how much CPU resources this fragment used during the course

// of the execution.

RuntimeProfile::Counter* average_thread_tokens_;

View solution in original post

Highlighted

Re: What does mean AverageThreadTokens in impala's query profile

Community Manager

I am happy to see that you found your answer. Thanks for sharing it. :)


Cy Jervis, Community Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:
Community Guidelines
How to use the forum
Don't have an account?
Coming from Hortonworks? Activate your account here