Support Questions
Find answers, ask questions, and share your expertise

HiveServer2 Thrift Thread Pool

We have Hive 1.2.1.2.3 Thrift service installed with Atlas Plugin, Ranger Plugin. After some days, we exhaust the running threads, receive an error such as below in the logs and the service stops responding, requiring a restart.

org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Hive Internal Error: java.util.concurrent.RejectedExecutionException(Task java.util.concurrent.FutureTask@1c9f4873 rejected from java.util.concurrent.ThreadPoolExecutor@1bacbbcc[Running, pool size = 1, active threads = 1, queued tasks = 10000, completed tasks = 345])

Caused by: java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1c9f4873 rejected from java.util.concurrent.ThreadPoolExecutor@1bacbbcc[Running, pool size = 1, active threads = 1, queued tasks = 10000, completed tasks = 345]

Does anyone have further information on troubleshooting this issue or means to determine what is exhausting the thread pool?

thanks.

1 REPLY 1

Cloudera Employee

@Andrew Sears Can you get the output of jstack when this happens? The threads go back to the threadpool once a query has completed execution, so unless there is some kind of a leak, this should not happen. The number of queued tasks also seem pretty huge.