Member since
01-08-2019
8
Posts
0
Kudos Received
1
Solution
06-13-2019
06:04 AM
I ended up submitting this as a Cloudera Support request. I will post the solution once we figure it out.
... View more
06-11-2019
06:46 PM
I'm connected to... impalad version 2.12.0-cdh5.15.2 And yes, I'm running 300+ instances of impala-shell at the same time. I have a python script that loops through a set of queries and executes one impala-shell command per query: impala-shell -k -i edpprd --ssl --quiet -B -c -q "SET REQUEST_POOL=root.pool1; SET IDLE_SESSION_TIMEOUT=3600; select 'table1' as table_name, count(1) as cloud_count from default.table" Some of the queries take 30+ minutes to complete when running by themselves. I also tried this without defining a pool and just submitting all the queries on their own and it overwhelms the impala server memory and results in 100+ failed queries.
... View more
06-11-2019
01:37 PM
I'm executing 300+ queries at once via impala-shell in a pool that allows a queue of 500. However, after 10 minutes I start to see some queries flagged as error with a query status of "session closed". The query uses the following option "SET IDLE_SESSION_TIMEOUT=3600;" Any thoughts on what property I need to change so the session stays open longer than 10 minutes? I'm running Impala Shell v2.12.0-cdh5.15.2
... View more
Labels:
- Labels:
-
Apache Impala