question Re: Impala-shell timeout via oozie workflow in Archives of Support Questions (Read Only)

Impala-shell timeout via oozie workflow

chriswalton007 — Fri, 16 Sep 2022 13:59:49 GMT

Hi,

I have a simple oozie workflow which runs an impala-shell and exeutes a impala query file. The query is a big one so I expect to see if take a few hours, however worlflow keeps getting killed after 1 hour. When looking through the logs I see on the impala-shell logs the following "timeout 1hr"

>>> Invoking Shell command line now >>

Stdoutput Generating kerberos ticket, attempt 0, fromxxx.keytab for xxx@xxx.xom
Stdoutput Sucessfully obtained Kerberos ticket for xxx@xxx.com
Stdoutput Generating random string
Stdoutput Query parameters:
Stdoutput   tempTable=temp._attxxx_60742242
Stdoutput 0: Running query query.sql with timeout 1h, attempt 0, parameters:

The impala admission queue the query executes under has no timeout setting set, so i'm at a loss as to were this value is been picked up from?

Re: Impala-shell timeout via oozie workflow

chriswalton007 — Tue, 18 Dec 2018 15:30:31 GMT

Turns out this was a enviroement variable set within the impala-shell.sh

Re: Impala-shell timeout via oozie workflow

rohit19 — Wed, 19 Aug 2020 06:29:00 GMT

Hi Chris,

I am facing some challenges while executing the impala shell command through oozie. If possible can you please share the sample of script file in order to execute the query using Oozie workflow

Re: Impala-shell timeout via oozie workflow

Madhur — Wed, 19 Aug 2020 13:42:25 GMT

Hi @rohit19,

As this is an older post you would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question.