Support Questions
Find answers, ask questions, and share your expertise

why impala query execution ends before log shows 100% complete

why impala query execution ends before log shows 100% complete

Explorer

impala.JPG

I am running the query in the above image.
Before the log shows "100% complete (128 out of 128) " the execution of the query stopped and showed that "Inserted 803974 rows".

 As you can see it stopped when the log is showing "74% Complete (95 out of 128)" ... and I am expecting more records to be inserted. 

 

where can I find the error/problem, if there is any?

2 REPLIES 2

Re: why impala query execution ends before log shows 100% complete

Cloudera Employee

Hi @anis447 ,

 

Could you compare the actual row counts of the source and target tables? (like "select count(*) from v2_scopeFactTable;" and "select count(*) from dwh_db_atlas_jrtf.tblScopeFact;" ) to see if they match? The percentage values you describe seem to come from Hue, and they seem to be very different from the row count you mention, so I am not sure the two values are actually related.

Querying count(*) should give you the actual database row counts there.

 

Regards,

  - Laszlo

Re: why impala query execution ends before log shows 100% complete

Explorer

Thanks @LaszloG 

But I don't know if you understood my question ... sorry if I was not clear.

 

First yes the query should insert more than 1M records in the created table, yet it inserted and stopped on around 800K.

 

Second what I am wondering and my question in another words is:
if you check the query log you will see that the "Status" of the query "FINISHED", yet the "Scan Progress" is "104 128 (81.25)% " as in the following image:

impala2.jpg

can you interpret that please?