Cloudera Community
thewayofthinkin
user rank
Rising Star

Re: queries in flight issue

by Rising Star in Support Questions
‎02-02-2017 09:28 AM
‎02-02-2017 09:28 AM
Thank you.   I will check with team to set the timeout.   Gatsby ... View more

Re: What / When flush out table metadata in catalo...

by Rising Star in Support Questions
‎02-02-2017 09:27 AM
‎02-02-2017 09:27 AM
From log history, I found out someone keep running 'invalidate metadata' without table name. 😞   Thank you for your comment Gatsby ... View more

Re: When querying a VIEW, query planning takes a l...

by Rising Star in Support Questions
‎02-02-2017 09:26 AM
‎02-02-2017 09:26 AM
yeap. you're right. I will take a look log. Thank you Gatsby ... View more

Re: queries in flight issue

by Rising Star in Support Questions
‎02-01-2017 08:17 PM
‎02-01-2017 08:17 PM
I found out this open ticket - https://issues.cloudera.org/browse/IMPALA-1575 Probably the query you saw is from Hue.   Gatsby ... View more

Re: When querying a VIEW, query planning takes a l...

by Rising Star in Support Questions
‎02-01-2017 02:09 PM
‎02-01-2017 02:09 PM
@gaurang   Today, I had some issue with slow quries. And, the issue was related to metadata Catalog Daemon caches.     How often do you make quries to that TABLE/VIEW ( I don't think your issue is related to VIEW )?   In my case, metadata for TABLE was reloaded very often because Catalog Daemon flushes out metadata.   Take a look your catalog daemon and check if TABLE metadata is cached.   Gatsby ... View more

What / When flush out table metadata in catalog da...

by Rising Star in Support Questions
‎02-01-2017 02:04 PM
‎02-01-2017 02:04 PM
Hello,   I have a question about metadata loaded in Impala catalog daemon.   If I understand correctly, catalog daemon read TABLE metadata from Hive metadata store and caches in memory. My question is what trigger flushing out this cached TABLE metadata.   The reason I ask this question is that I noticed that TABLE metadata is flushed out from catalog daemon after some time. And, since TABLE metadata doesn't exist, catalog daemon tries to load metadata again from metastore.   Is there some kind of configuration I can set to control TABLE metadata lifecycle ( or memory )?   Thank you Gatsby   ... View more
Labels:

Re: When querying a VIEW, query planning takes a l...

by Rising Star in Support Questions
‎02-01-2017 12:44 PM
‎02-01-2017 12:44 PM
@Lars Volker   I have a question for you. How long the metadata loaded from Hive metastore by Impala Catalog Daemon stay in memory?   I'm using Impala 2.7 ( KUDU ). It seems the metadata is flushed more often than before.   Is there any configuration for life cycle for metadata in catalog daemon has?   @gaurang I'm asking this question here because I guess @Lars Volker answer can help resolve your issue.   Thank you Gatsby ... View more

Re: queries in flight issue

by Rising Star in Support Questions
‎02-01-2017 09:20 AM
‎02-01-2017 09:20 AM
@dsss   yeap. I agree with you. we can't just kill those quries manually. I think most of times quries in exception status and in filght quries from Hue.   @Lars Volker Is there way to log slow quries like MySQL slow quries? Is there way to set timeout for long running quries so that those quries can be killed?   Thank you Gatsby ... View more

Re: CDH5.10 redhat repo doesn't have Impala 2.8 RP...

by Rising Star in Support Questions
‎01-31-2017 05:45 PM
‎01-31-2017 05:45 PM
@Tim Armstrong   Thank you very much for your explanation. 🙂   Gatsby ... View more

Re: WARNINGS: Too many partitions selected, doing ...

by Rising Star in Support Questions
‎01-31-2017 04:36 PM
‎01-31-2017 04:36 PM
FYI, `COMPUTE STATS` can run with first level partition. https://issues.cloudera.org/browse/IMPALA-1570 ... View more
Contact Me
Online
Offline
Last Visited
‎04-28-2020 07:04 PM
Community Statistics
Member Since ‎12-30-2015 01:25 PM
Last Visited ‎04-28-2020 07:04 PM
Posts 73
Kudos received 3