Member since
03-23-2015
1288
Posts
114
Kudos Received
98
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3297 | 06-11-2020 02:45 PM | |
5016 | 05-01-2020 12:23 AM | |
2815 | 04-21-2020 03:38 PM | |
2620 | 04-14-2020 12:26 AM | |
2322 | 02-27-2020 05:51 PM |
08-02-2017
04:56 AM
1 Kudo
Hi, That link contains the settings provided by Cloudera Manager to monitor impala services, I do not think that's what you are looking for. They are specific to Cloudera Manager, not part of Impala. Cloudera Manager internally queries this page provided by Impala daemon host: http://<impala-daemon-url>:25000/inflight_query_ids to determine if the impala is responding to requests. This page will return a list of query IDs that is inflight. How long it takes to get a response and how many queries are running at a time, could give you some indication of the health of the impala daemon. Hope this helps.
... View more
08-02-2017
04:38 AM
ALTER TABLE test CHANGE {columname} {columnname} {datatype} comment 'test comment'; See below test case: [impala-host:21000] > show create table test;
Query: show create table test
+---------------------------------------------------------------------------------------------------------------------+
| result |
+---------------------------------------------------------------------------------------------------------------------+
| CREATE TABLE default.test ( |
| a INT, |
| b INT |
| ) |
| WITH SERDEPROPERTIES ('serialization.format'='1') |
| STORED AS TEXTFILE |
| LOCATION 'hdfs://namenode-host:8020/user/hive/warehouse/test' |
| TBLPROPERTIES ('numFiles'='3', 'COLUMN_STATS_ACCURATE'='true', 'numRows'='9', 'totalSize'='40', 'rawDataSize'='31') |
+---------------------------------------------------------------------------------------------------------------------+
Fetched 1 row(s) in 7.42s
[impala-host:21000] > alter table test change a a int comment 'test comment';
Query: alter table test change a a int comment 'test comment'
Fetched 0 row(s) in 0.66s
[impala-host:21000] > show create table test;
Query: show create table test
+---------------------------------------------------------------------------------------------------------------------+
| result |
+---------------------------------------------------------------------------------------------------------------------+
| CREATE TABLE default.test ( |
| a INT COMMENT 'test comment', |
| b INT |
| ) |
| WITH SERDEPROPERTIES ('serialization.format'='1') |
| STORED AS TEXTFILE |
| LOCATION 'hdfs://namenode-host:8020/user/hive/warehouse/test' |
| TBLPROPERTIES ('numFiles'='3', 'COLUMN_STATS_ACCURATE'='true', 'numRows'='9', 'totalSize'='40', 'rawDataSize'='31') |
+---------------------------------------------------------------------------------------------------------------------+
... View more
08-02-2017
04:19 AM
Hi, As the error message indicated, UNION ALL is not supported at top level, you need to put it in a sub query, similar to below: SELECT loc, cnt FROM ( select a.loc as loc, a.cnt13 cnt from crimeloc13 a UNION ALL select b.loc as loc, b.cnt14 as cnt from crimeloc14 b ) a;
... View more
07-12-2017
12:26 AM
Hi Garren, Where did you check those settings? Is it on the server side or client side? Hive has client (beeline) and server (hiveserver2), depends on where the setting sit, they might be ignored. Please locate the hive-site.xml file for HS2 and attach the content here.
... View more
07-12-2017
12:21 AM
You might also want to share the full query that failed with such error, together with the full stack trace.
... View more
07-11-2017
11:58 PM
Hi yueyang, Can you please share your impyla source code and the error you are getting? That will help me understand why it failed. Thanks
... View more
04-12-2017
04:52 AM
Can you please share what was the data look like in MySQL and what it looks like in Hive after imported? Can you show the output of "SHOW CREATE TABLE customer" in Hive?
... View more
04-12-2017
04:23 AM
By the way, what data format are those two tables? Are they TEXT file or other container formats like Parquet or AVRO? Can you show me the DDL of both tables?
... View more
04-12-2017
04:21 AM
Is column a.t_date a timestamp field? Can you try to sort another column that is other data types, like int, or varchar, to compare? Sorting by timestamp data type could be an expensive operation.
... View more
04-11-2017
11:49 PM
It looks like the job was stuck at SORT operation, and was using at least 47GB so far before you killed the query. Can you please try to remove the ORDER BY clause in the query to see if it makes any difference?
... View more