Hi,   I am running a query and despite the fact that it reached the limit in (8 mins) and it seems FINISHED inside the query details in CM, it stops at (19 mins). Whys it this happening? I saw the below information in query details:   First row fetched: 7.9m (75ms) Last row fetched: 8.0m (7.21s) Released admission control resources: 19.5m (11.6m) Unregister query: 19.5m (103ms) ... View more

Hi,   I have create a UDF in impala but every time I am restarting it the UDF is gone. Is there anyway to fix this issue ?      create function my_udf(String,String,String) returns boolean location 'udfs-1.0-SNAPSHOT-jar-with-dependencies.jar' SYMBOL='MyUDF ; ... View more

Hi,   I am new in Kafka and I have some questions. I want to create a pipeline which extract data from Mysql to kafka. Although after a lot of search I found something about CDH which is when something in the source table changes to send the updated record to Kafka. I do not want such a thing. I only want to extract data according to primary key.  Is there any course to do in order to learn or can anybody provide any tips?   Thanks in advance. ... View more

I have some tables in hive and I want to find the size of each table through the metastore (MySQL). I am trying the below but it returns paratition_params, notification_log, sds etc. My tables are stored in TABLES.TBLS but when I am running the below query with from information_schema.TABLES.TBLS it returns this: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '.TBLS ORDER BY (DATA_LENGTH + INDEX_LENGTH) DESC LIMIT 0, 200' at line 5 SELECT TABLE_NAME AS `Table`, ROUND((DATA_LENGTH + INDEX_LENGTH) / 1024 / 1024) AS `Size (MB)` FROM information_schema.TABLES ORDER BY (DATA_LENGTH + INDEX_LENGTH) DESC; ... View more

I have some tables in impala and in the create tables statement they have sort by( timestamp column) but when I query them they are returning the data not sorted. Why is this happening?   For example  2019-09-18 08:44:10 2020-08-05 13:15:48 2020-08-05 13:24:00 2020-10-15 18:29:34 2020-09-09 09:35:04 ... View more