Member since
03-06-2020
406
Posts
56
Kudos Received
37
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 395 | 08-29-2025 12:27 AM | |
| 1021 | 11-21-2024 10:40 PM | |
| 978 | 11-21-2024 10:12 PM | |
| 3050 | 07-23-2024 10:52 PM | |
| 2155 | 05-16-2024 12:27 AM |
02-28-2022
04:50 AM
1 Kudo
Hi, Similar exception can be seen if we do not add credentials block with in the workflow something like below. Do check you have correct credentials if its a kerborized cluster. <credentials> <credential name="hcatauth_creds" type="hcat"> <property> <name>hcat.metastore.uri</name> <value>thrift://<metastore-fqdn>:9083</value> </property> <property> <name>hcat.metastore.principal</name> <value>hive/_HOST@<REALM></value> </property> </credential> Regards, Chethan YM
... View more
02-16-2022
06:21 AM
Hi, As i seen till now there is no such way to rerun the job automatically when it is failed, I think you have to rerun it manually as you do always. If you want this type of behaviour you may need to create custom scripts as per your requirements. Regards, Chethan YM
... View more
02-16-2022
05:46 AM
Hi @mala_etl , It looks like a below known issue: https://issues.cloudera.org/browse/HUE-8717 Do work with Cloudera support to get a patch. Regards, Chethan YM
... View more
02-16-2022
05:32 AM
Hi, To look into the issue we need a complete error stack-trace can you please attach it? Also is this happens every-time after impala restart? Regards, Chethan YM
... View more
02-04-2022
05:00 AM
Hi, Yes, Impala daemons will use the memory during the execution. Your understanding is correct. In the attached screenshot i can see the corrupted stats for the tables involved in the query, We recommend to run "compute stats" on the tables which is having partial stats and rerun the queries otherwise it will generates bad execution plan and uses more memory than expected. Regards, Chethan YM
... View more
01-25-2022
04:08 AM
1 Kudo
Hi, Please try to rerun the sqoop import outside of oozie and confirm whether its working or not. If it is working then we need to check it from oozie side. We need a complete stacktrcae of the error. Regards, Chethan YM
... View more
01-25-2022
02:51 AM
1 Kudo
Hi, You can restrict the amount of memory Impala reserves during query execution by specifying the -mem_limit option. If you set mem_limit=2gb, The query will not use more than 2gb even if it needs. If you cannot set the memory at the time of execution every-time i think you can create a new resource pool under impala admission control. While creating resource pool you can mention Min and Maximum Query Memory Limit and do not use this resource pool for production queries. set request_pool="pool-name" run the test queries. Regards, Chethan YM
... View more
01-03-2022
04:37 AM
Hi, -> Have you tried the same query via Hive? Does it work? -> How this table got created via hive or impala? -> Try "invalidate metadata" in impala and retry Regards, Chethan YM
... View more
12-06-2021
06:15 AM
Hi @HareshAmin , As per the below documentation it looks like Hive UDF's are not supported in Impala. Please refer the documentation: https://docs.cloudera.com/documentation/enterprise/5-8-x/topics/impala_udf.html Regards, Chethan YM
... View more
12-01-2021
08:41 AM
Hi, The Reducer process the output of the mapper. After processing the data, it produces a new set of output. At last HDFS stores this output data. Reducer takes a set of an intermediate key value pair produced by the mapper as the input and runs a Reducer function on each of them. The mappers and reducers depends on the data that is processing. You can manually set the number of reducers with below property but i think it is not recommended. set mapred.reduce.tasks=xx; Regards, Chethan YM
... View more