Hi @HareshAmin ,   As per the below documentation it looks like Hive UDF's are not supported in Impala. Please refer the documentation: https://docs.cloudera.com/documentation/enterprise/5-8-x/topics/impala_udf.html   Regards, Chethan YM ... View more

Hi,   The Reducer process the output of the mapper. After processing the data, it produces a new set of output. At last HDFS stores this output data. Reducer takes a set of an intermediate key value pair produced by the mapper as the input and runs a Reducer function on each of them. The mappers and reducers depends on the data that is processing.   You can manually set the number of reducers with below property but i think it is not recommended. set mapred.reduce.tasks=xx;   Regards, Chethan YM ... View more

Hi @drgenious ,   1. can you attach the full query profile of it to take a look? 2. You mean query is finished in 8 minutes but why Unregister query has took 19 min am i correct ? if not please elaborate the issue. 3. How you are running the queries from impala-shell or Hue? 4. what is the session timeouts you have in the cluster for impala queries?   Regards, Chethan YM ... View more

Hello @raghu9raghavend ,   Please provide the error/stack-trace for the failure.   Regards, Chethan YM ... View more

Hi,   As per my previous comment can you destroy it and restart the LLAP and see if this works. Note: llap0 is the default application that will be running if LLAP is installed it will be recreated even if you destroy it and restart the service.    #yarn app -destroy llap0   Regards, Chethan YM   ... View more

Hi,   Can you perform these steps and see if this helps to restart LLAP.   1. Check ps -ef | grep -I llapdaemon  run it on the node managers and kill the process if queue utilisation was full.        check in all the nodemanager ,if any stale llap daemon process is running        > ps -ef | grep llap   2.   su - hive       # yarn app -status llap0       # yarn app -destroy llap0   Regards, Chethan YM     ... View more

Hello @ighack ,   You are welcome..!!   Was your question answered? Please Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.   Regards, Chethan YM ... View more

Hi @ighack ,   As like yarn, there is no direct options for impala admission control pool, As per the cloudera documentation you need to select "default settings" under impala admission control to add users and group. Below is the screenshot of it.     After you click on Default Settings you need to choose "Allow these users and groups to submit to this pool" to add users and groups.   Regards, Chethan YM ... View more

Hi @harnu ,   Could you add these below values to /etc/security/limits.conf file and see if this helpfull? If you already have these values try to increase it and rerun the query.   hive soft nofile 65000 hive hard nofile 65000   hive soft proc 80000 hive hard proc 80000   Update limits.conf with above settings and restart hiveserver2 service while stopping all the services on that node. Please su - hive and then ulimit -a to check whether the parameters are updated for no of open files and max user process.   Regards, Chethan YM   Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.     ... View more

Hi @wert_1311 ,   Seems to be "load_catalog_in_background" option is set to true in your cluster,  This can result in lock contention.  The recommended value for this parameter is false.  Please change the value to False and see if this helpful. And if you are also seeing any JVM pauses in the catalog logs try to increase the catalog heap size and monitor the cluster.   https://docs.cloudera.com/documentation/enterprise/5-16-x/topics/impala_config_options.html   Regards, Chethan YM    Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more