Hi wyukawa As you mentioned this is yarn bug - YARN-5368 and is fixed in the HDP-2.5.6 version.  You can try setting the below properties in your environment and check whether it helps you. yarn.timeline-service.ttl-ms=604800000 yarn.timeline-service.rolling-period=daily yarn.timeline-service.leveldb-timeline-store.read-cache-size=4194304 yarn.timeline-service.leveldb-timeline-store.write-buffer-size=4194304 yarn.timeline-service.leveldb-timeline-store.max-open-files=500 NOTE: Kindly replace the values according to your need.  If the above suggested workaround doesn't help then i would suggest you to upgrade your environment to HDP-2.5.6 version or more. You can refer the below link to check the fixed issues: https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.5.6/bk_release-notes/content/fixed_issues.html    Please "Accept as Solution" if my answer was helpful to you.   Thanks!  ... View more

@enirys This issue occurs when the request status in Ambari DB is not matching the current status of LLAP. Due to this, we can't enable Interactive Query. 1) Kindly check for the status in the Ambari DB using the below command: "select status, last_execution_status from requestschedule where status='SCHEDULED' OR status='IN_PROGRESS'" 2) To change this, run the following and change status form requestschedule table to 'COMPLETED'. update requestschedule set status='COMPLETED' where status='SCHEDULED' Reference article:  https://community.cloudera.com/t5/Customer/ERROR-quot-You-cannot-enable-Interactive-Query-now-because/ta-p/272587    Please accept as solution if my above update helps you.   Thanks! ... View more

@caisch The temp tables are created during the application run as intermediate data. These intermediate tables will not be removed in case the application fails and cleanup does not happen. The other reason might be if you are using beeline to run the query and if you abruptly disconnect the session without disconnecting properly by using '!q' then the file created on the '/tmp/hive' during the beeline initialisation will not be cleared. To clean up the /tmp directory automatically add the below properties in custom-hive-site.xml hive.start.cleanup.scratchdir - True // To clean up the Hive scratch directory while starting the HiveServer2. hive.server2.clear.dangling.scratchdir - true //This will start a thread in Hiveserver2 to clear out the dangling directories from the HDFS location. hive.server2.clear.dangling.scratchdir.interval - 1800s After adding the property kindly restart the hive service.  Reference link: https://cwiki.apache.org/confluence/display/Hive/Setting+Up+HiveServer2#SettingUpHiveServer2-ScratchDirectoryManagement    or you can run a cron job to delete the files periodically. Reference Link:  https://community.cloudera.com/t5/Support-Questions/Do-we-have-any-script-which-we-can-use-to-clean-tmp-hive-dir/m-p/156965    Please 'Accept as Solution' if my answers are really helpful to you. Thanks! ... View more

@Nikhil Raina In hadoop, Mapreduce breaks the jobs into task and these task runs in a parallel way. So that the overall execution time may reduce. Now among the divided tasks, if one of the tasks take more time than desired, then the overall execution time of job increases. The reason can be anything: node busy, network congestion, etc, which limits the total execution time of the Job, and the system should wait for the slow running tasks to be completed. It may be difficult to detect causes since the tasks still complete successfully, although more time is taken than the expected time. Hadoop doesn’t try to diagnose and fix slow running tasks, instead, it tries to detect them and runs backup tasks for them. The backup tasks will be preferentially scheduled on the faster nodes. This is called "speculative execution" in Hadoop. The "backup task" are "speculative Tasks". When a task successfully completes, then duplicate tasks that are running are killed since they are no longer needed. If the original task finishes first, then the speculative task will be killed. On the other hand, if the speculative task finishes first, then the original one will be killed. Simply, "Speculative execution" is a "MapReduce job optimization technique" in Hadoop that is enabled by default. To disable that set the property value "mapred.map.tasks.speculative.execution" - "false" and "mapred.reduce.tasks.speculative.execution" - "false" in "mapred-site.xml". Please accept this answer if you found it helpful. ... View more