Support Questions
Find answers, ask questions, and share your expertise

Dynamic YARN resource allocation

Dynamic YARN resource allocation


Half of the resources on YARN in our cluster is dedicated to Hive LLAP, while the other half is left free for other various tasks, such as Spark or mapreduce containers. However, there are times when no other jobs are running, and LLAP is loaded to its fullest. Is there a setting allowing for dynamic allocation of all resources? That is, in such cases, would it be possible to allocate all, or i.e., 80% of the unused space for LLAP, and return it back to normal after finishing the jobs?

As far as I know now, only way to do that would require a LLAP or YARN restart, which is not at all preferred.

Don't have an account?