I think it could be a configuration issue .When you say "custom yarn queue" ,Is this the queue you are configuring in the capacity scheduler.xml file ? Could you please attach your configuration files and we can review the same .
You can check the following parameters to get more details
Yes, by the custom YARN queue I mean the queue which I configured in the capacity-scheduler of Yarn. I used the exact same configurations as suggested by you above but it didn't work so I switched back to using the default queue in Yarn. I'll again change the configs on my sandbox to use a custom queue and will share the config files shortly. Thanks for your help..:)