Thank you @Markovich. I have been looking for this fix for months. I even opened multiple tickets with Hortonworks but they were not very helpful. Finally, I can put this to rest.
Just to add more clarity, for HDP clusters the hive.server2.parallel.ops.in.session=true propery has to be added to hive-site.xml (if done manually) or at Hive > Config > Advanced > "Custom hive-site" section if done via Ambari.