Created on 07-07-2022 03:04 AM - edited 07-07-2022 03:29 AM
Hello Everyone,
Greeting of the day.
I have installed HDP 3.1 two times on two different servers. That is it was a single node installation on two different physical machines. But both the times I am facing issues in hive. In this , create,update, drop, delete queries works properly but always at the time of insert statement it waits for long time with a message "tez session hasn't been created yet, opening session". And it further doesn't progress . So I have to wait for some time and then cancel the command/queries.
Normal basic insert statements also doesn't works and gets same message.
I have tried all possible tuning parameters in hive, yarn, tez etc but no luck. Tried with set session variables as well i.e hive.execution.engine but no luck again.
Need your help, valuable suggestions/inputs here.Thank you.
Thanks & Regards,
Created 07-07-2022 08:30 PM
Hi @dmharshit, if possible can you try running the insert query after changing the execution engine to MapReduce by setting the below parameter?
set hive.execution.engine=mr;
Created 07-11-2022 11:33 PM
Hi @jagadeesan Tried this option already with set but no luck
Created 07-12-2022 09:15 AM
Hi @dmharshit, once you have set hive.execution.engine=mr; what error are you getting? Please can you attach the screenshot?
Created 07-13-2022 06:50 AM
It further proceeds with starting job and get urls but jobs doesn't get complete and remains in hang state.
Created on 07-24-2022 11:41 PM - edited 07-24-2022 11:42 PM
Yarn queue where the Tez application gets submitted don't have enough capacity to start a new application.
You should be able to see tez application in yarn rm -> accepted applications. Tune NM capacity + reduce following configs to let yarn accept & launch new application.
-- Setting AM size to 512mb
set tez.am.resource.memory.mb=512;
-- Setting Task container size to 512mb
set hive.tez.container.size=512;