Member since
09-28-2021
4
Posts
0
Kudos Received
0
Solutions
09-30-2021
12:27 AM
Thanks for the answer, but it is not the solution. See my reply above.
... View more
09-30-2021
12:27 AM
Thanks for the answer, but the result is negative, I don't know why, but the UI simply do not show appropriate information. I tested it, I started 2 different sessions of Hive simultaneously and initially yes - the UI shows new running sessions of Hive properly, but then when I reproduce the error of session with "kill - 9" command the UI do not updates and keep showing that there are still 2 active sessions (truly only one left - first screen). I waited a couple minutes updating the page and then UI showed that there are no active sessions, that both are finished successfully (truly - one session is killed and one is still active and proceed queries - second screen).
... View more
09-28-2021
07:07 AM
Hello everyone. So the problem is next. I have Apache Hive 2.3.6. on my cluster. I start multiple sessions simultaneously and independently from each other. And then temporary .pipeout files with directories are created and if certain session end up with an error this empty files keep accumulating because they are not deleted if the session end up not right. The similar issue was here, but it was not solved - https://issues.apache.org/jira/browse/HIVE-6091. So the question is how can I find the list of active sessions on my cluster or how can I check whether a session is active or not by sessionId in Hive? I need this information because I want to delete those .pipeout files and in order to do that I need to know which file are still in use (belongs to active session) and which are not! Thanks!
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
-
HDFS