Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2062 | 06-15-2020 05:23 AM | |
| 17113 | 01-30-2020 08:04 PM | |
| 2225 | 07-07-2019 09:06 PM | |
| 8579 | 01-27-2018 10:17 PM | |
| 4844 | 12-31-2017 10:12 PM |
06-16-2019
11:30 PM
@dear Jay , ok our hive version is lower so we need to run the - ( from hive user ) do you think this cli will able to remove all old folders under /tmp/hive/hive ? hive --service cleardanglingscratchdir
... View more
06-16-2019
11:21 PM
@Dear KJay so finally lets summary when we set the following hive.server2.clear.dangling.scratchdir=true hive.start.cleanup.scratchdir=true and then we restart the hive service from ambari do you think this configuration will be able to delete the old folders under /tmp/hive/hive in spite the folder are a millions folders ?
... View more
06-16-2019
11:19 PM
Dear Geoffrey Shelton Okot , since this is production cluster we need to get approve to restart the HDFS and Yarn and map reduce ( as you know this settings require to restart all 3 services )
... View more
06-16-2019
11:16 PM
@ear Jay so finally lets summary when we set the following hive.server2.clear.dangling.scratchdir=true
hive.start.cleanup.scratchdir=true and then we restart the hive service from ambari do you think this configuration will be able to delete the old folders under /tmp/hive/hive in spite the folder are a millions folders ?
... View more
06-16-2019
11:11 PM
so this settings ( hive.server2.clear.dangling.scratchdir=true ) supported by the hive version - 1.2.1.2.6 ?
... View more
06-16-2019
11:05 PM
by the way in ambari hive version is - 1.2.1.2.6
... View more
06-16-2019
11:01 PM
@dear Jay ok but what are the values that need to set for both parameters?
... View more
06-16-2019
10:59 PM
@dear Jay - you said - "I do not think that we should do it on our own" I agree but we not have a choice because under /tmp/hive/hive we have a millions of folders and we cant delete them . so after we delete the folder from hdfs , we seen that after hive restart it create again the /tmp/hive/hive folder , do you have some advice what need to check after this brutal action ?
... View more
06-16-2019
10:53 PM
@dear jay ( hive.server2.clear.dangling.scratchdir and hive.start.cleanup.scratchdir ) are not configured in ambari from HIVE --> CONFIG , do you recommended to add them? , if yes then under advanced on which section we need to add them and what is the value for both parameters?
... View more
06-16-2019
10:48 PM
for your info - actually we already delete this folder before you post your answer , and after we restart the hive service in ambari , it create again the /tmp/hive/hive folder
... View more