Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2186 | 06-15-2020 05:23 AM | |
| 18852 | 01-30-2020 08:04 PM | |
| 2346 | 07-07-2019 09:06 PM |
06-27-2019
12:01 PM
hi all We are using the hortonworks kits for our hadoop cluster ( HDP - 2.6.4 - HDP 3.1 ) I just wondering if any of kafka versions in HDP 2.X / 3.X must have a zookeeper servers?? Or maybe some kafka version can works without zookeeper??
... View more
Labels:
06-27-2019
08:00 AM
we have HDP version 2.6.4 in our cluster cluster include 285 data node machines and 3 kafka machines for now zookeeper servers are installed on the masters machines and zookeepers are not independent machines but since this is very important production cluster we think to separate the zookeeper from the masters machines and install the zookeeper servers on separate servers to be independent machines am I right here?
... View more
Labels:
06-27-2019
07:42 AM
hi all we download the HDP packages from HDP 2.6.4 version and we want to installed only a new 3 zookeeper servers on new machines ( without ambari ) how to exclude the zookeeper packages from the HDP 2.6.4 kit so we can install only the zookeeper servers on the new machines
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)
06-24-2019
07:31 PM
hi all can you upgrade HDP 2.6.4 to 3.1 and stay with ambari 2.6.1?
... View more
Labels:
06-16-2019
11:21 PM
@Dear KJay so finally lets summary when we set the following hive.server2.clear.dangling.scratchdir=true hive.start.cleanup.scratchdir=true and then we restart the hive service from ambari do you think this configuration will be able to delete the old folders under /tmp/hive/hive in spite the folder are a millions folders ?
... View more
06-16-2019
10:59 PM
@dear Jay - you said - "I do not think that we should do it on our own" I agree but we not have a choice because under /tmp/hive/hive we have a millions of folders and we cant delete them . so after we delete the folder from hdfs , we seen that after hive restart it create again the /tmp/hive/hive folder , do you have some advice what need to check after this brutal action ?
... View more
06-16-2019
10:48 PM
for your info - actually we already delete this folder before you post your answer , and after we restart the hive service in ambari , it create again the /tmp/hive/hive folder
... View more
06-16-2019
10:47 PM
second is it safe to delete the folder - hdfs dfs -rm -r /tmp/hive/hive
... View more
06-16-2019
10:46 PM
@dear jay - what is the meaning of hive.scratchdir.lock when is set to false?
... View more
06-16-2019
03:51 PM
from - https://stackoverflow.com/questions/44235019/delete-files-older-than-10days-on-hdfs
... View more