Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2093 | 06-15-2020 05:23 AM | |
| 17451 | 01-30-2020 08:04 PM | |
| 2256 | 07-07-2019 09:06 PM | |
| 8727 | 01-27-2018 10:17 PM | |
| 4914 | 12-31-2017 10:12 PM |
08-08-2018
05:20 PM
I set that under Custom mapred-site: and I restart the service
... View more
08-08-2018
03:16 PM
capture.pngunder the following mapred folder /var/log/hadoop-mapreduce/mapred we have the following log files [root@master mapred]# du -sh *20M
mapred-mapred-historyserver-master.sys64.com.log257M
mapred-mapred-historyserver-master.sys64.com.log.1257M
mapred-mapred-historyserver-master.sys64.com.log.2257M
mapred-mapred-historyserver-master.sys64.com.log.3257M
mapred-mapred-historyserver-master.sys64.com.log.4257M
mapred-mapred-historyserver-master.sys64.com.log.5257M
mapred-mapred-historyserver-master.sys64.com.log.64.0K
mapred-mapred-historyserver-master.sys64.com.out4.0K
mapred-mapred-historyserver-master.sys64.com.out.14.0K
mapred-mapred-historyserver-master.sys64.com.out.24.0K
mapred-mapred-historyserver-master.sys64.com.out.34.0K
mapred-mapred-historyserver-master.sys64.com.out.44.0K
mapred-mapred-historyserver-master.sys64.com.out.5
<br> which is the log4j configuration that need update so each
file will not be greater than 100M and maxbackup file will not more then 3
files we search in the service Mapreduce2 --> configuration but we not found any log4j file , is it logical ?
... View more
Labels:
08-07-2018
10:17 PM
Until now the latest HDP version is 2.6.5 version according to hortonworks documentation, we want to know what is the next coming HDP version , and what is the target date for this release ? Second about HDP version 2.6.5 , what are the benefits of 2.6.5 version on the previous - 2.6.4 are the diffrences are major differences?
... View more
Labels:
08-01-2018
08:03 AM
@Akhil thank you so much its works very cool , Another question regarding the configs.py lets say we want to add anew line as YARN_TEST=TEST in yarn-env template ( under Advanced yarn-env ) YARN_TEST=TEST
... View more
07-31-2018
03:24 PM
we have ambari cluster version 2.6.1 with HDP version - 2.6.4 I want to add by API those properties Ambari dasboard.--> YARN
--> Configs-->Advanced-->Customer yarn-site --> Click on "Add
Property" yarn.nodemanager.localizer.cache.target-size-mb
= 10240 yarn.nodemanager.localizer.cache.cleanup.interval-ms
= 300000 so both parameters will be in Customer yarn-site please advice how to do this task with REST API?
... View more
Labels:
07-31-2018
02:22 PM
@Jordan Moore what are the risks if we still use only 3 zookeeper servers with 17 kafka machines ?
... View more
07-25-2018
07:37 PM
so just to summary what you said do you mean that we need min 5 zookeeper server for 17 kafka machines ? or in other words how many zookeeper you suggest for the following cluster nodes: master machines - 3 kafka machines - 17 worker machines - 160
... View more
07-25-2018
04:35 PM
we hear that kafka should be an odd number to avoid split-brain scenarios! but can we get more info about this ? why kafka should be odd number? we want to create the following ambari cluster based on HDP version 2.6.5 master machines - 3 kafka machines - 17 worker machines - 160
... View more
Labels:
07-15-2018
03:34 PM
@Geoffrey , any suggestion how to ciontinue from this point ?
... View more
07-15-2018
12:20 PM
@Geoffrey yes I already removed it , and the error is exactly the same error as we already seen ,
... View more