Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1964 | 06-15-2020 05:23 AM | |
| 15987 | 01-30-2020 08:04 PM | |
| 2104 | 07-07-2019 09:06 PM | |
| 8220 | 01-27-2018 10:17 PM | |
| 4661 | 12-31-2017 10:12 PM |
02-19-2018
12:27 PM
ok I will add it but what is the value according to the cluster size ? , I mean the doc talk about to set this parameters in case we need to upgrade very large cluster system , so in that case what is the defintion of large cluster? - 10 workers? 20 workers 50 workers , and what is the value regarding that ?
... View more
02-19-2018
12:12 PM
I am not sure about this parameter , but what we need is the parameter from the doc - https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.3/bk_ambari-upgrade/content/preparing_to_upgrade_ambari_and_hdp.html the parameter that called - Ambari’s NameNode restart timeout parameter , if you think the doc talk about the parameter - upgrade.parameter.nn-restart.timeout then just confirm that so we can continue
... View more
02-19-2018
11:52 AM
we intend to perform ambari upgrade to 2.6.1 so we read the hortonworks doc - https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.3/bk_ambari-upgrade/content/preparing_to_upgrade_ambari_and_hdp.html and about the: ( from the doc ) For Large Clusters "In a large cluster, starting the NameNode can take a long time. To ensure the Ambari requests to start the NameNode do not timeout during the upgrade, you should configure Ambari’s NameNode restart timeout parameter. To do this, add ten percent to the normal amount of time in seconds it takes to start your NameNode when restarted. That value should be used to set the upgrade.parameter.nn-restart.timeout in /etc/ambari-server/conf/ambari.properties on the Ambari Server host. Then, restart Ambari Server before beginning the upgrade." we try to find the "ambari’s NameNode restart timeout parameter from the file: /etc/ambari-server/conf/ambari.properties ( on ambari server machine ) but this parameters isn't exists first question - what is the exactly name of this parameters? second question - what is the amount of the workers in the cluster to set this parameters in the - ambari.properties ? grep timeout /etc/ambari-server/conf/ambari.properties
agent.package.install.task.timeout=1800
agent.task.timeout=900
server.http.session.inactive_timeout=1800
server.task.timeout=1200
user.inactivity.timeout.default=0
user.inactivity.timeout.role.readonly.default=0
views.ambari.request.connect.timeout.millis=30000
views.ambari.request.read.timeout.millis=45000
views.request.connect.timeout.millis=5000
views.request.read.timeout.millis=10000
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
02-19-2018
11:13 AM
@Jay , its working now after I set the file under the root home and not postgres home
... View more
02-19-2018
09:51 AM
@Jay we set the file - /var/lib/pgsql/.pgpass but still command - insist to get password - pg_dump -U ambari -f ambari.sql so where I am wrong ? file - /var/lib/pgsql/.pgpass localhost:5432:postgres:ambari:bigdata
... View more
02-18-2018
10:57 AM
what should be the port name number ? and the hostname ( I guess the hostname of master02 because PG installed on it )
... View more
02-18-2018
10:50 AM
how to capture the id request number from API ? for example we stop the service - AMBARI_METRICS and we get the id - 128 from output , so we can use grep to capture the id , but we prefer other elegant way , curl -u admin:admin -i -H 'X-Requested-By: ambari' -X PUT -d '{"RequestInfo": {"context" :"Stop AMBARI_METRICS via REST"}, "Body": {"ServiceInfo": {"state": "INSTALLED"}}}' http://localhost:8080/api/v1/clusters/sys15626/services/AMBARI_METRICS
HTTP/1.1 202 Accepted
X-Frame-Options: DENY
X-XSS-Protection: 1; mode=block
X-Content-Type-Options: nosniff
Cache-Control: no-store
Pragma: no-cache
Set-Cookie: AMBARISESSIONID=19rvqn2cgzwb51sfevywdfvwm7;Path=/;HttpOnly
Expires: Thu, 01 Jan 1970 00:00:00 GMT
User: admin
Content-Type: text/plain
Vary: Accept-Encoding, User-Agent
Content-Length: 137
Server: Jetty(8.1.19.v20160209)
{
"href" : "http://localhost:8080/api/v1/clusters/sys15626/requests/128",
"Requests" : {
"id" : 128,
"status" : "Accepted"
}
... View more
Labels:
- Labels:
-
Apache Ambari
02-18-2018
09:54 AM
how to create ambari database backup without enter password? we want to create the backup in bash script , so need to automate the CLI ( CLI must be in silent mode ) pg_dump -U {ambari.db.username} -f ambari.sql
Password: {ambari.db.password}
... View more
Labels:
- Labels:
-
Apache Ambari
02-09-2018
02:44 PM
from the output I see that hdfs dfs -du -h /
398.2 M /app-logs
7.5 M /apps
3.5 M /ats
695.6 M /hdp
0 /mapred
0 /mr-history
53.1 G /spark2-history
0 /tmp
516.3 M /user
is it possible to delete the spark history from CLI , if not how to delete the spark history from ambari GUI?
... View more