Member since
08-08-2017
1652
Posts
30
Kudos Received
11
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1923 | 06-15-2020 05:23 AM | |
| 15495 | 01-30-2020 08:04 PM | |
| 2076 | 07-07-2019 09:06 PM | |
| 8122 | 01-27-2018 10:17 PM | |
| 4575 | 12-31-2017 10:12 PM |
01-12-2020
11:24 AM
since metrics take space on the local disk ,
we want to move to distributed mode , so metrics data will be on HDFS and not on local disk
we start to work according to the link - https://cwiki.apache.org/confluence/display/AMBARI/AMS+-+distributed+mode
we are using ambari cluster 2.6.4 with active/stand by name node
so we start the configuration
first we set in ambari the following
ams-site, Set timeline.metrics.service.operation.mode = distributed
now we need to Edit ams-hbase-site,
hdfs://<nameservice-id>/user/ams/hbase
the question is - how to find the nameservice-id ?
since we have active/stand by name node
then how to know the - nameservice-id value?
... View more
Labels:
- Labels:
-
Apache Ambari
12-07-2019
12:19 PM
hi all
we have 5 kafka brokers
we can stop or start the kafka service by API
but how to stop specific kafka broker by REST API?
for example , in this pic we can see 5 kafka brokers , and we want to stop/start only the second kafka broker by REST API
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Kafka
12-03-2019
12:24 PM
Dear Jay so from your example , I understand that we need to capture the - "state" from the output for each kafka broker , while expected output should be OK am I right until now?
... View more
12-03-2019
04:48 AM
hi all
we want to identify kafka alert from ambari by rest api
Example when we get alert
what is the AMBARI REST API in order to verify alert on kafka broker01 or kafka broker02 , etc
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Kafka
12-02-2019
02:48 AM
yes we get the following: cat /etc/group | grep -i hadoop hadoop:x:1006:hive,livy,zookeeper,spark,ams,kafka,yarn,hcat,mapred cat /etc/group | grep -i airflow hdfs:x:1005:hdfs,hive,airflow airflow:x:1016: cat /etc/group | grep -i hdfs hdfs:x:1005:hdfs,hive,airflow let me know if you need additional info?
... View more
12-02-2019
02:09 AM
so when we do hdfs dfs -ls -R / | grep "airflow " | awk '{print $1" "$2" "$3" "$4" "}' we get: drwxrwx--- - airflow hadoop drwxrwx--- - airflow hadoop drwxrwx--- - airflow hadoop -rw-r----- 3 airflow hadoop -rw-r----- 3 airflow hadoop -rw-r----- 3 airflow hadoop drwxrwx--- - airflow hadoop -rw-r----- 3 airflow hadoop -rw-r----- 3 airflow hadoop -rw-r----- 3 airflow hadoop . . . . do you means to change every hadoop group to hdfs ? or in simple words - how to know the HDFS path , that we need to change?
... View more
12-02-2019
12:57 AM
ok , we meed to find the path's for the changing
... View more
12-02-2019
12:51 AM
we got the following , because missing PATH $ hdfs dfs -chown airflow:hdfs -chown: Not enough arguments: expected 2 but got 1 Usage: hadoop fs [generic options]
... View more
12-02-2019
12:17 AM
Dear Shelton do you mean : grep airflow /etc/passwd airflow:x:1016:1016::/home/airflow:/sbin/nologin # id 1016 uid=1016(airflow) gid=1016(airflow) groups=1016(airflow),1005(hdfs) so we need to perform : $ hdfs dfs -chown airflow:1016 ?
... View more
12-02-2019
12:10 AM
how to found the airflow_group ?
... View more