Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2729 | 04-27-2020 03:48 AM | |
| 5287 | 04-26-2020 06:18 PM | |
| 4458 | 04-26-2020 06:05 PM | |
| 3584 | 04-13-2020 08:53 PM | |
| 5383 | 03-31-2020 02:10 AM |
03-15-2018
09:08 PM
@Dmitro Vasilenko You will need to check the "/etc/ambari-server/conf/ambari.properties" to know which Postrgres instance it is connecting to? And also it is also possible that a user can use the database name other than "ambari" so the following grep command will help in knowing that ambari server is setup to connect to which DB and what is the database name & DB Host. # grep 'jdbc' /etc/ambari-server/conf/ambari.properties . In case of Embedded Postgres Mode the ambari server creates the DB and the tables on it's own when we run the "ambari-server setup" command. But in case of non default Database we need to manually create the tables as described in. https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-administration/content/ch_amb_ref_using_existing_databases.html
... View more
03-15-2018
08:45 PM
@Aymen Rahal The default Mysql Port 3306 is a TCP/IP port (non http). So you can not connect to it via Http. If you want to remotely connect to MySQL DB and want to run some queries then youi will need to install "mysql-clients" (Or use some third party tools like DBVisualizer / JDBC code ..etc) on your local machine and then using the following format you will be able to connect to it. # mysql --host=remote.example.com --port=3306 -u root -p . For more details on this please refer to MySQL standard documentation: https://dev.mysql.com/doc/refman/5.6/en/connecting.html
... View more
03-15-2018
12:12 PM
@Dmitro Vasilenko Most of the configuration version related info and changes (config history) are maintained inside the Ambari DB. For example some of the tables like "clusterconfig" contains the various config informations like core-site / hdfs-site type informations. Similarly another inportant table is "hostcomponentdesiredstate" which contains the state information about various components like NAMENODE/DATANODE ..ect on The "servicecomponentdesiredstate" is another important table which shows all the components/Services installed on cluster and their desired state.
... View more
03-15-2018
11:20 AM
1 Kudo
@Sana Faraz For Sandbox Kafka learning the following tutorial can be a good start point. Just replace all "hdf" words with "hdp" in that article if you are using HDP sandbox. https://hortonworks.com/tutorial/kafka-in-trucking-iot-on-hdf/section/2/ https://hortonworks.com/tutorial/kafka-in-trucking-iot-on-hdf/section/3/ . Some more examples like Using Kafka Manager: https://community.hortonworks.com/articles/44038/using-kafka-manager-with-hdp-25-sandbox-kafka.html Kafka Storm integration for realtime processing: https://hortonworks.com/tutorial/realtime-event-processing-in-hadoop-with-nifi-kafka-and-storm/
... View more
03-15-2018
10:21 AM
@Michael Bronson Yes we can set individual properties as well like following: # /var/lib/ambari-server/resources/scripts/configs.py --user=admin --password=admin --port=8080 --action=set --host=localhost --cluster=Sandbox --config-type=yarn-site -k "yarn.timeline-service.recovery.enabled" -v "true" .
... View more
03-15-2018
09:37 AM
@Michael Bronson Here is another example in which we are setting a property in cluster-env. Notice "-k" means Key and "-v" for value. Following command will set the Auto Start for Cluster services to true. # /var/lib/ambari-server/resources/scripts/configs.py --user=admin --password=admin --port=8080 --action=set --host=localhost --cluster=Sandbox --config-type=cluster-env -k "recovery_enabled" -v "true" .
... View more
03-15-2018
09:33 AM
2 Kudos
@Michael Bronson Here is a simple example of config.py: # /var/lib/ambari-server/resources/scripts/configs.py --user=admin --password=admin --port=8080 --action=get --host=localhost --cluster=Sandbox --config-type=yarn-site
... View more
03-15-2018
02:06 AM
@Arathy Bhuvaragavamurthy This error "VERR_VD_VMDK_INVALID_HEADER" indicates that your downloaded Sandbox image in corrupted. So please check the MD5sum result of the image from the Hortonworks site to verify if the MD5sum results are same or not? https://hortonworks.com/downloads/#sandbox (here you will find the MD5 of different downloaders so after download completes then please check if the downloaded file MD5 is same as mentioned in the mentioned link or not?) If not then please try downloading the image again. Also please refer to: https://community.hortonworks.com/questions/27067/vd-error-verr-vd-vmdk-invalid-header-opening-image.html
... View more
03-14-2018
11:16 AM
1 Kudo
@Michael Bronson In the other thread : https://community.hortonworks.com/questions/176682/api-via-script-how-to-verify-zkfailovercontroller.html?childToView=176685#answer-176685 If you just replace the ZKFC with JOURNALNODE then you should be able to find the same. # curl -u admin:admin -H "X-Requested-By: ambari" -X GET "http://amb25101.example.com:8080/api/v1/clusters/plain_ambari/components?fields=ServiceComponentInfo/service_name,ServiceComponentInfo/component_name,ServiceComponentInfo/state,host_components/HostRoles/host_name,host_components/HostRoles/state" | grep -A 2 "\"component_name\" \: \"JOURNALNODE\"" | awk '{print $NF}' > /tmp/requests_details.txt; sed -e '1,2d' -e s'/--//g' -e 's/\n//g' -e 's/"//g' -e '/^$/d' /tmp/requests_details.txt | awk 'NR%3{printf "%s ",$0;next;}1' . Example Output: STARTED JOURNALNODE, amb25101.example.com,
STARTED JOURNALNODE, amb25102.example.com,
STARTED JOURNALNODE, amb25103.example.com, .
... View more
03-14-2018
11:13 AM
1 Kudo
@Michael Bronson You can try something like following: # curl -u admin:admin -H "X-Requested-By: ambari" -X GET "http://amb25101.example.com:8080/api/v1/clusters/plain_ambari/components?fields=ServiceComponentInfo/service_name,ServiceComponentInfo/component_name,ServiceComponentInfo/state,host_components/HostRoles/host_name,host_components/HostRoles/state" | grep -A 2 "\"component_name\" \: \"ZKFC\"" | awk '{print $NF}' > /tmp/requests_details.txt; sed -e '1,2d' -e s'/--//g' -e 's/\n//g' -e 's/"//g' -e '/^$/d' /tmp/requests_details.txt | awk 'NR%3{printf "%s ",$0;next;}1' . Example Output: STARTED ZKFC, amb25102.example.com,
STARTED ZKFC, amb25103.example.com,
... View more