Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2452 | 04-27-2020 03:48 AM | |
4890 | 04-26-2020 06:18 PM | |
3977 | 04-26-2020 06:05 PM | |
3221 | 04-13-2020 08:53 PM | |
4928 | 03-31-2020 02:10 AM |
03-09-2017
10:24 AM
@Inam Ur Rehman Your latest query is not very clear to me. Can you please elaborate more. If you want to access the DB schema of a remote mysql DB in your local mysql then one option will be to export the DB dump of the remote DB and then import the DB dump to your local machine. Example: importing DB dump: mysql -u ambari -pbigdata ambari < ambari_mydb_current.sql
Here assuming that the DB username is "ambari" and password is "bigdata" and the database name is 'ambari" which may be different in your case.
Example: Exporting DB dump: mysqldump ambari > /tmp/mydir/ambari_mydb_current.sql .
... View more
03-09-2017
08:06 AM
@Jacqualin jasmin Are you looking out for the 'ranger' database table 'x_portal_user' As per : https://cwiki.apache.org/confluence/display/RANGER/Ranger+0.5.0+Database+Schema This table contains user profile and credentials of Ranger Admin users.
It also contains users synced from external sources but credentials are
not stored and password field contains garbage value. Important
attributes of this table are login_id, password, email, status and
user_src. 'user_src' field value ‘0’ represents internal user while ‘1’
represents external user. External users are users synced from external
sources i.e (UNIX / LDAP / AD). .
... View more
03-09-2017
06:31 AM
1 Kudo
@Sanaz Janbakhsh It depends on various factors like the kind of components that you are planning to use, the kind of job and the amount of data that you are planning to process, size of cluster ...etc. 1. But in general you can refer to the following doc to get a good idea (Cluster Planning): http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/ch_hardware-recommendations_chapter.html 2. Similarly for Slave/Master recommendations: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_cluster-planning/content/hardware-for-slave.1.html 3. Also you can get some idea about the Memory requirement for NameNode based on the number of files: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_command-line-installation/content/ref-80953924-1cbf-4655-9953-1e744290a6c3.1.html 4. You can also use the HDP utility script which is the recommended method for calculating HDP memory configuration settings: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_command-line-installation/content/determine-hdp-memory-config.html
... View more
03-09-2017
05:12 AM
@ashfaq ahamed Also please refer to the following article to know How to dynamically Add Hosts to a Cluster with Blueprints ? https://community.hortonworks.com/articles/1333/dynamically-adding-hosts-to-an-existing-cluster-wi.html The Blueprints are not only useful to "initially" provision a cluster but they are also quite helpful to extend the existing cluster as well.
... View more
03-09-2017
05:05 AM
@ashfaq ahamed If your cluster is already deployed and ready then you can use the ambari to add a new host as following:
following: https://hortonworks.com/hadoop-tutorial/using-apache-ambari-add-new-nodes-existing-cluster/ Once the host is added then you can deploy the desired service components/clients to that host. But if you want to add a new host only using the Ambari APIs then you can refer to : https://cwiki.apache.org/confluence/display/AMBARI/Add+a+host+and+deploy+components+using+APIs
... View more
03-09-2017
03:13 AM
@Harold Allen Badilla
If you do not see the host where you wanted to run the 'sqoop client' in the list then you can install it as following:
Login to ambari UI --> "Hosts" (Tab Top Bar) click
- In the list of Host please click on the 'host' (name link) where you want to install the 'sqoop client' - Now On the Host summary page (where you see all the components installed on that host) click on the "Installed" drop down menu and select "Install Clients" . If the host is not at all present as part of the cluster then you can add that host to your cluster as following:
https://hortonworks.com/hadoop-tutorial/using-apache-ambari-add-new-nodes-existing-cluster/
... View more
03-09-2017
03:07 AM
@Harold Allen Badilla
From your screenshot we see that sqoop client is installed on 3 Hosts in your HDP cluster. So when you click on the "Sqoop Client" link then you should be able to find the 3 hosts (table) that has the sqoop client installed. Please check if the host where you are trying to run the sqoop is included in the list or not?
... View more
03-09-2017
02:46 AM
@Harold Allen Badilla Do you have sqoop client installed on this host? # rpm -qa | grep sqoop*
sqoop_2_5_0_0_1245-1.4.6.2.5.0.0-1245.el6.noarch
. You can also find this from ambari UI, to see if sqoop is installed on the mentioned host (if not then you can instal it via ambari as well) Login to ambari UI --> "Sqoop" (Left Panel) --> Summary --> Click on "Sqoop Client"
.
In order to manually install "sqoop" on HDP platform you can refer to: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_command-line-installation/content/install_sqoop_rpms.html
... View more
03-08-2017
12:02 PM
@Surya Rao Although It is strongly recommended to not change hostname/IPAddress of HDP cluster nodes. Hortonworks support / engineering assistance might be needed in such scenario as it might impact the whole cluster. . You also might want to refer to the following article: https://community.hortonworks.com/content/supportkb/48815/how-to-change-ip-address-for-a-datanode.html
... View more
03-08-2017
11:45 AM
1 Kudo
@Surya Rao FQDN is recommended for reasons like changing IP in the environment does
not require any changes in the cluster or users does not need to have
local /etc/hosts in their env to reach the cluster. From ambari side although you can change the hostnames as mentioned in : https://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.18/bk_ambari-reference/content/ch_changing_host_names.html ambari-server update-host-names host_names_changes.json .
... View more