I dont know much about this please help me.
Im going to get data from RDMS to HDFS using Sqoop. i got the commands that i need to do this, But after putting those commands on Putty. It doesn't recognize at all. Is there anything that i need to do first before i can put some command of sqoop on putty ? or is there another command shell for hadoop?
Thank you in advance!
Do you have sqoop client installed on this host?
# rpm -qa | grep sqoop* sqoop_2_5_0_0_1245-126.96.36.199.5.0.0-1245.el6.noarch
You can also find this from ambari UI, to see if sqoop is installed on the mentioned host (if not then you can instal it via ambari as well)
Login to ambari UI --> "Sqoop" (Left Panel) --> Summary --> Click on "Sqoop Client"
In order to manually install "sqoop" on HDP platform you can refer to: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_command-line-installation/content/instal...
From your screenshot we see that sqoop client is installed on 3 Hosts in your HDP cluster. So when you click on the "Sqoop Client" link then you should be able to find the 3 hosts (table) that has the sqoop client installed.
Hi @Jay SenSharma,
I found out that its not listed on the sqoop client, Thanks for the help. but now my user dont have access on the other nodes.. I will post my updates once the user created. Thank you!
@Harold Allen Badilla If you do not see the host where you wanted to run the 'sqoop client' in the list then you can install it as following: Login to ambari UI --> "Hosts" (Tab Top Bar) click
- In the list of Host please click on the 'host' (name link) where you want to install the 'sqoop client'
- Now On the Host summary page (where you see all the components installed on that host) click on the "Installed" drop down menu and select "Install Clients"
If the host is not at all present as part of the cluster then you can add that host to your cluster as following: https://hortonworks.com/hadoop-tutorial/using-apache-ambari-add-new-nodes-existing-cluster/
Place the microsofy MSSQL JDBC driver inside the "/usr/hdp/current/sqoop-client/lib/" then try again.
cp -f sqljdbc4.jar /usr/hdp/current/sqoop-client/lib/
You can download the MSSQL server Jdbc driver from the following link based on your MySQL database version.
It is better to place only one jar of the same type in the lib.. else if there is a bug assicoated with any particular version of the JAR then it will require further debugging to know the buggy class was loaded from jar1 or jar2. So i will suggest you to remove one duplicate jar from the lib.
i successfully moved the sqljdbc42.jar here : /usr/hdp/current/sqoop-client/lib/
what else should i do after i moved the jar file? i try again another import command but somethings wrong again.