Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 08-24-2023 02:28 AM
I tried connecting sqoop with Hue
But got error as:
Sqoop:could not get connectors
in hue.ini
# Settings to configure Sqoop2
###########################################################################
[sqoop]
# For autocompletion, fill out the librdbms section.
# Sqoop server URL
server_url=http://192.168.2.112:16000/sqoop
# Path to configuration directory
sqoop_conf_dir=/home/hadoop/sqoop-1.4.7/conf
what is dfference between sqoop2 and sqoop
I have installed qoop1.4.7
Created 08-24-2023 03:23 AM
@nysq_sq, Welcome to our community! To help you get the best possible answer, I have tagged in our Sqoop experts @mszurap @ShankerSharma who may be able to assist you further.
Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.
Regards,
Vidya Sargur,Created 08-24-2023 06:41 AM
Hi @nysq_sq ,
Sqoop 1 is a client only solution, it submits Sqoop jobs (MR jobs) to the YARN cluster in order to import/export data from/to RDBMS databases.
See the docs:
https://sqoop.apache.org/docs/1.4.7/SqoopUserGuide.html
Sqoop 2 was an initiative to make the same functionality work as a client-server architecture, to be able to define "stored jobs", etc...
Sqoop 2 is not recommended for a long time and was discontinued long ago.
Sqoop 1 was still maintained for some time, however it is also a retired Apache project, still Cloudera supports it in CDP/CDH 7.x versions.
We would advise to use only Sqoop 1.
From Hue you can use Sqoop1 actions (without sqoop2), see
https://gethue.com/importing-data-from-traditional-databases-into-hdfshive-in-just-a-few-clicks/
Cheers,
Miklos
Created 08-24-2023 07:07 AM
Thanks for the info
i have Sqoop1.4.7 version installed in our local server 192.168.X.XXX
and hue in different server xxx.xxx.x.xxx
so in hue.ini config file
i have sqoop settings like below
###########################################################################
# Settings to configure Sqoop2
###########################################################################
[sqoop]
# For autocompletion, fill out the librdbms section.
# Sqoop server URL
##server_url=http://192.168.2.112:16000/sqoop
# Path to configuration directory
sqoop_conf_dir=/home/hadoop/sqoop-1.4.7/conf
when i make those changes and run im getting below error as
sqoop:could not get connectors