Created 08-24-2023 02:28 AM
I tried connecting sqoop with Hue
But got error as:
Sqoop:could not get connectors
in hue.ini
# Settings to configure Sqoop2
###########################################################################
[sqoop]
# For autocompletion, fill out the librdbms section.
# Sqoop server URL
server_url=http://192.168.2.112:16000/sqoop
# Path to configuration directory
sqoop_conf_dir=/home/hadoop/sqoop-1.4.7/conf
what is dfference between sqoop2 and sqoop
I have installed qoop1.4.7
Created 08-24-2023 03:23 AM
@nysq_sq, Welcome to our community! To help you get the best possible answer, I have tagged in our Sqoop experts @mszurap @ShankerSharma who may be able to assist you further.
Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.
Regards,
Vidya Sargur,Created 08-24-2023 06:41 AM
Hi @nysq_sq ,
Sqoop 1 is a client only solution, it submits Sqoop jobs (MR jobs) to the YARN cluster in order to import/export data from/to RDBMS databases.
See the docs:
https://sqoop.apache.org/docs/1.4.7/SqoopUserGuide.html
Sqoop 2 was an initiative to make the same functionality work as a client-server architecture, to be able to define "stored jobs", etc...
Sqoop 2 is not recommended for a long time and was discontinued long ago.
Sqoop 1 was still maintained for some time, however it is also a retired Apache project, still Cloudera supports it in CDP/CDH 7.x versions.
We would advise to use only Sqoop 1.
From Hue you can use Sqoop1 actions (without sqoop2), see
https://gethue.com/importing-data-from-traditional-databases-into-hdfshive-in-just-a-few-clicks/
Cheers,
Miklos
Created 08-24-2023 07:07 AM
Thanks for the info
i have Sqoop1.4.7 version installed in our local server 192.168.X.XXX
and hue in different server xxx.xxx.x.xxx
so in hue.ini config file
i have sqoop settings like below
###########################################################################
# Settings to configure Sqoop2
###########################################################################
[sqoop]
# For autocompletion, fill out the librdbms section.
# Sqoop server URL
##server_url=http://192.168.2.112:16000/sqoop
# Path to configuration directory
sqoop_conf_dir=/home/hadoop/sqoop-1.4.7/conf
when i make those changes and run im getting below error as
sqoop:could not get connectors