Member since
04-13-2018
4
Posts
0
Kudos Received
0
Solutions
12-11-2018
05:30 PM
Hi, I am trying to run sqoop list job for a Azure Sql database but getting login failed error. SQL database in question is using Active Directory Password Authentication but unable to find out how to put this parameter in sqoop jdbc command, Can you please help me out, I have used IntegratedSecurity = true but get an error saying this SQL driver is not configured for Integrated Security. Below is the sqoop command in which I want AD authentication parameter to be placed sqoop list-tables --connect 'jdbc:sqlserver://xxxx:1433;database=xxx' --username "xxx@xx.com" --password 'xxx' --driver com.microsoft.sqlserver.jdbc.SQLServerDriver --connection-manager org.apache.sqoop.manager.SQLServerManager ERROR manager.CatalogQueryManager: Failed to list tables
com.microsoft.sqlserver.jdbc.SQLServerException: Cannot open server "xxx.com" requested by the login. The login failed. ClientConnectionId:xxxx
... View more
Labels:
- Labels:
-
Apache Sqoop
05-10-2018
06:21 PM
I am creating a DAG in Json format and ingesting data to hive and then to impala. I can't use SQL statement or --query option as my framework doesn't support it.I am using Airflow to run these jobs. PS:I am able to run this using Select statement in sqooo command when running manually not in airflow.As said my framework for Airflow doesnt support query so looking for any other alternatives like using '' or ``
... View more
05-10-2018
03:15 PM
I am trying to ingest data from progress datasource and I have few fields with names like Sales-uk due to hyphen sqoop is throwing me an error It seems like you are looking up a column that does not [2018-05-10 15:05:09,149] {base_task_runner.py:95} INFO - Subtask: [2018-05-10 15:05:09,148] {sqoop_hook.py:101} INFO - 18/05/10 15:05:09 ERROR util.SqlTypeMap: exist in the table. Please ensure that you've specified
[2018-05-10 15:05:09,149] {base_task_runner.py:95} INFO - Subtask: [2018-05-10 15:05:09,148] {sqoop_hook.py:101} INFO - 18/05/10 15:05:09 ERROR util.SqlTypeMap: correct column names in Sqoop options.
[2018-05-10 15:05:09,149] {base_task_runner.py:95} INFO - Subtask: [2018-05-10 15:05:09,148] {sqoop_hook.py:101} INFO - 18/05/10 15:05:09 ERROR tool.ImportTool: Import failed: column not found: `notes-id`
I can do this through query option but my framework doesn't allow me to use query function in sqoop, can you please suggest is there any other way around this please?
... View more
Labels:
- Labels:
-
Apache Sqoop