Cloudera Community
prashant_redd
user rank
Explorer

Re: Connecting to netezza using sqoop, external ta...

by Explorer in Support Questions
‎05-13-2019 03:13 PM
‎05-13-2019 03:13 PM
Geoffrey, I tried the sqoop command you have provided for creating the hive table, still facing the same issue. HDFS out directory gets created, Getting a syntax error for creating the external table on NZ, but the mapper didn't fail Last log message of the mapper Sqoop job still showing as progressing. The sqoop version I am using is Sqoop 1.4.6.2.6.4.0-91 ... View more

Re: Connecting to netezza using sqoop, external ta...

by Explorer in Support Questions
‎05-13-2019 01:17 PM
‎05-13-2019 01:17 PM
Thanks @Geoffrey Shelton Okot for looking at my post, below is the sqoop command which I have used, there is a syntax error in the where clause to fail the sqoop command. Target directory got created, and the command ran for 17 hrs without failing even after the mapper showed it failed while creating netezza external table. sqoop-import \ -D mapreduce.job.queuename=XDL \ -D mapreduce.task.timeout=60000 \ --verbose \ --connect jdbc:netezza://server/db \ --username username \ --password ***** \ --table table_name \ --where " a(SUBSTR(src_file_nm,23,8)like'20190104%')" \ --target-dir /data/xdl/dev/HIVE_SCHEMA/tgt.db/table_name_20190509 \ --fields-terminated-by '\b' \ --num-mappers 8 \ --null-string '\\N' \ --null-non-string '\\N' \ --outdir /xdl_code/dev/LAND/CDR/TEMP \ --split-by fw_rec_nbr \ --direct ... View more

Re: Connecting to netezza using sqoop, external ta...

by Explorer in Support Questions
‎05-10-2019 06:36 PM
‎05-10-2019 06:36 PM
@Geoffrey Shelton Okot ... View more

Re: Connecting to netezza using sqoop, external ta...

by Explorer in Support Questions
‎05-10-2019 06:26 PM
‎05-10-2019 06:26 PM
@Sindhu; @Vinicius Higa Murakami ... View more

Connecting to netezza using sqoop, external table ...

by Explorer in Support Questions
‎05-10-2019 03:45 PM
‎05-10-2019 03:45 PM
We are pulling data from a Netezza database to hive using sqoop direct option, we are providing a custom SQL it has a syntax error which makes the mapper fail, but the sqoop command doesn't fail. 2019-05-09 18:17:05,175 ERROR [Thread-17] org.apache.sqoop.mapreduce.db.netezza.NetezzaJDBCStatementRunner: Unable to execute external table export org.netezza.error.NzSQLException: ERROR: Function 'A(BOOL)' does not exist     Unable to identify a function that satisfies the given argument types     You may need to add explicit typecasts     at org.netezza.internal.QueryExecutor.getNextResult(QueryExecutor.java:280)     at org.netezza.internal.QueryExecutor.execute(QueryExecutor.java:76)     at org.netezza.sql.NzConnection.execute(NzConnection.java:2740)     at org.netezza.sql.NzStatement._execute(NzStatement.java:849)     at org.netezza.sql.NzPreparedStatament.execute(NzPreparedStatament.java:155)     at org.apache.sqoop.mapreduce.db.netezza.NetezzaJDBCStatementRunner.run(NetezzaJDBCStatementRunner.java:75) 19/05/09 18:17:25 INFO mapreduce.Job: Job job_1557423660592_0171 running in uber mode : false 19/05/09 18:17:25 INFO mapreduce.Job: map 0% reduce 0% 19/05/09 18:17:38 INFO mapreduce.Job: map 25% reduce 0% 19/05/09 18:17:39 INFO mapreduce.Job: map 100% reduce 0% if I provide --driver org.netezza.Driver option for sqoop command, sqoop fails when it encounters above error, but doesnt use direct method for data import for successful runs. Please help. ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎08-27-2019 04:01 PM
Community Statistics
Member Since ‎05-09-2019 06:59 PM
Last Visited ‎08-27-2019 04:01 PM
Posts 5