sqoop export with hdp teradata connector error

nelsonarasu — Tue, 15 Mar 2016 04:25:55 GMT

Trying to export the data from hdfs to teradata and got below error .

2016-03-14 17:18:09,688 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1454014691973_216609_000001

2016-03-14 17:18:10,010 FATAL [main] org.apache.hadoop.conf.Configuration: error parsing conf job.xml
org.xml.sax.SAXParseException; systemId: file://temp/yarn/local/usercache/*****/appcache/application_1454014691973_216609/container_e14_1454014691973_216609_01_000001/job.xml; lineNumber: 90; columnNumber: 62; Character reference "�" is an invalid XML character.
	at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
	at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
	at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
	at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480)
	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2549)
	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2502)
	at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405)
	at org.apache.hadoop.conf.Configuration.get(Configuration.java:1232)
	at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.initialize(MRWebAppUtil.java:51)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1482)
2016-03-14 17:18:10,012 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.lang.RuntimeException: org.xml.sax.SAXParseException; systemId: file:///temp/yarn/local/usercache/****/appcache/application_1454014691973_216609/container_e14_1454014691973_216609_01_000001/job.xml; lineNumber: 90; columnNumber: 62; Character reference "�" is an invalid XML character.
	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2645)
	at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2502)
	at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405)
	at org.apache.hadoop.conf.Configuration.get(Configuration.java:1232)
	at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.initialize(MRWebAppUtil.java:51)
	at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1482)
Caused by: org.xml.sax.SAXParseException; systemId: file:///apps/opt/data07/hadoop/yarn/local/usercache/rajenne/appcache/application_1454014691973_216609/container_e14_1454014691973_216609_01_000001/job.xml; lineNumber: 90; columnNumber: 62; Character reference "�" is an invalid XML character.
	at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
	at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
	at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
	at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480)
	at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2549)
	... 5 more
2016-03-14 17:18:10,014 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting with status 1

Re: sqoop export with hdp teradata connector error

aervits — Wed, 16 Mar 2016 05:56:59 GMT

Are you exporting xml? It looks like a syntax issue. Please post the command. Check the field #62, do you have an emty field? You may need to escape it or convert to null. https://community.hortonworks.com/questions/10848/sqoop-export-to-teradata-issue-exporting-n-instead.html

Re: sqoop export with hdp teradata connector error

nelsonarasu — Wed, 16 Mar 2016 08:45:45 GMT

Find the below command to export the text data from HDFS to teradata .

sqoop export -Dmapred.job.queue.name=xxxxx --connect jdbc:teradata://xxxxxx/Database=xxxxxx --connection-manager org.apache.sqoop.teradata.TeradataConnManager --username xxxxxx --password xxxxxx --table xxxxxx_teradata_table_name --export-dir /hdfs_data_path/insert_dt=2016-03-01 --input-null-string '\\N' --input-null-non-string '\\N'

I tried with --input-null-string '\\N' --input-null-non-string '\\N' and got same exception. It is looks like some version mismatch issue .

find below version details .:

hdp teradata version : 1.4.1

hdp version : 2.3.4

Re: sqoop export with hdp teradata connector error

nelsonarasu — Wed, 06 Apr 2016 22:50:03 GMT

It is working fine after removing duplicate hdp teradata connector jar file from sqoop lib location .

question Re: sqoop export with hdp teradata connector error in Support Questions

sqoop export with hdp teradata connector error

Re: sqoop export with hdp teradata connector error

Re: sqoop export with hdp teradata connector error

Re: sqoop export with hdp teradata connector error