Created 03-14-2016 09:25 PM
Trying to export the data from hdfs to teradata and got below error .
2016-03-14 17:18:09,688 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1454014691973_216609_000001
2016-03-14 17:18:10,010 FATAL [main] org.apache.hadoop.conf.Configuration: error parsing conf job.xml org.xml.sax.SAXParseException; systemId: file://temp/yarn/local/usercache/*****/appcache/application_1454014691973_216609/container_e14_1454014691973_216609_01_000001/job.xml; lineNumber: 90; columnNumber: 62; Character reference "" is an invalid XML character. at org.apache.xerces.parsers.DOMParser.parse(Unknown Source) at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source) at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150) at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2549) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2502) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405) at org.apache.hadoop.conf.Configuration.get(Configuration.java:1232) at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.initialize(MRWebAppUtil.java:51) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1482) 2016-03-14 17:18:10,012 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster java.lang.RuntimeException: org.xml.sax.SAXParseException; systemId: file:///temp/yarn/local/usercache/****/appcache/application_1454014691973_216609/container_e14_1454014691973_216609_01_000001/job.xml; lineNumber: 90; columnNumber: 62; Character reference "" is an invalid XML character. at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2645) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2502) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405) at org.apache.hadoop.conf.Configuration.get(Configuration.java:1232) at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.initialize(MRWebAppUtil.java:51) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1482) Caused by: org.xml.sax.SAXParseException; systemId: file:///apps/opt/data07/hadoop/yarn/local/usercache/rajenne/appcache/application_1454014691973_216609/container_e14_1454014691973_216609_01_000001/job.xml; lineNumber: 90; columnNumber: 62; Character reference "" is an invalid XML character. at org.apache.xerces.parsers.DOMParser.parse(Unknown Source) at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source) at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150) at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2549) ... 5 more 2016-03-14 17:18:10,014 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting with status 1
Created 04-06-2016 03:50 PM
It is working fine after removing duplicate hdp teradata connector jar file from sqoop lib location .
Created 03-15-2016 10:56 PM
Are you exporting xml? It looks like a syntax issue. Please post the command. Check the field #62, do you have an emty field? You may need to escape it or convert to null. https://community.hortonworks.com/questions/10848/sqoop-export-to-teradata-issue-exporting-n-instead...
Created 03-16-2016 01:45 AM
Find the below command to export the text data from HDFS to teradata .
sqoop export -Dmapred.job.queue.name=xxxxx --connect jdbc:teradata://xxxxxx/Database=xxxxxx --connection-manager org.apache.sqoop.teradata.TeradataConnManager --username xxxxxx --password xxxxxx --table xxxxxx_teradata_table_name --export-dir /hdfs_data_path/insert_dt=2016-03-01 --input-null-string '\\N' --input-null-non-string '\\N'
I tried with --input-null-string '\\N' --input-null-non-string '\\N' and got same exception. It is looks like some version mismatch issue .
find below version details .:
hdp teradata version : 1.4.1
hdp version : 2.3.4
Created 04-06-2016 03:50 PM
It is working fine after removing duplicate hdp teradata connector jar file from sqoop lib location .