Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 03-14-2016 09:25 PM
Trying to export the data from hdfs to teradata and got below error .
2016-03-14 17:18:09,688 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1454014691973_216609_000001
2016-03-14 17:18:10,010 FATAL [main] org.apache.hadoop.conf.Configuration: error parsing conf job.xml org.xml.sax.SAXParseException; systemId: file://temp/yarn/local/usercache/*****/appcache/application_1454014691973_216609/container_e14_1454014691973_216609_01_000001/job.xml; lineNumber: 90; columnNumber: 62; Character reference "" is an invalid XML character. at org.apache.xerces.parsers.DOMParser.parse(Unknown Source) at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source) at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150) at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2549) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2502) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405) at org.apache.hadoop.conf.Configuration.get(Configuration.java:1232) at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.initialize(MRWebAppUtil.java:51) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1482) 2016-03-14 17:18:10,012 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster java.lang.RuntimeException: org.xml.sax.SAXParseException; systemId: file:///temp/yarn/local/usercache/****/appcache/application_1454014691973_216609/container_e14_1454014691973_216609_01_000001/job.xml; lineNumber: 90; columnNumber: 62; Character reference "" is an invalid XML character. at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2645) at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2502) at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2405) at org.apache.hadoop.conf.Configuration.get(Configuration.java:1232) at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.initialize(MRWebAppUtil.java:51) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1482) Caused by: org.xml.sax.SAXParseException; systemId: file:///apps/opt/data07/hadoop/yarn/local/usercache/rajenne/appcache/application_1454014691973_216609/container_e14_1454014691973_216609_01_000001/job.xml; lineNumber: 90; columnNumber: 62; Character reference "" is an invalid XML character. at org.apache.xerces.parsers.DOMParser.parse(Unknown Source) at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source) at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150) at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2480) at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2549) ... 5 more 2016-03-14 17:18:10,014 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting with status 1
Created 04-06-2016 03:50 PM
It is working fine after removing duplicate hdp teradata connector jar file from sqoop lib location .
Created 03-15-2016 10:56 PM
Are you exporting xml? It looks like a syntax issue. Please post the command. Check the field #62, do you have an emty field? You may need to escape it or convert to null. https://community.hortonworks.com/questions/10848/sqoop-export-to-teradata-issue-exporting-n-instead...
Created 03-16-2016 01:45 AM
Find the below command to export the text data from HDFS to teradata .
sqoop export -Dmapred.job.queue.name=xxxxx --connect jdbc:teradata://xxxxxx/Database=xxxxxx --connection-manager org.apache.sqoop.teradata.TeradataConnManager --username xxxxxx --password xxxxxx --table xxxxxx_teradata_table_name --export-dir /hdfs_data_path/insert_dt=2016-03-01 --input-null-string '\\N' --input-null-non-string '\\N'
I tried with --input-null-string '\\N' --input-null-non-string '\\N' and got same exception. It is looks like some version mismatch issue .
find below version details .:
hdp teradata version : 1.4.1
hdp version : 2.3.4
Created 04-06-2016 03:50 PM
It is working fine after removing duplicate hdp teradata connector jar file from sqoop lib location .