question Re: Using --direct option in Sqoop import/export in Support Questions

question Re: Using --direct option in Sqoop import/export in Support Questions https://community.cloudera.com/t5/Support-Questions/Using-direct-option-in-Sqoop-import-export/m-p/66951#M47365 Hi Vitalii, I think you are correct, based on below: <A href="https://github.com/cloudera/sqoop/blob/cdh5-1.4.6_5.14.0/src/java/org/apache/sqoop/SqoopOptions.java#L1719-L1721" target="_blank">https://github.com/cloudera/sqoop/blob/cdh5-1.4.6_5.14.0/src/java/org/apache/sqoop/SqoopOptions.java#L1719-L1721</A> <PRE>public void setInputFieldsTerminatedBy(char c) { this.inputDelimiters.setFieldsTerminatedBy(c); }</PRE>  <A href="https://github.com/cloudera/sqoop/blob/cdh5-1.4.6_5.14.0/src/java/org/apache/sqoop/SqoopOptions.java#L1816-L1818" target="_blank">https://github.com/cloudera/sqoop/blob/cdh5-1.4.6_5.14.0/src/java/org/apache/sqoop/SqoopOptions.java#L1816-L1818</A> <PRE>public void setFieldsTerminatedBy(char c) { this.outputDelimiters.setFieldsTerminatedBy(c); }</PRE>However, I can see that when --direct is used,   1. it calls class DirectMySQLManager:<A href="https://github.com/cloudera/sqoop/blob/cdh5-1.4.6_5.14.0/src/java/org/apache/sqoop/manager/DirectMySQLManager.java#L103" target="_blank">https://github.com/cloudera/sqoop/blob/cdh5-1.4.6_5.14.0/src/java/org/apache/sqoop/manager/DirectMySQLManager.java#L103</A>  <PRE> public void exportTable(com.cloudera.sqoop.manager.ExportJobContext context) throws IOException, ExportException { context.setConnManager(this); MySQLExportJob exportJob = new MySQLExportJob(context); exportJob.runExport(); }</PRE>2. in MySQLExportJob class, it actually uses getOutputFieldDelim() function <A href="https://github.com/cloudera/sqoop/blob/cdh5-1.4.6_5.14.0/src/java/org/apache/sqoop/mapreduce/MySQLExportJob.java#L57-L58" target="_blank">https://github.com/cloudera/sqoop/blob/cdh5-1.4.6_5.14.0/src/java/org/apache/sqoop/mapreduce/MySQLExportJob.java#L57-L58</A>  <PRE> conf.setInt(MySQLUtils.OUTPUT_FIELD_DELIM_KEY, options.getOutputFieldDelim());</PRE> This explains that we need to use --fields-terminated-by rather than --input-fields-terminated-by. It looks like that it is considered as output for MySQL, as code uses MySQLUtils.OUTPUT_FIELD_DELIM_KEY. I am not sure if it is expected or a bug. I will follow up with our engineering team.  Look out for another update sometime next week. Fri, 04 May 2018 04:54:47 GMT EricL 2018-05-04T04:54:47Z