question Re: Sqoop : Teradata to HDFS using PARQUET file format not working in Support Questions

Sqoop : Teradata to HDFS using PARQUET file format not working

arkaprova — Wed, 21 Sep 2016 14:05:19 GMT

I am trying to execute below command in sqoop

sqoop import --connection-manager org.apache.sqoop.teradata.TeradataConnManager --connect jdbc:teradata://***.***.***.***/DATABASE=***** --username ***** --password **** --table mytable --target-dir /user/aps/test2 --as-parquetfile -m 1

Output :

-rw-r--r-- 3 ****** hdfs 0 2016-09-21 12:25 /user/aps/test2/_SUCCESS

-rw-r--r-- 3 ****** hdfs 18 2016-09-21 12:25 /user/aps/test2/part-m-00000

Above output is not in parquet format. If I use com.teradata.jdbc.TeraDriver , it is working. But I have to use org.apache.sqoop.teradata.TeradataConnManager for connection. Please help.

Re: Sqoop : Teradata to HDFS using PARQUET file format not working

arkaprova — Wed, 21 Sep 2016 19:32:08 GMT

Is there any update. Please help.

Re: Sqoop : Teradata to HDFS using PARQUET file format not working

mqureshi — Wed, 21 Sep 2016 21:10:59 GMT

@Arkaprova Saha

The reason I think you are not able to import data in Parquet format is because Parquet is not supported by this driver. Please see the following link for supported formats which include Avro and RCfile beside other formats but does not include Parquet (check under section 1.2.1).

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.6/bk_HortonworksConnectorForTeradata/content/ch_HortonworksConnectorForTeradata.html

Re: Sqoop : Teradata to HDFS using PARQUET file format not working

arkaprova — Fri, 23 Sep 2016 22:17:55 GMT

@mqureshi Thanks for your quick response.