question Re: Import data directly in as-parquetfile format in Archives of Support Questions (Read Only)

Import data directly in as-parquetfile format

nanyim_alain — Fri, 16 Sep 2022 10:15:41 GMT

Hello, Please I will like to know how to import the data with Sqoop while compressing with as- parquetfile directly . Is it possible? here's what I use:

sqoop import \ -libjars jtds-1.3.1.jar \ --connect "jdbc:jtds:sqlserver://xxxxxxx:xxxx;databaseName=xxxxxx;user=xxxxx;password=xxxxxxx;instance=xxxxx" \ --driver net.sourceforge.jtds.jdbc.Driver \ --username xxxx \ --table xxxx \ --hive-import \ --hive-database xxxxxx \ --hive-table xxxx --as-parquetfile --m 1

Here the error it returns me:
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.FileNotFoundException): File does not exist: /apps/hive/warehouse/"name_table"/.metadata/schemas/1.avsc

Thank you !

Re: Import data directly in as-parquetfile format

ravi1 — Tue, 26 Apr 2016 00:01:44 GMT

Is this an existing table that is based on avro? From the logs that looks like the case. If you want to import as parquet, try creating a new hive-table with the above command.

Re: Import data directly in as-parquetfile format

nanyim_alain — Mon, 09 May 2016 17:10:45 GMT

Ravi Mutyala thank you for your answer

Re: Import data directly in as-parquetfile format

ravi1 — Sat, 14 May 2016 01:52:26 GMT

@alain TSAFACK Please try accepting the answer that answered your question. Avoid accepting your own answers unless you have done your research after asking the question and have an answer.