Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

What tool is the best tool for extract data from Teradata database to hortonworks HDFS?

avatar
Expert Contributor

our hortonworks cluster look for an ETL tool to extract data from tara data to HDFS

1 ACCEPTED SOLUTION

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
8 REPLIES 8

avatar
Master Mentor

@Robin Dong

take a look at our add-on for teradata and hdp. Link. Read the docs on the Connector. In general you would use Sqoop to ingest into and out of an EDW or RDBMS.

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar
Master Mentor

@Ancil McBarnett Impressive response!!!

avatar
Expert Contributor

@Ancil McBarnett

Great, appreciated your quick respond. we will try this tool to see what comes out.

Thanks again.

Robin

avatar
Master Mentor

@Robin Dong has this been resolved? Can you post your solution or accept best answer?

avatar
New Contributor

Hi,

I am getting the following ERROR:

16/02/25 04:06:39 ERROR tool.BaseSqoopTool: Unrecognized argument: -Dteradata.db.input.file.format

The command I am running:

sqoop import -libjars ${LIB_JARS} --connect jdbc:teradata://<host_address>/TMODE=ANSI,CHARSET=UTF8,database=datatypes --connection-manager org.apache.sqoop.teradata.TeradataConnManager --username dbc --password <password> --table test_datatype_numeric --split-by col_num --target-dir /sqoop/teratest/orc_new -Dteradata.db.input.file.format orcfile

Basically I am using Hortonworks Connector for Teradata. I want to store the result in ORC format.

Can some one help.

avatar
New Contributor

@Ancil McBarnett :

Can you plese help me out.

avatar
Master Mentor

You're saying the format coming from teradata is orc what you need to do is import into Hive orc table. Look at sqoop user guide for Hive https://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_importing_data_into_hive

And our documentation for sqoop