Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

sqoop syntax to import to kudu table

Highlighted

sqoop syntax to import to kudu table

New Contributor

We'd like to test Kudu and need to import data. Sqoop seems like the correct choice. I find references that you can import to Kudu but no specifics. Is there any way to import to Kudu using Sqoop?

3 REPLIES 3

Re: sqoop syntax to import to kudu table

Guru
This is being worked via:

https://issues.apache.org/jira/browse/SQOOP-2903
https://issues.apache.org/jira/browse/SQOOP-3148

So currently Sqoop does not support Kudu yet. You can import to HDFS and then use Impala to write data to Kudu.
Highlighted

Re: sqoop syntax to import to kudu table

Expert Contributor

I have seen people create Kudu connectors for Sqoop, however these are not supported by Cloudera. The main reason is likely that Sqoop is fundamentally designed for writing to HDFS.

If you are limited to CDH you could first use sqoop to get the data into your cluster, and then do an extra step to bring it to Kudu.

However, since CDF has been released we have now got standard NiFi processors for reading from a database and writing to Kudu. Hence this would be my recommended solution.


- Dennis Jaheruddin

If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'. Also check out my techincal portfolio at https://portfolio.jaheruddin.nl
Highlighted

Re: sqoop syntax to import to kudu table

New Contributor

It's an old post, but my problem with NiFi, it will read data from Source, write to avro, load to KuDu. Sqoop will retry, redtart job on other node, if a node fails. If a NiFi node goes down, you have to bring it back online, to get your data back, or offload it (manual).

Don't have an account?
Coming from Hortonworks? Activate your account here