Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Ingest dinamic data technics

Ingest dinamic data technics

New Contributor
Hi everybody, I'm new on cloudera platform,
I have this scenario, I need to ingest a lot of data (data bases, files), sometimes files changes the column count, more or less, but it change, I want to import data on hive, which tool do you suggest me? Any adeas?

Thanks
1 REPLY 1
Highlighted

Re: Ingest dinamic data technics

Expert Contributor

Hello @arturopineda,

 

It is quite an open question. Solution depends on the various factors like latency, network, existing products within your company, infrastructure, your team's skillset. As a MVP model and assuming that your team has skills to implement it, you may start with sqoop and flume and then take it from there.

 

Hope that helps.

Don't have an account?
Coming from Hortonworks? Activate your account here