New Contributor
Posts: 1
Registered: ‎04-15-2019

Ingest dinamic data technics

Hi everybody, I'm new on cloudera platform,
I have this scenario, I need to ingest a lot of data (data bases, files), sometimes files changes the column count, more or less, but it change, I want to import data on hive, which tool do you suggest me? Any adeas?

Expert Contributor
Posts: 92
Registered: ‎01-08-2016

Re: Ingest dinamic data technics

Hello @arturopineda,


It is quite an open question. Solution depends on the various factors like latency, network, existing products within your company, infrastructure, your team's skillset. As a MVP model and assuming that your team has skills to implement it, you may start with sqoop and flume and then take it from there.


Hope that helps.