Reply
New Contributor
Posts: 1
Registered: ‎04-15-2019

Ingest dinamic data technics

Hi everybody, I'm new on cloudera platform,
I have this scenario, I need to ingest a lot of data (data bases, files), sometimes files changes the column count, more or less, but it change, I want to import data on hive, which tool do you suggest me? Any adeas?

Thanks
Expert Contributor
Posts: 92
Registered: ‎01-08-2016

Re: Ingest dinamic data technics

Hello @arturopineda,

 

It is quite an open question. Solution depends on the various factors like latency, network, existing products within your company, infrastructure, your team's skillset. As a MVP model and assuming that your team has skills to implement it, you may start with sqoop and flume and then take it from there.

 

Hope that helps.