Support Questions
Find answers, ask questions, and share your expertise

Transfer Large Data files

New Contributor

Hi all,

Our company acquires a large amount of data (terabytes) at the well site. I'm new to Hadoop but it seems to me that Hadoop would be an attractive solution to our data management challenge.

Is it possible to record raw data at the well site and write it to HDFS files so our data is secured ( have 3 copies of data) and distributed among clusters given the fact that the internet at the wellsite is slow ( 5 mbps upload). It seems to me that the internet could pose a problem.

Just thought that if Hadoop is designed to deal with big data, then it would have an efficient way to move the data around.

I would really appreciate any input/opinion on this.