Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hey, I need help moving files from local directory to HDFS using oozie workflow. Helpless so far.

Hey, I need help moving files from local directory to HDFS using oozie workflow. Helpless so far.

New Contributor

Can any explain to me how to move files from a local directory to HDFS using oozie workflow. 

3 REPLIES 3

Re: Hey, I need help moving files from local directory to HDFS using oozie workflow. Helpless so far

Oozie works for when the data is in the cluster already.

To import data in, Flume, Scoop are recommended instead
http://blog.cloudera.com/blog/2015/02/how-to-do-real-time-log-analytics-with-apache-kafka-cloudera-s...

Romain

Re: Hey, I need help moving files from local directory to HDFS using oozie workflow. Helpless so far

New Contributor

Is there any way to pull data from my local directory using flume? Without Kafka?

Highlighted

Re: Hey, I need help moving files from local directory to HDFS using oozie workflow. Helpless so far

Cloudera Employee

You can use the HDFS sink in Flume: https://flume.apache.org/FlumeUserGuide.html

Don't have an account?
Coming from Hortonworks? Activate your account here