Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

Where would be .avsc files stored for the SQOOP JOBs submitted using Oozie Workflow

Where would be .avsc files stored for the SQOOP JOBs submitted using Oozie Workflow

Explorer

I am able to submit a Oozie workflow to sqoop a mysql (retail_db.orders) table into HDFS location as avro datafile and the JOB is successfully completed. However, Unable to locate the .avsc (schema) file in the Oozie location.

 

Any idea, where would be those supporting files (.avsc, .java) are being saved for the JObs submitted using Oozie?

 

Because whenever we do Sqoop import from the CLI the respective .avsc and .java are being created in the directory from where the sqoop import has been invoked. 

1 REPLY 1

Re: Where would be .avsc files stored for the SQOOP JOBs submitted using Oozie Workflow

New Contributor

I would like to know this as well.

 

found this related topic but the answer there is not realy satisfing.

http://community.cloudera.com/t5/Web-UI-Hue-Beeswax/Sqoop-as-Avro-file-Missing-avsc-files/m-p/35667/...

 

If you want to create a table in hive based on a avro file you still need the avsc file so storing this file in hdfs as well saves us from extracting it again from the datafile itself using avro tools.