Reply
Explorer
Posts: 15
Registered: ‎11-21-2015

Where would be .avsc files stored for the SQOOP JOBs submitted using Oozie Workflow

I am able to submit a Oozie workflow to sqoop a mysql (retail_db.orders) table into HDFS location as avro datafile and the JOB is successfully completed. However, Unable to locate the .avsc (schema) file in the Oozie location.

 

Any idea, where would be those supporting files (.avsc, .java) are being saved for the JObs submitted using Oozie?

 

Because whenever we do Sqoop import from the CLI the respective .avsc and .java are being created in the directory from where the sqoop import has been invoked. 

Highlighted
New Contributor
Posts: 3
Registered: ‎07-08-2016

Re: Where would be .avsc files stored for the SQOOP JOBs submitted using Oozie Workflow

I would like to know this as well.

 

found this related topic but the answer there is not realy satisfing.

http://community.cloudera.com/t5/Web-UI-Hue-Beeswax/Sqoop-as-Avro-file-Missing-avsc-files/m-p/35667/...

 

If you want to create a table in hive based on a avro file you still need the avsc file so storing this file in hdfs as well saves us from extracting it again from the datafile itself using avro tools.

Announcements