01-28-2017 07:54 PM
I am able to submit a Oozie workflow to sqoop a mysql (retail_db.orders) table into HDFS location as avro datafile and the JOB is successfully completed. However, Unable to locate the .avsc (schema) file in the Oozie location.
Any idea, where would be those supporting files (.avsc, .java) are being saved for the JObs submitted using Oozie?
Because whenever we do Sqoop import from the CLI the respective .avsc and .java are being created in the directory from where the sqoop import has been invoked.
03-15-2017 04:26 AM
I would like to know this as well.
found this related topic but the answer there is not realy satisfing.
If you want to create a table in hive based on a avro file you still need the avsc file so storing this file in hdfs as well saves us from extracting it again from the datafile itself using avro tools.