12-03-2017 08:34 AM - last edited on 12-04-2017 05:41 AM by cjervis
I'm working with spark 1.6.
I read a table from MySQL with Sqoop Import and process it with SqlContext as a DataFrame.
I save the result with parquet format in HDFS, and I check it on Hue:
As you can see, it creates a _metadata file. But to use Sqoop Export and put the information back to mySQL, I need a .metadata file with the schema. (and changing the name doesn't work).
How can I do it?