question Re: How to convert spark dataframes into xml files? in Archives of Support Questions (Read Only)

How to convert spark dataframes into xml files?

goudhadoop — Wed, 16 Nov 2016 09:32:02 GMT

How to convert spark data frames into xml files in scala. Very large data need to change from oracle database into xml files how can we do that?

Re: How to convert spark dataframes into xml files?

vjain — Wed, 16 Nov 2016 10:06:56 GMT

@Gundrathi babu

You should use this package:

https://spark-packages.org/package/HyukjinKwon/spark-xml

val selectedData = df.select("author", "_id")
selectedData.write
    .format("com.databricks.spark.xml")
    .option("rootTag", "books")
    .option("rowTag", "book")
    .save("newbooks.xml")

Re: How to convert spark dataframes into xml files?

cstanca — Thu, 17 Nov 2016 06:27:51 GMT

@Gundrathi babu

https://spark-packages.org/package/HyukjinKwon/spark-xml has been moved to databricks: https://github.com/databricks/spark-xml for Spark 2.0 or for older: https://github.com/databricks/spark-xml/tree/branch-0.3

You should start the shell like this (check the proper version of spark-xml package):

spark-shell --packages com.databricks:spark-xml:0.1.1-s_2.10

+++

If this helped, please vote/accept best answer

Re: How to convert spark dataframes into xml files?

goudhadoop — Sat, 19 Nov 2016 12:12:35 GMT

Thank you staca ...its working fine.But out put xml file saved in 10 files but I need in single file.How can we do that?

Re: How to convert spark dataframes into xml files?

goudhadoop — Sat, 19 Nov 2016 12:13:07 GMT

its working fine.But out put xml file saved in 10 files but I need in single file.How can we do that?

Re: How to convert spark dataframes into xml files?

Ciro_Fuccio — Tue, 14 Apr 2020 07:10:51 GMT

you can use .repartition(1)

DF..repartition(1) .....