Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 11-16-2016 01:32 AM
How to convert spark data frames into xml files in scala. Very large data need to change from oracle database into xml files how can we do that?
Created 11-16-2016 10:27 PM
https://spark-packages.org/package/HyukjinKwon/spark-xml has been moved to databricks: https://github.com/databricks/spark-xml for Spark 2.0 or for older: https://github.com/databricks/spark-xml/tree/branch-0.3
You should start the shell like this (check the proper version of spark-xml package):
spark-shell --packages com.databricks:spark-xml:0.1.1-s_2.10
+++
If this helped, please vote/accept best answer
Created 11-16-2016 02:06 AM
You should use this package:
https://spark-packages.org/package/HyukjinKwon/spark-xml
val selectedData = df.select("author", "_id")
selectedData.write
.format("com.databricks.spark.xml")
.option("rootTag", "books")
.option("rowTag", "book")
.save("newbooks.xml")
Created 11-19-2016 04:13 AM
its working fine.But out put xml file saved in 10 files but I need in single file.How can we do that?
Created 11-16-2016 10:27 PM
https://spark-packages.org/package/HyukjinKwon/spark-xml has been moved to databricks: https://github.com/databricks/spark-xml for Spark 2.0 or for older: https://github.com/databricks/spark-xml/tree/branch-0.3
You should start the shell like this (check the proper version of spark-xml package):
spark-shell --packages com.databricks:spark-xml:0.1.1-s_2.10
+++
If this helped, please vote/accept best answer
Created 11-19-2016 04:12 AM
Thank you staca ...its working fine.But out put xml file saved in 10 files but I need in single file.How can we do that?
Created 04-14-2020 12:10 AM
you can use .repartition(1)
DF..repartition(1) .....