How to store JSON as TXT file? Please refer screenshot!

sudhir_reddy — Mon, 09 Jul 2018 15:11:27 GMT

jsonissue.png Getting exception that u have multiple columns and text format can accept 1 column only.

Re: How to store JSON as TXT file? Please refer screenshot!

Shu_ashu — Mon, 09 Jul 2018 16:29:36 GMT

Try with csv writer as text expects only one column.

 df.write.mode("overwrite").csv("/user/root/JOUT")

(or)

Convert the df to rdd then use saveAsTextFile to write the json to hdfs

df.rdd.saveAsTextFile("/user/root/JOUT")

(or)

using .format("json") and save the file to hdfs

df.write.format("json").mode("append").save("/user/root/JOUT")

Some useful links regarding similar errors link1,link2,link3