question Save dataframe with header in spark 1.6 in Archives of Support Questions (Read Only)

Save dataframe with header in spark 1.6

subbiramreddyp — Thu, 29 Mar 2018 16:56:25 GMT

I am going to write HPCD spark certification in that I need to save dataframe to HDFS

Doubts:

1.Do I need to store data with header or not If need to store any approach please suggest me because they are not going to give any databricks package without header I can.

Thanks in Advance

Subbiram

Re: Save dataframe with header in spark 1.6

RahulSoni — Fri, 30 Mar 2018 00:15:41 GMT

@subbiram Padala

I don't think so! The certification is purely going to be based on your Spark skills and external jars are generally omitted. Also, if there is any such requirement, this would be explicitly mentioned that you need to store the header. And that I mentioned earlier, may not be the case.

Keep the spirits up! All the best with your exam.

Re: Save dataframe with header in spark 1.6

RahulSoni — Sun, 01 Apr 2018 22:21:49 GMT

@subbiram Padala

Did the answer help in the resolution of your query? Please close the thread by marking the answer as Accepted!

Re: Save dataframe with header in spark 1.6

subbiramreddyp — Mon, 02 Apr 2018 13:01:10 GMT

@Rahul Soni

Thanks for the response Rahul,

I have doubt regarding spark version in certification are they updated the spark version to 2.xx or still they provide 1.6 only.