Reply
New Contributor
Posts: 1
Registered: ‎07-09-2018

CCA 175 Certification - Spark version 1.6 issue

Dear Community.

I had given the CCA175 exam. There were some questions which could not be solved with spark 1.6. There were questions where it was asked to load the hive table in an avro format, as well as write a data frame in an avro format. in 1.6 this is not possible, We need addition libraries com.databricks.avro to perform the above operations. I was not able to perform the above operation with sqlContext or hiveContext since they donot support avro. Could you guys help in this regard

 

Thanks

Saurabh

Announcements