Can you please advise if i need to read avro files on the CCA-175 exam environment,will the below work
val avroDF = sqlContext.read.avro("/user/test/emp-avro")
You are welcome to watch the updated exam preparation video, as well as read through the required skills on the related exam webpage here: https://www.cloudera.com/about/training/certification/cca-spark.html
Hi, The video posted on certification site does not mention any information related to avro files.
Let me rephrase the question.
Do we need to explicitly include avro packages when we launch pyspark (or spark-shell, in case of scala) using "--packages org.apache.spark:spark-avro_2. ... " option ?
Appreciate your response as we are unable to find an answer for this anywhere.
All information is mentioned in the video and in the related exam webpage in order to successfully pass this certification exam. You are welcome to check out the required skills section again.
Thank you for your understanding.