Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

CCA 175 Avro Format Spark 2.3.0

CCA 175 Avro Format Spark 2.3.0

New Contributor

Hi.. I am planning to take the CCA 175 Spark & Hadoop Developer Certification. 

Kindly let me know if the Virtual Machine provided during the exam will allow for avro package to be downloaded when starting the spark2 shell like below

spark2-shell --packages com.databricks:spark-avro_2.11:4.0.0

 

If not will the package com.databricks.spark.avro be present in the vm i.e., we can directly import com.databricks.spark.avro._ 

 

Note that i would like to use spark 2.3 during the exam and in the cloudera quick start vm I am including the package when starting the shell (as above bolded), since internet connectivity will not be available on the vm on which we will be taking the exam kindly suggest if the import of avro will work out of the box or an alternative.

 

Thanks..

Manoj B

1 REPLY 1

Re: CCA 175 Avro Format Spark 2.3.0

Master Guru
The VM offered typically includes all required items pertaining to questions asked.

I'm not certain about the exact version of Spark2 offered, but the included version will suffice in achieving the presented goals.