Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575)

[#1]

I was reviewing the list of tools available for the CCP: Data Engineer Exam (DE575)

http://www.cloudera.com/content/cloudera/en/documentation/core/v5-3-x/topics/cdh_vd_cdh_package_tarb...

It is not obvious if Maven can be used during the exam to compile the JAR files.

I typically use Maven to build my Jars and I use some open source dependencies in my Map/Reduce logic.

http://www.cloudera.com/content/cloudera/en/training/certification/ccp-data-engineer.html

I would like to know if Maven is available during this test and if I can point my pom file to 

https://repository.cloudera.com/artifactory/cloudera-repos so that I can use open source libraries such as Google GSON, Joda Time and Apache Common utils during the exam in my M/R code.

Please let me know at your earliest convenience.

Thanks.

[#2 · Accepted solution]

The exam environment includes a base Maven project preconfigured with all relevant dependencies that you can clone.  The local Maven cache contains all necessary JAR files.

During the exam, however, the firewall will prevent you from loading any modules that are not already cached.  Fortunately, all Hadoop-related JAR files, including things like Guava and Apache Commons are provided in the /opt/cloudera/parcels/CDH/jars directory.

Devon

[#3]

Hi,

Do you have scala sbt installed for packaging scala files into requred jars.

Thanks,

Satya

[#4]

SBT is not one of the packages that comes installed on the cluster.

[#5]

So, we have to use maven for compiling scala applications.