Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575)

avatar
Contributor

I was reviewing the list of tools available for the CCP: Data Engineer Exam (DE575)

 

http://www.cloudera.com/content/cloudera/en/documentation/core/v5-3-x/topics/cdh_vd_cdh_package_tarb...

 

It is not obvious if Maven can be used during the exam to compile the JAR files.

 

I typically use Maven to build my Jars and I use some open source dependencies in my Map/Reduce logic.

 

http://www.cloudera.com/content/cloudera/en/training/certification/ccp-data-engineer.html

 

I would like to know if Maven is available during this test and if I can point my pom file to 

https://repository.cloudera.com/artifactory/cloudera-repos so that I can use open source libraries such as Google GSON, Joda Time and Apache Common utils during the exam in my M/R code.

 

Please let me know at your earliest convenience.

 

Thanks.

1 ACCEPTED SOLUTION

avatar
Rising Star

The exam environment includes a base Maven project preconfigured with all relevant dependencies that you can clone.  The local Maven cache contains all necessary JAR files.

 

During the exam, however, the firewall will prevent you from loading any modules that are not already cached.  Fortunately, all Hadoop-related JAR files, including things like Guava and Apache Commons are provided in the /opt/cloudera/parcels/CDH/jars directory.

 

Devon

View solution in original post

4 REPLIES 4

avatar
Rising Star

The exam environment includes a base Maven project preconfigured with all relevant dependencies that you can clone.  The local Maven cache contains all necessary JAR files.

 

During the exam, however, the firewall will prevent you from loading any modules that are not already cached.  Fortunately, all Hadoop-related JAR files, including things like Guava and Apache Commons are provided in the /opt/cloudera/parcels/CDH/jars directory.

 

Devon

avatar
Explorer

Hi,

Do you have scala sbt installed for packaging scala files into requred jars.

 

Thanks,

Satya

avatar
Super Collaborator

SBT is not one of the packages that comes installed on the cluster.

avatar
Explorer

So, we have to use maven for compiling scala applications.