Reply
Explorer
Posts: 10
Registered: ‎08-12-2015
Accepted Solution

Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575)

[ Edited ]

I was reviewing the list of tools available for the CCP: Data Engineer Exam (DE575)

 

http://www.cloudera.com/content/cloudera/en/documentation/core/v5-3-x/topics/cdh_vd_cdh_package_tarb...

 

It is not obvious if Maven can be used during the exam to compile the JAR files.

 

I typically use Maven to build my Jars and I use some open source dependencies in my Map/Reduce logic.

 

http://www.cloudera.com/content/cloudera/en/training/certification/ccp-data-engineer.html

 

I would like to know if Maven is available during this test and if I can point my pom file to 

https://repository.cloudera.com/artifactory/cloudera-repos so that I can use open source libraries such as Google GSON, Joda Time and Apache Common utils during the exam in my M/R code.

 

Please let me know at your earliest convenience.

 

Thanks.

Cloudera Employee
Posts: 39
Registered: ‎11-19-2014

Re: Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575

The exam environment includes a base Maven project preconfigured with all relevant dependencies that you can clone.  The local Maven cache contains all necessary JAR files.

 

During the exam, however, the firewall will prevent you from loading any modules that are not already cached.  Fortunately, all Hadoop-related JAR files, including things like Guava and Apache Commons are provided in the /opt/cloudera/parcels/CDH/jars directory.

 

Devon

Explorer
Posts: 8
Registered: ‎02-21-2016

Re: Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575

Hi,

Do you have scala sbt installed for packaging scala files into requred jars.

 

Thanks,

Satya

Cloudera Employee
Posts: 75
Registered: ‎12-21-2015

Re: Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575

SBT is not one of the packages that comes installed on the cluster.

Highlighted
Explorer
Posts: 8
Registered: ‎02-21-2016

Re: Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575

So, we have to use maven for compiling scala applications.