Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575)

SOLVED Go to solution

Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575)

Explorer

I was reviewing the list of tools available for the CCP: Data Engineer Exam (DE575)

 

http://www.cloudera.com/content/cloudera/en/documentation/core/v5-3-x/topics/cdh_vd_cdh_package_tarb...

 

It is not obvious if Maven can be used during the exam to compile the JAR files.

 

I typically use Maven to build my Jars and I use some open source dependencies in my Map/Reduce logic.

 

http://www.cloudera.com/content/cloudera/en/training/certification/ccp-data-engineer.html

 

I would like to know if Maven is available during this test and if I can point my pom file to 

https://repository.cloudera.com/artifactory/cloudera-repos so that I can use open source libraries such as Google GSON, Joda Time and Apache Common utils during the exam in my M/R code.

 

Please let me know at your earliest convenience.

 

Thanks.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575

Contributor

The exam environment includes a base Maven project preconfigured with all relevant dependencies that you can clone.  The local Maven cache contains all necessary JAR files.

 

During the exam, however, the firewall will prevent you from loading any modules that are not already cached.  Fortunately, all Hadoop-related JAR files, including things like Guava and Apache Commons are provided in the /opt/cloudera/parcels/CDH/jars directory.

 

Devon

4 REPLIES 4

Re: Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575

Contributor

The exam environment includes a base Maven project preconfigured with all relevant dependencies that you can clone.  The local Maven cache contains all necessary JAR files.

 

During the exam, however, the firewall will prevent you from loading any modules that are not already cached.  Fortunately, all Hadoop-related JAR files, including things like Guava and Apache Commons are provided in the /opt/cloudera/parcels/CDH/jars directory.

 

Devon

Re: Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575

Explorer

Hi,

Do you have scala sbt installed for packaging scala files into requred jars.

 

Thanks,

Satya

Highlighted

Re: Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575

Expert Contributor

SBT is not one of the packages that comes installed on the cluster.

Re: Using Apache Maven, POM Files and Open Source Dependencies During CCP: Data Engineer Exam (DE575

Explorer

So, we have to use maven for compiling scala applications.