Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Converting Cloudera VM to Amazon AMI

Highlighted

Converting Cloudera VM to Amazon AMI

New Contributor
Is anyone of you successful in converting Cloudera Professor VM to Amazon AMI for using on Amazon AWS EC2. The Cloudera VM requires a very high computer specification (like 4-8 cores, 16 Gram) which our computer lab is not able to support. Therefore we intend to convert this Cloudera VM to an Amazon AMI and install it on the Amazon AWS EC2 service, then our students can remote access to this EC2 for practicing. Implementing this way save us a significant cost because we don't have to invest in a whole range of hardware, students only have to pay for EC2 service.
 
I followed this instruction from amazon aws http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/VMImportPrerequisites.html#vmimport-image-formats to convert to Amazon AMI but failed at the final step when running the "import" command. The process completed at 100% but then issued an error message like "wrong partition or smth like that related to partition".
 
In Amazon document it says "You can only import VMDK files into Amazon EC2 that were created through the OVF export process in VMware". Maybe this is the reason, is Cloudera VM created through the OVF process ?
 
Do you guys have any other suggestion to implement Cloudera VM on the cloud. This is our most economical solution for students to do the hand-on labs.
 
Best regards,
Mai
3 REPLIES 3

Re: Converting Cloudera VM to Amazon AMI

Rising Star

Cloudera provides VMs and a Spark-based curriculum as part of the university CAP program (Cloudera Academic Partnership). Cloudera also provides the Quickstart VM for the general public to use. Both the CAP VMs and the Quickstart VM are provided at no cost. I am running these VMs on a MacBook Pro and on Windows laptops.

 

Requirements for running these VMs:

  • The Quickstart VM can run in 4GB of RAM. It is available as a VMWare, VirtualBox, or KVM image.
  • Through the CAP program, member universities receive two VMWare VMs, the Professor VM and the Student VM. These VMs are used for completing homework assignments provided with the cost-free CAP curriculum. 8GB of RAM is the minimum.

Another option chosen by many CAP universities is to deploy a cluster. Cloudera provides CAP universitites with a free, renewable, Cloudera Enterprise License for CDH. Such a cluster can be deployed on bare metal or in a private or public cloud.

 

Re: Converting Cloudera VM to Amazon AMI

New Contributor

Sue, as I said the hardware requirement for student VM is too hight for all our generic computer labs. We also don't want to deploy CDH yet because that doesn't include all the homework assignments included in the student VM.

Re: Converting Cloudera VM to Amazon AMI

Master Collaborator

Mai,

 

I think Cloudera Live (cloudera.com/live) is what you need. Provides access to a full multi-node CDH cluster; AWS charges apply.

Don't have an account?
Coming from Hortonworks? Activate your account here