Cloudera Quickstart VMs, Cloudera in particular and Hadoop in general have moved on. We are in a transition period away from that version of the Cloudera Quickstart VM, as it was extremely outdated and nearing end of support.   As you noted, the up-to-date product is Cloudera Data Platform, which you can download at that URL. If you really must have a VM-based distribution of Hadoop, I strongly recommend you migrate to   the HDP Sandbox.   Cheers, Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. View solution in original post ... View more

@sbd4q0 This doc can help you to understand the heap requirements. https://docs.cloudera.com/documentation/enterprise/release-notes/topics/hardware_requirements_guide.html   Also generally we consider that 1Million Blocks=1G Heap size needed.  The calculation to determine Hadoop memory over-commit   per Host   is as follows: commit = available_memory_for_hadoop - total_hadoop_java_heap - impala_memory if (total_system_memory * 0.8) < ( sum(java_heap_of_processes) * 1.3 + impala_memory) then flag over-committed ... View more

@Mondi No, This is not the part of 6.3.3, though this available in Cloudera Runtime 7.x. https://docs.cloudera.com/runtime/7.0.3/yarn-allocate-resources/topics/yarn-add-queues-using-yarn-queue-manager-ui.html   But you might want to take a look at fair scheduler. https://docs.cloudera.com/documentation/enterprise/latest/topics/admin_fair_scheduler.html ... View more

@panfng Check here: http://docker-registry.infra.cloudera.com/list/docker2-repo/impala-statestore/ and download the version V2/Latest as per your requirement.  ... View more

@saihadoop This depends on service. In this case you can select the security filter and search for LDAP in search bar. ... View more

@ManjunathK Can you check the jars in the hadoop class /usr/hdp/3.1.0.0-78/hadoop-hdfs/ in the problematic node and see if there is any 0 bytes file. If yes, then copy all the jars from working node and started the services. ... View more

@ManjunathK We might help if you can attach full error log file.  ... View more

@saihadoop I am little bit unsure what LDAP config file you wants to see. Though to answer you question which services can support LDAP mechanism in CDH you can see the doc below.  https://docs.cloudera.com/documentation/enterprise/latest/topics/sg_auth_overview.html#concept_fjp_ht_bt Few components is like: - Cloudera Manager - Cloudera Navigator Metadata Server - Hue - Hive - Impala - Solr   Also to check configuration related with LDAP in CDH services you can just go to service > Configuration > From Category select External Authentication. Here you can see all LDAP related parameters. ... View more

@qazwsxedc The below Ambari guide can give you a good start.  https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/administering-ambari/content/amb_moving_the_ambari_server.html   On the same link you can also navigate from the the left hand side bar to start Ambari from scratch means new install.  ... View more

@nkim When you said randomly does this mean it's working sometimes without any manual intervention.  The klist command showing there there is no credentials found, have you checked if some process or software is deleting this "kdestroy" periodically?   Else KRB trace can a good start here.  ... View more

@Rah It's worth to check if you have TLS enabled installation. I see a note in doc which needs out attention. If you have enabled Auto-TLS, you must include the Cloudera Manager server host when you specify hosts.  https://docs.cloudera.com/cdpdc/7.0/installation/topics/cdpdc-install-runtime-using-wizard.html   Did you restart CM after disabling TLS? Also, when you are using the add host wizard, you do not want to set use_tls=1 until the host is successfully added. It is actually kind of a messy procedure: 1. Disable Use TLS Encryption for Agents, and Use TLS Authentication of Agents to Server. 2. Restart CM 3. Add host to CM 4. Turn on Use TLS Encryption for Agents, and Use TLS Authentication of Agents to Server. 5. Configure agent to use TLS (setting use_tls=1 and the cert/key parameters, or copy config.ini from another host with TLS enabled). 6. Restart agent Alternatives: Use Auto-TLS introduced in C6 Follow the "Alternate Method of installing Cloudera Manager Agent without Disabling TLS" steps instead. If above does not help then we need full log file from CM server to take a look.   Cheers, ... View more

@Pankaj276356   The Cloudera Quick start VM has been discontinued as It was based on CDH 5.13 which is going end of support in the Fall of this year.   As we have introduced CDP so it's available to taste and to get you experience new exciting feature of it.  Also you can try an docker image of Cloudera available publicly on https://hub.docker.com/r/cloudera/quickstart or simply run below command to download this on docker enabled system.  docker pull cloudera/quickstart NOTE: Cloudera Don't support QuickStart VM Officially.  ... View more

Yes It is. The compressed file is around ~20GB.  ... View more

@Jyutika Cloudera QuickStart VM has been discontinued due to EOL. So there is no Quickstart VM available now. As we have introduced CDP so it's available to taste and to get you experience new exciting feature of it.  Also you can try an docker image of Cloudera available publicly on https://hub.docker.com/r/cloudera/quickstart or simply run below command to download this on docker enabled system.  docker pull cloudera/quickstart NOTE: Cloudera Don't support QuickStart VM Officially.  ... View more

@thuylevn I found this somewhere you can try this.   You could do this using the   docker-machine mount   command. Using this command,you can mount directories from a machine to your local host, using sshfs. The notation is machinename:/path/to/dir for the argument; you can also supply an alternative mount point (default is the same dir path). consider an example: $ mkdir foo $ docker-machine ssh dev mkdir foo $ docker-machine mount dev:/home/docker/foo foo $ touch foo/bar $ docker-machine ssh dev ls foo bar Now you can use the directory on the machine, for mounting into containers. Any changes done in the local directory, is reflected in the machine too. $ eval $(docker-machine env dev) $ docker run -v /home/docker/foo:/tmp/foo busybox ls /tmp/foo bar $ touch foo/baz $ docker run -v /home/docker/foo:/tmp/foo busybox ls /tmp/foo bar baz The files are actually being transferred using sftp (over an ssh connection). ... View more

@P_Suresh_Rao The reason on your ask is as per my guess is that QuickStart VM don't have internet access.  If yes then you can download packages externally and then copy into QuickStart and install something like: $ sudo yum update $ sudo yum install yum-utils You can then install the CentOS IUS package which will get you up to date with their site: $ sudo yum install https://centos7.iuscommunity.org/ius-release.rpm Finally you can then install Python and Pip: $ sudo yum install python36u $ sudo yum install python36u-pip If the QuickStart have internet access then you can just update Python like any other packages with yum update command. https://developers.redhat.com/blog/2018/08/13/install-python3-rhel/ ... View more

@Gabby Please follow our response on another community thread. https://community.cloudera.com/t5/Support-Questions/Quick-start-download-removed/m-p/290290/highlight/true#M214798 ... View more

@SSYED Apologies for inconvenience caused. This is a known bug in Cloudera Manager 6.1.   To resolve this issue just Upgrade your Cloudera Manager only to 6.3.3 and also  If you are here looking for a fix for this issue in a  CDH release , there is a patch for CM 6.3.1 available. To get the case please lock a case with Cloudera Support.    Cheers, ... View more

@Tarique  I think the right place for this question is to Contact Sales ... View more

@CaptainJa  The version of Tomcat used in CDH 5.16.2 should not have any vulnerabilities. Could you share the CVE that is reported CDH is vulnerable to?   Per the notice [1] independent upgrade of Tomcat is not supported and we are moving towards newer versions in CDH6 => Cloudera Enterprise 6 has replaced Tomcat 6 with Jetty 9 and is not susceptible to Tomcat security issues.   LINKS: [1] https://community.cloudera.com/t5/Customer/CDH-5-support-for-Tomcat-6/ta-p/73655 ... View more

@SVK NO. Airflow is not a part of the Cloudera suite of application. While you can definitely use 3rd party CSDs in general [1], or make your own CSDs, the support of it is outside Cloudera's scope. If you do pursue to install, my suggestion is to install in a dev/test environment and test it out. Once you are comfortable with the product then you can install into your production cluster.   Again this is not under Cloudera Support's Scope.  Feel free to reach out to your accounts team if you need more information about Cloudera's offerings.   [1] https://github.com/teamclairvoyant/apache-airflow-cloudera-csd ... View more