Hello @ni4ni ,   we were able to reproduce internally the behaviour you reported. As a workaround when the installer hangs, open http://hostname:7180 and proceed with the installation. Raising this internally to investigate further.   Kind regards: Ferenc ... View more

Hello @NumeroUnoNU ,   thank you for raising your enquiries about how to build a CSD. Have you seen the github repo [1] along with the instructions on how to build and deploy your custom solution, please? Please note the side-menu on the right with the links of the different instructions on e.g. how to build a parcel, how to create control scripts and so on.   Please let us know if you found the information on our github repo that you were looking for!   Thank you: Ferenc   [1] https://github.com/cloudera/cm_ext/wiki/CSD-Overview ... View more

Hello @ijarvis ,   - If you are looking to try out HDP, please consider downloading our HDP Sandbox [1]. It does not require to become a subscription customer or to have paywall credentials.   - If you would like to deploy HDP in a production environment, please reach out to our Sales Team [2] to guide you further. Once you are a subscription customer, make sure you are registered to our Support Portal [3], please. Please note, the Community Portal registration is different from the Support Portal one. After logging in to the Support Portal, you can navigate to the Downloads page and follow an automated process for the paywall credentials. You will need your license key ready to generate the paywall credential, if you need a copy of the license key, you can open a non-technical case to request it (once you are registered and logged in to our Support Portal).  The binaries are behind a paywall for which you need paywall credentials. Please see more about our Licencing Policy FAQ under [4].   - you can always download and compile the source code [5], which is not behind the paywall   Please let me know if you need further input!   Thank you: Ferenc    [1] https://www.cloudera.com/downloads/hortonworks-sandbox.html [2] https://www.cloudera.com/contact-sales.html [3] https://sso.cloudera.com/register.html [4] https://www.cloudera.com/products/faq.html [5] https://github.com/hortonworks/hadoop-release/releases ... View more

Hello @Mondi ,   thank you for raising your question about why application logs being deleted from the nodes after the applications finished running and why is it happening, how to keep them in place.   When log aggregation is enabled with the 'yarn.log-aggregation-enable = true' [1] you will observe the behaviour described: after the logs are aggregated to HDFS, the logs are immediately deleted from the local file system. Log aggregation does not start until the application is finished. If you need to keep the logs and some other temporary files on the local node for troubleshooting and you have log aggregation turned on then you can use yarn.nodemanager.delete.debug-delay-sec . This is set to 0 seconds by default causing the immediate delete.   Should you disable log aggregation, non aggregated logs are kept for yarn.nodemanager.log.retain-seconds = 10800 seconds (3*3600 seconds or 3 hours). After that the NodeManager will delete the log files.   Please let us know if your enquiries been addressed!   Thank you: Ferenc   [1] https://hadoop.apache.org/docs/r2.7.0/hadoop-yarn/hadoop-yarn-common/yarn-default.xml ... View more

Hello @Mondi ,   thank you for sharing with us your concerns. I believe you were referring to the thread under [1].   dr.who is a username used for all unauthenticated users who submit job to YARN. You can be subject to malware attacks when your cluster is not secured and connected to the Internet. Please see [2] on this topic and how to remedy.   Please always secure your cluster [3]. Make sure you enable authentication for web consoles [4] (securing your UIs). Once enabled, secured web UI will require SPNEGO to be configured on the browser you are accessing it e.g. the YARN Web UI.   Please let us know if you need more information on this topic.   Thank you: Ferenc   [1] https://community.cloudera.com/t5/Support-Questions/HDP-2-6-1-Virus-CrytalMiner-dr-who/m-p/197497/highlight/true#M159548 [2] https://blog.cloudera.com/protecting-hadoop-clusters-from-malware-attacks/ [3] https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/security.html [4] https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/cm_sg_web_auth.html ... View more