Member since
01-07-2019
217
Posts
135
Kudos Received
18
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3808 | 12-09-2021 09:57 PM |
04-05-2017
05:16 PM
You can try HDP 2.6 and Ambari 2.5 in HDCLoud for AWS 1.14.1. Get started here.
... View more
04-03-2017
06:56 PM
Updated for HDCloud 1.14.1. Check it out!
... View more
04-03-2017
06:16 PM
Updated for HDCloud for AWS version 1.14.1. Check it out!
... View more
04-03-2017
06:10 PM
Updated for the latest release 1.14.1. Check it out!
... View more
04-03-2017
05:53 PM
Updated for the latest HDCloud version 1.14.1. Check it out!
... View more
01-20-2017
08:01 PM
2 Kudos
We just updated Hortonworks Data Cloud for AWS to Technical Preview #1.12. The release is packed with goodies such as:
Support for deploying compute nodes with spot pricing. Support for executing node recipes - custom scripts that can be run pre- or post- cluster deployment for customizing the cluster and installing additional software. Support for HDP 2.6 (Technical Preview) that can launch two new cluster configurations for Spark 2.1 and Druid. To create an HDP 2.6 cluster, launch the cloud controller and when creating a cluster choose HDP Version: HDP 2.6 (Technical Preview) and then choose one of the available cluster types: For more details, refer to the Release Notes: http://hortonworks.github.io/hdp-aws/releasenotes/. To get started with HDCloud for AWS, visit http://hortonworks.github.io/hdp-aws/. To get started with Spark 2.1, see Vinay's blog at http://hortonworks.com/blog/try-apache-spark-2-1-zeppelin-hortonworks-data-cloud/. Have fun!
... View more
01-10-2017
05:35 PM
2 Kudos
After creating a cluster on the HDCLoud for AWS, you may notice that certain ports are not opened by default, so you may need to manually open these ports by editing the inbound access on the security group. In this tutorial, I will show you how to open YARN Resource Manager UI (8088) and Hive UI (10502) ports by manually editing the inbound access on the master node security group. Let’s get started! 1. On AWS, from the Services menu, select EC2 to navigate to the EC2 console: 2. In the left pane, in the INSTANCES section, click on Instances. Note: If you can’t see your instances, check the top right corner to make sure that you are in the correct region. 3. Identify the instance corresponding to your master node and. The name of the instance should be <your-cluster-name>-1-master. Next, select that instance. This will allow you to see the Description tab, which includes the link to the security group configuration: 4. Click on the security group URL to open the Security Group section. 5. Select the Inbound tab: 6. Check if 8088 and 10502 are found in the Port Range column. If not, add them by clicking the Edit button, then Add Rule, and add a new Custom TCP Rule for port 8088 with source “0.0.0.0/0”. Next, do the same for port 10502. Save changes by hitting the Save button.
... View more
Labels:
12-13-2016
11:57 PM
s3n is deprecated in newer versions of Hadoop (see https://wiki.apache.org/hadoop/AmazonS3), so it's better to use s3a. To use s3a, specify s3a:// in front of the path when accessing files. The following properties need to be configured first: <property><name>fs.s3a.access.key</name><value>ACCESS-KEY</value></property><property><name>fs.s3a.secret.key</name><value>SECRET-KEY</value></property>
... View more
12-13-2016
11:52 PM
S3N is deprecated in newer versions of Hadoop, so it's better to use s3a. To use s3a, specify s3a:// in front of the path. The following properties need to be configured first: <property><name>fs.s3a.access.key</name><value>ACCESS-KEY</value></property><property><name>fs.s3a.secret.key</name><value>SECRET-KEY</value></property>
... View more