Member since
10-14-2015
65
Posts
57
Kudos Received
20
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
7530 | 04-20-2018 10:07 AM | |
2430 | 09-20-2017 12:31 PM | |
2238 | 05-04-2017 01:11 PM | |
1303 | 02-14-2017 07:36 AM | |
4558 | 02-03-2017 05:52 PM |
10-03-2016
06:32 AM
Yes, the 50gb fixed root disk is for OS and RPMs, configs etc., but not for HDFS.
... View more
10-02-2016
08:32 AM
2 Kudos
Hi Chris, If you would like to launch an instance on AWS you have basically two options for root volumes: Instance Store backed root volumes EBS backed root volumes So you cannot really use ephemeral storage as root disks. In conceptional point of view the Instance Storage is very similar to ephemeral one, but Cloudbreak does not support it mainly for the following reasons: Instance Store has slower boot time it is up to 5 mins, the esb is up to 1 mins according to specification. Instance Store has a limit in size which is 10GB which does not really make suitable for installing HDP packages on it a lot of base ami support EBS root disk only, e.g. I was not able to find Redhat 7.2 base ami with “Instance Store” support You can read more about root disk storage on AWS site: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ComponentsAMIs.html#storage-for-the-root-device Cloudbreak supports EBS only and with a fixed size of 50GB, although this 50GB is not configurable at the moment, but based on a feature request we can make it configurable. The ephemeral disks selected by you on Cloudbreak UI is used for HDFS data, so Cloudbreak puts the HDFS data on those ephemeral disks, but all HDP RPMs will be installed on the root disk with is EBS backed. Attila
... View more
09-02-2016
10:31 AM
Hi, Please try to download it with: curl -O -k https://public-repo-1.hortonworks.com/HDP/cloudbreak/cloudbreak-2016-07-06-12-51.img
Regarding the import process you can see further instructions here (it was written to 1.3.0 but it is still valid just replace the image name): http://sequenceiq.com/cloudbreak-docs/latest/openstack/ Attila
... View more
07-08-2016
05:33 PM
hi, it seems it is an issue in the documentation. On every cloud provider you can use 'cloudbreak' user. If you are looking for the public IP address of VMs started by Cloudbreak, you can find them under the Nodes section of the UI. Attila
... View more
06-24-2016
06:47 PM
It is not possible with 1.3 (which is just a tech preview), you need to use 1.2.3 or wait for the next release.
... View more
06-24-2016
05:03 PM
The 1.3.x is already on SaltStack. Under the hood the Cloudbreak starts the Ambari and configures the VM with SaltStack.
... View more
06-24-2016
02:04 PM
1 Kudo
The recipes functionality was based on Consul and Docker. In Cloudbreak 1.3 we have removed both from the HDP cluster in order to improve stability. We also replaced Swarm with SaltStack which also allows custom shell or command execution, furthermore it also provides much more greater flexibility what the Docker + Consul allowed. The first part of this SaltStack based recipes was done only after after we cut the 1.3 release branch, therefore it will be only supported in the upcoming releases.
... View more
03-31-2016
11:33 AM
@Vadim, no, the HDFS and the Swift Object storage will be two different storage and both work parallel with the same cluster. 1.) HDFS: the HDFS components will be installed by Ambari and you can use the HDFS storage as usual, you can store data on it and access to it as usual e.g: hdfs dfs -ls /some_dir/ 2.)
You can connect to Swift with the aid of the Swift connector shown in the link above. The Swift connector is basically allows you to communicate with Swift trough a HDFS API and the Swift connector will translate the HDFS API calls to API calls that can be understood by the Swift object storage. Therefore commands like this will work: hdfs dfs -ls swift://some_container/
... View more
03-29-2016
02:46 PM
2 Kudos
Hi, we have not tested Cloudbreak with Swift, but Hadoop supports Swift out of the box , therefore it shall work on a Hadoop cluster which have been installed with Cloudbreak. Attila
... View more
- « Previous
- Next »