About rdoktorics

rdoktorics · ‎05-07-2019

Cloudbreak supports resizing HDF cluster but not those hostgroups which has NIFI service.

rdoktorics · ‎01-29-2019

Hi @Anton Zadorozhniy Currently this is not possible in cloudbreak but it is a great feature request and I will create a Jira for these. Thanks

rdoktorics · ‎07-19-2018

@challa vinitha cluster details screen-shot-2018-07-19-at-43331-pm.png screen-shot-2018-07-19-at-43337-pm.png

rdoktorics · ‎07-18-2018

@challa vinitha You can do that manually but you can also configure autoscaling policies on your cluster which based on time, or based on metrics which are exposed by ambari. Read more here: https://docs.hortonworks.com/HDPDocuments/Cloudbreak/Cloudbreak-2.7.1/content/autoscaling/index.html

rdoktorics · ‎03-31-2018

@Shant Hovsepian you can not use cbd update but you can update for the patch version as we mentioned. curl -Ls public-repo-1.hortonworks.com/HDP/cloudbreak/cloudbreak-deployer_2.4.1-rc.27_Linux_x86_64.tgz | sudo tar -xz -C /bin cbd and then cbd restart Br, R

rdoktorics · ‎03-31-2018

@Leszek Leszczynski Unfortunately this is not possible currently so you have to recreate the whole cluster. As I know this is also a limitation on Ambari side. Br R

rdoktorics · ‎03-30-2018

@Leszek Leszczynski My first question is can you upgrade to 2.4? That is latest GA release and if you just now started testing Cloudbreak I suggest to use 2.4 Br R

rdoktorics · ‎03-28-2018

@Muralidhar Adapala You are right we only support DS-series, DSv2-series, GS-series, Ls-series, Fs-series with premium storage. can you please contact with our support and open a support case? We are happy to help in this problem. Br, R

rdoktorics · ‎03-27-2018

@Muralidhar Adapala https://docs.microsoft.com/en-us/azure/virtual-machines/windows/premium-storage Premium Storage supports VM disks that can be attached to specific size-series VMs. Premium Storage supports DS-series, DSv2-series, GS-series, Ls-series, Fs-series and Esv3-series VMs For example Standard_D32s_v3 supports Premium storage Br, R

rdoktorics · ‎03-26-2018

Hi @Craig Connell finally we get some response so working on the fix. we will let you know as soon as possible

rdoktorics · ‎03-23-2018

I think you using some strange character in your template can you paste here what are you using? (for sure without any sensitive data) btw the stack name can contains only lowercase letters

rdoktorics · ‎03-21-2018

@Brandon Gold what is your stackname ?

rdoktorics · ‎02-02-2018

ok then you don't use hdc. Are you saying I have to pay for another HDP service to get this to work? No First of all please upgrade for latest GA release with 'cbd update' command.

rdoktorics · ‎02-02-2018

@Bob Thorman I think you are using Hortonworks Data Cloud. If yes then please the instruction here follow https://docs.hortonworks.com/HDPDocuments/HDCloudAWS/HDCloudAWS-1.16.2/bk_hdcloud-aws/content/subscribe/index.html

rdoktorics · ‎09-29-2017

In this documentation: https://hortonworks.github.io/hdp-aws/s3-configure/index.html <property> <name>fs.s3a.aws.credentials.provider</name> <value>org.apache.hadoop.fs.s3a.SharedInstanceProfileCredentialsProvider</value> </property>

rdoktorics · ‎09-29-2017

Can you please contact with our support team and raise an issue. We need some application log and I don't want to share here. Br, R

rdoktorics · ‎09-29-2017

@Shyam Shaw Can please give us more context? Which version are you using ? Br, R

rdoktorics · ‎09-29-2017

@Pradeep Bhadani You have to attach an AWS instance profile to every machine which you would like to use with s3. After that you are able to reach s3 with s3a:// Br, R

rdoktorics · ‎09-29-2017

@Pradeep Bhadani If you would like to use Cloudbreak to provision your HDP stack then here are the answers: 1. http://hortonworks.github.io/cloudbreak-docs/latest/aws/#advanced-options -> Instance Profile option 2. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_cloud-data-access/content/s3-guard.html this is in TP in HDP 2.6 3. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_cloud-data-access/content/s3-get-started.html a documentation regarding S3 connector Br, R

rdoktorics · ‎09-27-2017

@Matt Andruff please add --verify=true as parameter and thanks for reporting the issue

rdoktorics · ‎09-25-2017

I just checked your blueprint file and the blueprint_name is missing in the blueprint config like this: https://github.com/hortonworks/cloudbreak/blob/master/integration-test/src/main/resources/blueprint/multi-node-hdfs-yarn.bp#L53

rdoktorics · ‎09-19-2017

read this: https://hortonworks.github.io/hdp-aws/s3-hive/index.html

rdoktorics · ‎09-19-2017

@Anandha L Ranganathan Can those machines reach the internet? what is your vpc config where you want to deploy your cluster?

rdoktorics · ‎09-12-2017

If you have 3 hostgroup then you have to configure 3 instancegroup as well

rdoktorics · ‎09-12-2017

@Matt Andruff How many hostgroup do you have in your blueprint? Which version of cbd shell are you using ? Br R

rdoktorics · ‎09-07-2017

@Eder alves As I see in the examples the installation user is root but on your machine this is cloudbreak it could be a problem. Also please check the python version. That article using sandbox environment maybe that is different int he configuration than a cloudbreak installed cluster. Br, R

rdoktorics · ‎09-07-2017

@Eder alves As I see in the examples the installation user is root but on your machine this is cloudbreak it could be a problem. Also please check the python version. That article using sandbox environment maybe that is different int he configuration than a cloudbreak installed cluster. Br, R

rdoktorics · ‎09-07-2017

Please accept the answer if it solved your problem @Henrique Silva

rdoktorics · ‎09-06-2017

@Julien Champ I think you are on the right track. This is how we doing things in Hortonworks Data Cloud. We have 3 type of nodes there: master, workers, computes and scaling the computes up and down. One thing which you should investigate that where you want to store your data because I probably suggest a cloud object store which is supported by Hortonworks so s3 (AWS) or adls (Azure). Br, R

rdoktorics · ‎09-06-2017

@Julien Champ I think this is the correct approach for your problem. I suggest to config enough cooldown time between scaling events because the hdfs data movement can be slow If you have too much data. Br, R

Online	Offline
Last Visited	‎08-03-2020 02:41 AM

Date Registered	‎09-25-2015 09:20 PM
Last Visited	‎08-03-2020 02:41 AM
Total Messages Posted	142
Total Kudos Received	56

Re: Cloudbreak Workspace: doing things for other u...

Re: Is it possible to add a new instance group to ...

Re: Cloudbreak downscale fails when no Datanodes i...

Re: Cloudbreak Azure, Can't create stack via CLI f...

Re: Change Default HDP Repositories during UI clus...

Re: Cloudbreak HDF cluster resizing

Re: Cloudbreak Workspace: doing things for other u...

Re: when we deploy cloudbreak HDP on AWS will the...

Re: when we deploy cloudbreak HDP on AWS will the...

Re: Infrastructure creation issue in GCP with Clou...

Re: Is it possible to add a new instance group to ...

Re: Cloudbreak downscale fails when no Datanodes i...

Re: Cloudbreak - Premium locally-redundant storage...

Re: Cloudbreak - Premium locally-redundant storage...

Re: Infrastructure creation issue in GCP with Clou...

Re: Unable to create JSON for custom deployment

Re: Unable to create JSON for custom deployment

Re: Cloudbreak fails to create my cluster on AWS

Re: Cloudbreak fails to create my cluster on AWS

Re: How to configure HDP2.6 to use S3?

Re: Enable Auto-scaling through Cloudbreak UI

Re: Enable Auto-scaling through Cloudbreak UI

Re: How to configure HDP2.6 to use S3?

Re: How to configure HDP2.6 to use S3?

Re: Cloudbreak verbose logging - RuntimeException:...

Re: Cloudbreak & Atlas installation error when usi...

Re: I am using EC2 , RDS and S3 .can anyone tell m...

Re: HDC - unable to launch cluster

Re: Cloudbreak Azure, Can't create stack via CLI f...

Re: Cloudbreak Azure, Can't create stack via CLI f...

Re: Get error trying to install jupyter in HDP2.5

Re: Trying to install jupyter in HDP2.5

Re: Change Default HDP Repositories during UI clus...

Re: [CloudBreak] Scale DOWN when 1 node is useless...

Re: [CloudBreak] Scale DOWN when 1 node is useless...