Member since
09-21-2015
11
Posts
0
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3638 | 05-27-2016 10:48 AM | |
2876 | 05-24-2016 11:05 AM |
05-27-2016
10:48 AM
Hi kartikbha, I asked what we do and we mount them as /data0, /data1, ... etc It was mentioned that they are used for hdfs data.
... View more
05-26-2016
01:31 PM
Re: #2, I just asked and the root volume size that you specify in the config file is for an EBS backed volume.
... View more
05-26-2016
01:12 PM
Hi Kartikbha, When defining a config, the instances section is basically a set of instance templates that you are defining. So for your worker group, you could define a worker template, and your master group would use the master template. Given this separation, you would assign the worker template to your worker cluster group definition. instances { worker-instance { type: d2.2xlarge rootVolumeSizeGB: 100 # 100GB ... } master-instance { type: super.powered.xxxlarge } } .... cluster { masters { instance: ${master-instance} } workers { instance: ${worker-instance} } } I think that EBS root volume type is specific to the ami you choose. Looking at the aws documentation: https://aws.amazon.com/ec2/instance-types/ It looks like d2.2xlarge doesn't say anything about EBS, so I may be assuming incorrectly but I don't think it is of the EBS kind.
... View more
05-24-2016
11:05 AM
http://www.cloudera.com/documentation/director/latest/topics/director_security_socks.html
... View more
05-24-2016
10:05 AM
not sure if the problem is dns or tunneling, or both does nslookup ip-10.0.0.106.ec2.internal return an ip address? If you change the hostname to the ip address: http://10.0.0.106:8088/cluster/app/application_1463741301226_0001 does that route? If it doesn't route, maybe you have to setup another ssh tunnel or a socks proxy Let me know your findings
... View more