Member since
08-22-2014
45
Posts
9
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1523 | 08-20-2019 08:56 AM | |
25045 | 10-14-2016 10:25 AM | |
25070 | 10-11-2016 02:00 PM | |
2334 | 05-29-2015 10:43 AM | |
35554 | 05-12-2015 09:59 AM |
08-20-2019
08:56 AM
1 Kudo
Hi VikramD, Thanks for reaching out. Regarding your question: > If the rack awareness topology is changed, would HDFS kick-off immediate Block movement > or the new topology will only be effective for NEW blocks written on the cluster? The new topology will be applied when new blocks are written, and should not automatically trigger an event for all existing blocks. However, depending on your existing configuration, the HDFS Balancer will utilize the current rack awareness configuration, such that when it (the HDFS Balancer) is run, it will read the existing blocks and rebalance them based on the current rack awareness topology.
... View more
07-25-2018
06:58 PM
Glad to hear, have a wonderful day!
... View more
07-24-2018
07:04 AM
Hi Kostas, As a follow up from my colleague's post, were you able to create a cluster on Azure successfully?
... View more
04-09-2018
10:03 AM
2 Kudos
Symptoms When attempting to create a Cloudera Altus cluster in AWS, it fails with INTERNAL_CM_CMD_FAIL
Diagnosis CM Deployment is failing at the creation / deployment of CM services due to incorrect or unexpected DNS hostnames of the AWS EC2 instances created for Cloudera Altus. Cloudera Altus requires the options DNS hostnames and DNS resolution are enabled (set to yes) within the AWS VPC settings
Solution Set and confirm DNS hostnames and DNS resolution are set to yes in the AWS VPC used for Cloudera Altus. Details for configuring AWS VPCs with DNS is available here: https://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/vpc-dns.html Once the AWS VPC DNS settings of the Cloudera Altus Environment are enabled, ensure to delete the previous cluster creation attempt's EC2 instances, both within a Cloudera Altus console, as well as through the AWS EC2 interface Retry creating a new Cloudera Altus cluster with the updated settings
... View more
Labels:
08-29-2017
05:54 AM
Hi @uzubair,
Thanks for raising this to our attention.
You may be able to check the S3 bucket (if configured) for log output that may help with determining why the described symptoms occurred.
Given the nature of this issue, are you able to create a support case through the Altus Web UI (Altus Web UI -> Support -> Support Center -> Technical Support; Component = Altus Data Engineering; Sub-Component = Clusters)?
Would you be able to provide some additional details within the support case as well, in particular:
The output of the following command as well (if you have the Altus CLI installed):
$ altus dataeng describe-clusters --cluster-name <cluster_name>
Cluster Creation time
# of Workers and Computer workers created, and if spot instances were used
Was there an Instance Bootstrap Script used? If so can you attach that to the Support Case as well?
Has any other Cluster creations failed in this same manner recently, or has this only been a single manifestation?
Kind Regards,
Anthony
... View more
04-25-2017
07:27 AM
4 Kudos
Symptoms When attempting to access a running cluster via SSH, the connection times out or is rejected
Applies To All versions of clusters managed by Cloudera Altus
Cause Update needed for AWS Security group, as the incoming SSH connection originating for client machine may not be included on the defined cluster's AWS Security Group incoming connections
Troubleshooting Steps This issue can typically occur if the AWS security group configured for does not contain an updated IP from the connecting client. To alleviate this issue, please perform the following steps which will add the IP address(es) needed to connect to the appropriate AWS security group: Login to AWS Select the Appropriate Region in the top-right hand corner, (i.e. US West (Oregon)). Navigate to EC2 Under Resources, click on Security Groups Locate the corresponding Cloudera Altus Security Group configured; For a particular cluster in question, narrow down the options filtering by Group ID. Click on the Security Group, which will then list the Description of the group in the lower portion of the window. Click on the Inbound tab, then Edit. Click on Add Rule, select SSH as the Type which also sets TCP as the Protocol, and the Port Range to 22. Adjust this if needed. Under Source, select one of the options, My IP or Custom, depending on the usage requirements (see notes below) NOTE: Please review the current incoming list if there are multiple My IP entries as some of these may be outdated and may be removed. Please check with your AWS administrator if needed. Click on Save to save changes, which will be implemented immediately. NOTES: My IP is good for setting a single IP address that is identified from the existing web connection to the AWS Web UI. This will be the external address identified from your current machine. If more flexibility is needed, please consider using Custom. While My IP is useful for setting a single IP, there can be administration challenges when the incoming IP address is dynamically allocated, requiring an update to the AWS security group each time the client workstation's IP changes. If the DHCP pool or list of IP addresses is know, using a Custom setting can help reduce the amount of administration required in keeping the Security Group up-to-date. Using a Custom setting, ensure to set the CIDR block for the given range of known IP addresses. Per AWS: Specify a single IP address, or an IP address range in CIDR notation (for example, 203.0.113.5/32). If connecting from behind a firewall, you'll need the IP address range used by the client computers.
References
... View more
Labels:
04-19-2017
03:02 PM
Question What steps should a Cloudera Altus administrator take if a Cloudera Altus end-user leaves their company, or should no longer have access to Cloudera Altus?
Answer If a user leaves their company, a Cloudera Altus administrator will need to delete the Cloudera Altus CLI Keys and remove user access from the Web UI to prevent unauthorized access.
... View more
04-19-2017
02:59 PM
1 Kudo
Question Where are Cloudera Altus Clusters created and how are Data Engineering jobs run?
Answer Clusters are spun up and reside within customer's public cloud account. For example, in case of AWS, EC2 instances are spun-up and managed by Cloudera Altus in the subnet and VPC specified by customer created environment; These clusters handle specific Data Engineering workloads (Hive-on-Spark, Spark-on-YARN, MR2 on YARN, etc).
... View more
Labels:
04-19-2017
02:53 PM
1 Kudo
Question What are the various Cloudera Altus interfaces available and how can I access them?
Answer Cloudera Altus is accessible via command line interface (CLI), console / graphical user interface (GUI) and via a software development kit (SDK) for use with Java. The Cloudera Altus Web console is available via: https://console.altus.cloudera.com/ Instructions for installing the Cloudera Altus CLI is available here (link to Cloudera Altus CLI Documentation) Additional details for the Cloudera Altus SDK and coding examples are available here (link to Cloudera Altus SDK) Additional details on interfaces are available in the Cloudera Altus Interfaces section of the Cloudera Altus Documentation.
... View more
04-19-2017
02:43 PM
Question Are there any current limitations with Cloudera Altus?
Answer Default limit for commercial have the following default soft-limits: Up to 10 active clusters at any given time Limit of 100 users Limit of 10 defined Cloudera Altus environments If there are needs required that will utilize beyond the current soft-limits, please reach out to Cloudera Support to request an increase. Users that are given access as part of a free trial will have no ability to create additional users and may have smaller limits.
... View more