Member since
10-28-2014
82
Posts
18
Kudos Received
17
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1781 | 07-11-2019 08:49 AM | |
4848 | 08-02-2018 12:20 PM | |
7125 | 06-19-2018 02:19 PM | |
3206 | 06-19-2018 08:32 AM | |
3032 | 12-21-2017 08:19 AM |
11-09-2017
01:34 PM
Tauqeer, Cloudera Director's API will provide what you need to add instances and replace data nodes. Master migration is a little trickier. Cloudera Director can help with creating instances for the migration, but you will have to perform the migration in Cloudera Manager. See https://www.cloudera.com/documentation/director/latest/topics/director_create_ha_clusters.html#migrate_hdfs_master_roles for information on how to use Cloudera Director when migrating masters. These tasks will mainly use Cloudera Director's "update" API. See https://github.com/cloudera/director-sdk/blob/master/java-client/src/main/java/com/cloudera/director/client/latest/api/ClustersApi.java#L549 or https://github.com/cloudera/director-sdk/blob/master/python-client/cloudera/director/latest/ClustersApi.py#L625 There are examples in both java and python to get you started. https://github.com/cloudera/director-sdk
... View more
11-09-2017
01:24 PM
David, Cloudera Director 2.5 changed the way it tags instances to include the tags on the runInstances request. This feature has not been added to the China region. I'm afraid that you will have to stay on 2.4.x until Amazon updates that region to support this features. A proxy server will work. Which yum packages are timing out? Here are other alternatives. You could create an ami with the packages pre-installed. https://github.com/cloudera/director-scripts/tree/master/faster-bootstrap You could host the parcels and packages. If you do this, then you will need to configure the custom repos when you create a Deployment or Cluster. https://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_create_local_package_repo.html https://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_create_local_parcel_repo.html Good Luck! David
... View more
09-28-2017
10:13 AM
Sankaranarayanan, Cloudera Director does not support proxy exclusions. This like likey most easily configured on your proxy server. The proxy server should have a configuration to not proxy local addresses. David
... View more
09-25-2017
09:42 AM
1 Kudo
ebeb, Cloudera Director is designed for provisioning cloud clusters and cannot create a mixed cloud/on-premise cluster. My initial thoughts on a mixed cluster is that network latency between the cloud nodes and on-premise nodes would lead to poor performance. You may be better served by creating two separate clusters and using some other mechanism for sharing data. For example, you can export/import data to S3.
... View more
07-05-2017
07:19 AM
Director uses the IP address and hostnames reported back by the cloud provider (e.g., AWS) to connect to the instance. If Director is inside the same VPC as the instance, this will be the internal IP address or private hostname. If Director is outside the VPC, then this will be the public IP or public hostname. Since these values come from the cloud provider, it is best for them to be set as you like when the instance is allocated. Some possible suggestions for doing so are to use a custom DNS server or to bake some hostname assignment logic into your AMI.
... View more
04-13-2017
09:09 AM
Yoga, I just tried to repro your problem and I see a BYON-specific instance template popup. One thing to note that may be confusing you is that Director requires an Type and Image field even though these concepts are not needed in BYON. Feel free to put anything you want in those fields. If you click on the "Advanced Options", you can specify the preferred hosts for that template. Director will attempt to pick a host from that list on a best effort basis. David
... View more
04-10-2017
08:05 AM
1 Kudo
David, The "bootstrap" and "bootstrap-remote" commands are completely different. The "bootstrap" command will create a deployment and cluster without a Director server, storing the models in a local database file. There is no way to re-use these models across multiple "bootstrap" commands. "bootstrap-remote" submits the deployment and cluster to a Director server and the models will be stored in the Director server database. See Cloudera Director Interfaces for more information about the distinction between the CLI and the Stand-alone Client. You can modify your workflow in the following manner: Please use the bootstrap-remote command in your step 1. In step 2, you can terminate the cluster in the Director UI. This will leave CM running. The existing CM will be re-used if you re-run bootstrap-remote with the same conf file or a different conf file that specifies the same "environmentName" and "deploymentName".
... View more
04-07-2017
11:42 AM
David, Director does not currently have a way to create only a Deployment (CM) using the conf file. Conf files must specify a Cluster. You can set the "environmentName" and "deploymentName" fields in subsequent conf files to re-use the same CM with future Clusters using the "bootstrap-remote" command. Cluster termination can be performed in the UI or API, while leaving the Deployment around. Also, if you have multiple Clusters under the same Deployment, using the terminate-remote command in the CLI to terminate a Cluster will NOT terminate the Deployment (as of Director 2.3). David
... View more
02-24-2017
08:32 AM
WZ, Service names must be globally unique in Cloudera Manager. Director appends random characters to ensure that this uniqueness when creating services in case there are multiple clusters created under the same Cloudera Manager. There is no way to turn off this randomization in Director at the moment and there is no way to rename a service in Cloudera Manager (you can rename the display name only). Since Director supports only a single instance of each service type, you can retrieve the list of services from Cloudera Manager and create a mapping from service type to service name for your cluster. In bash, you can use jq to process the service list to retrieve the service names. $ curl -u cmusername:cmpassword http://<cmhost>:7180/api/v15/clusters/<clustername>/services | jq -r '.items[] | "export \(.type)=\(.name)"' > export_service_names.sh
$ cat export_service_names.sh
export ZOOKEEPER=CD-ZOOKEEPER-asdna2f you can then script against well known servicename variables by sourcing this export_service_names.sh script. You can similarly retrieve the service names using the java client or python client.
... View more
10-28-2016
08:30 AM
1 Kudo
Anil, Can you describes the steps that you took to reach this point? What was the state of Director? Was this a fresh install? What was the command that you used to submit the aws.simple.conf to Director? I don't see any obvious reason why this error should have occured and would like some more information to see if we can diagnose or reproduce the behavior. David
... View more