Member since
01-21-2016
14
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
5154 | 03-14-2016 11:27 AM |
03-21-2017
01:13 AM
Thanks! I will put this in the cluster config and try: ... YARN { yarn_service_config_safety_valve: """ <property> <name>yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds</name> <value>3600</value> </property> """ } ...
... View more
03-19-2017
12:06 PM
Is there any way to set advanced configuration snippets in Director's cluster.config? (that are not listed here https://www.cloudera.com/documentation/enterprise/properties/5-9-x/topics/cm_props_cdh590.html) e.g. yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds=3600
... View more
Labels:
- Labels:
-
Apache YARN
02-24-2017
11:32 AM
makes sense. thanks a lot!
... View more
02-23-2017
11:22 AM
After provisioned the cluster via Cloudera Director, all the service names appear to be random: e.g. "CD-ZOOKEEPER-ftOlmEAM": ..../api/v13/clusters/[cluster_name]/services/ ... {
"name" : "CD-ZOOKEEPER-ftOlmEAM",
"type" : "ZOOKEEPER",
"clusterRef" : {
"clusterName" : "platform-pod1-dev-cdh"
},
"serviceUrl" : "http://ip-10-0-1-121.us-west-2.compute.internal:7180/cmf/serviceRedirect/CD-ZOOKEEPER-ftOlmEAM",
"roleInstancesUrl" : "http://ip-10-0-1-121.us-west-2.compute.internal:7180/cmf/serviceRedirect/CD-ZOOKEEPER-ftOlmEAM/instances",
"serviceState" : "STARTED",
"healthSummary" : "GOOD",
"healthChecks" : [ {
"name" : "ZOOKEEPER_CANARY_HEALTH",
"summary" : "GOOD",
"suppressed" : false
}, {
"name" : "ZOOKEEPER_SERVERS_HEALTHY",
"summary" : "GOOD",
"suppressed" : false
} ],
"configStalenessStatus" : "FRESH",
"clientConfigStalenessStatus" : "FRESH",
"maintenanceMode" : false,
"maintenanceOwners" : [ ],
"displayName" : "ZOOKEEPER-1",
"entityStatus" : "GOOD_HEALTH"
} ... v.s. cluster provisioned via Cloudera Manager wizzard, the service name is very predictable... {
"items" : [ {
"name" : "zookeeper",
"type" : "ZOOKEEPER",
"clusterRef" : {
"clusterName" : "cluster"
},
"serviceUrl" : "http://ip-10-110-1-204.ec2.internal:7180/cmf/serviceRedirect/zookeeper",
"serviceState" : "STARTED",
"healthSummary" : "GOOD",
"healthChecks" : [ {
"name" : "ZOOKEEPER_CANARY_HEALTH",
"summary" : "GOOD"
}, {
"name" : "ZOOKEEPER_SERVERS_HEALTHY",
"summary" : "GOOD"
} ],
"configStale" : false,
"maintenanceMode" : false,
"maintenanceOwners" : [ ],
"displayName" : "ZooKeeper"
} This makes it very difficult to build automation around Manager REST APIs. For example, download client-conif: http://cloudera.github.io/cm_api/apidocs/v13/path__clusters_-clusterName-_services_-serviceName-_clientConfig.html Is there any way to config this in Director's cluster config or rename the service after provisioning?
... View more
Labels:
03-14-2016
11:27 AM
Thanks for your help! It finally works now! Turns out that "normalizeInstance" has to set to true. It's a bit confusing though as in the comment it says the following and I thought most of them are already done in the preloaded AMI. # Normalization includes: # downloading and installing packages # minimizing swappiness # increasing the maximun number of open files # mounting ephemeral disks # resizing the root partition. I will modify the packer scripts to download additional parcels we need. It will be great if you add support semi-preloeaded AMI so small parcels can be downloaded during provisioning.
... View more
03-14-2016
12:32 AM
Still seeing "java.lang.IllegalArgumentException: CDH=5.5.1-1.cdh5.5.1.p0.11 not found in list of all parcels. ..." Replied inline and thank you again for diagnose this with me! A couple other places to check on your system: Could you pull up the Cloudera Manager log to see if there are any errors around finding the parcel? In mine, after it starts Jetty server, I see this line "Discovered parcel on CM server: CDH-5.5.1-1.cdh5.5.1.p0.11-el6.parcel". Does your log have any errors around finding the parcel? I see the following in the log but there's no "Discovered parcel on CM server..." as yours: 2016-03-14 03:08:28,698 INFO ParcelUpdateService:com.cloudera.parcel.components.LocalParcelManagerImpl: Found files CDH-5.5.1-1.cdh5.5.1.p0.11-el6.parcel under /opt/cloudera/parcel-repo and I found the following error in the log. Are those related? 2016-03-14 03:08:27,311 WARN MainThread:org.springframework.web.client.RestTemplate: GET request for "http://169.254.169.254/latest/meta-data/public-hostname" resulted in 404 (Not Found); invoking error handler 2016-03-14 03:08:27,312 ERROR MainThread:com.cloudera.server.web.cmf.cloud.EC2MetadataFetcher: Request to EC2 metadata failed: 404 Not Found ... 2016-03-14 03:07:08,536 ERROR main:org.hibernate.engine.jdbc.spi.SqlExceptionHelper: ERROR: relation "cm_version" does not exist Position: 21 2016-03-14 03:07:08,538 WARN main:com.cloudera.server.cmf.bootstrap.EntityManagerFactoryBean: Failed to determine prior version, assuming no upgrade: org.hibernate.exception.SQLGrammarException: could not extract ResultSet In the CM UI, top nav, there is an icon for parcels. Under this, do you see any errors? I don't see any errors but only: CDH 5 5.5.1-1.cdh5.5.1.p0.11 Downloaded On this page if you click on Edit Settings, does the local parcel repository path show /opt/cloudera/parcel-repo and remote path show http://archive.cloudera.com/cdh5/parcels/5.5.1/ ? Yes, those two settings are correct. If you check the CM API for parcels, what does it return? http://<cm>:7180/api/v11/clusters/<clustername>/parcels Here are the response from http://10.0.1.242:7180/api/v11/clusters/platform/parcels { items: [ { product: "CDH", version: "5.5.1-1.cdh5.5.1.p0.11", stage: "DOWNLOADED", clusterRef: { clusterName: "platform" } } ] }
... View more
03-13-2016
08:21 PM
Thank you very much for the the response Jayita! I will definitely give it another try in the morning. But we have a couple of questions regarding the cluster config for director: 0. is there any particular settings have to be set in order to work with the pre-loeaded ami? 1. in the instance settings, do we have to turn normalizeInstance off? normalizeInstance: false 2. what if we need to setup additional parcels, do we need to do it in the pre-loaded scripts as well? products { CDH: 5.5.1 CLABS_PHOENIX: 4.5.2 KAFKA: 2.0.0 } parcelRepositories: ["http://archive.cloudera.com/cdh5/parcels/5.5.1/", "http://archive.cloudera.com/cloudera-labs/phoenix/parcels/1.2/", "http://archive-primary.cloudera.com/kafka/parcels/2.0.0/"] Thanks, WZ
... View more
03-08-2016
11:42 AM
thanks a lot for your respons! a. we are using the following parcel url "parcel_url": "https://archive.cloudera.com/cdh5/parcels/5.5.1/CDH-5.5.1-1.cdh5.5.1.p0.11-el6.parcel", b. just lauched the instance using the baked AMI, and here are those dir showing. (note that parcels are empty because PREEXTRACT_PARCEL flag are set to false) [ec2-user@ip-10-0-1-254 ~]$ ll /opt/cloudera/parcel-cache/ total 1453120 -rw-r--r--. 2 root root 1487987897 Mar 6 04:17 CDH-5.5.1-1.cdh5.5.1.p0.11-el6.parcel [ec2-user@ip-10-0-1-254 ~]$ ll /opt/cloudera/parcel-repo/ total 1453124 -rw-r--r--. 2 root root 1487987897 Mar 6 04:17 CDH-5.5.1-1.cdh5.5.1.p0.11-el6.parcel -rw-r--r--. 1 root root 41 Mar 6 04:17 CDH-5.5.1-1.cdh5.5.1.p0.11-el6.parcel.sha [ec2-user@ip-10-0-1-254 ~]$ ll /opt/cloudera/parcels total 0 Thanks!
... View more
01-22-2016
12:14 PM
Thanks for your reply! I'm using the latest Cloudera Director and Manager 2.0.0 and 5.5.1 We have the following settings in the config which looks correct for me but it never worked with the preloaded AMI ... repository: "http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.5.1/" repositoryKeyUrl: "http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/RPM-GPG-KEY-cloudera" ... products { CDH: 5.5.1 } parcelRepositories: ["https://archive.cloudera.com/cdh5/parcels/5.5.1/"] ...
... View more