Member since
07-08-2013
548
Posts
59
Kudos Received
53
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2560 | 08-17-2019 04:05 PM | |
2541 | 07-26-2019 12:18 AM | |
8789 | 07-17-2019 09:20 AM | |
4982 | 06-18-2018 03:38 AM | |
12412 | 04-06-2018 07:13 AM |
06-11-2017
05:13 PM
1 Kudo
Since you did not specify which approach, I had a python console open and below seems to return what may be looking for. from cm_api.api_client import ApiResource
api = ApiResource(server_host="cloudera-manager.host.com",version=12)
cluster = api.get_cluster("___REPLACE_ME_WITH_CLUSTER_NAME__")
for host in api.get_all_hosts(view='full'): # List (rolename,servicename,hostname) from all host where service name = impala print [(x.roleName,x.serviceName,host.hostname) for x in host.roleRefs if "impala" in str(x.serviceName).lower()]
... View more
05-29-2017
10:24 AM
1 Kudo
You might want to try refreshing the ResourceManager (RM) from the UI. That would be going to CM> YARN> Instances> RM> [Actions]> Refresh RM; With the API this would be Commands>Refresh see [0] and python [1] "For YARN services, this command should be executed on ResourceManager roles. It refreshes the role's queue and node information." Let me know if this works for you. [0] https://cloudera.github.io/cm_api/apidocs/v16/path__clusters_-clusterName-_services_-serviceName-_roleCommands_refresh.html [1] https://github.com/cloudera/cm_api/blob/master/python/src/cm_api/endpoints/services.py#L824-L831
... View more
03-13-2017
07:27 AM
There seems to be issues around update-alternatives command. Which is often caused by a broken alternatives link under /etc/alternatives/ or a bad (zero length, see [0]) alternatives configuration file under /var/lib/alternatives, and based on your description it appears to be the former.
The root cause is that Cloudera Manager Agents relies in the OS provided binary of update-alternatives, however the binary doesn't relay feedback on bad entries or problems, therefore we have to resort to manually rectifying issues like these. We have an internal improvement JIRA OPSAPS-39415 to explore options on how to make alternatives updates during upgrades more resilient.
To recover from the issue, you would need to remove CDH related entries from alternatives configuration files.
[0] https://bugzilla.redhat.com/show_bug.cgi?id=1016725
= = = = = = =
# Stop CM agent service on node
service cloudera-scm-agent stop
# Delete hadoop /etc/alternatives - below will displays the rm command you'll need to issue.
ls -l /etc/alternatives/ | grep "\/opt\/cloudera" | awk {'print $9'} | while read m; do if [[ -e /var/lib/alternatives/${m} ]]; then echo "rm -fv /var/lib/alternatives/${m}"; fi; echo "rm -fv /etc/alternatives/${m}"; done
# Remove 0 byte /var/lib/alternatives
cd /var/lib/alternatives
find . -size 0 | awk '{print $1 " "}' | tr -d '\n'
# The above command will give you a multi-line output of all 0 byte files in /var/lib/alternatives. Copy all the files, and put into the rm -f
rm -f
# Start CM agent
service cloudera-scm-agent start
= = = = = = =
... View more
02-01-2017
07:51 PM
> I was away from my Cloudera cluster for a bit and the Enterprise trial expired in the mean time. When a Cloudera Enterprise license expires, the following occurs: [0] - Cloudera Enterprise Enterprise Data Hub Edition Trial - Enterprise features are no longer available. see Table [1]
- Cloudera Enterprise - Cloudera Manager Admin Console displays a banner indicating license expiration. Contact Cloudera Support to receive an updated license. In the meanwhile, all enterprise features will continue to be available. Is your CDH deployment packaged based or parcel? Do you know what your yum update performed, if it updated any CDH/Cloudera packages? Can you check your yum logs /var/log/yum.log? How did you determined that everything is _kaput_, is there any error/stack trace that you can share? Best, Michalis [0] https://www.cloudera.com/documentation/enterprise/latest/topics/cm_ag_licenses.html#cmug_topic_13_7__section_ed1_nz1_wr [1] https://www.cloudera.com/documentation/enterprise/latest/topics/cm_ig_feature_differences.html
... View more
10-28-2016
02:27 PM
It's commonly found on the host where you have installed the cloudera-manager-server-db2 package, and physical location is /var/lib/cloudera-scm-server-db/data
... View more
10-28-2016
02:23 PM
Minor correction POST meant to be PUT but I trust you've figured this out.
... View more
10-26-2016
09:39 AM
1 Kudo
Hi AnandMS, From what I can tell the pg_dump command expects pg_dump [connection-option...] [option...] [dbname] see https://www.postgresql.org/docs/9.1/static/app-pgdump.html grep -oE 'db.(user|name)=.*' /etc/cloudera-scm-server/db.properties in my environment give me the followig output. db.name=scm
db.user=cloudera-scm threfore db.user I set in -U cloudera-scm followed by scm. effectively your command should look like # pg_dump -h hostname -p 7432 -U cloudera-scm scm > /tmp/scm_server_db_backup.$(date +%Y%m%d)
... View more
10-25-2016
06:43 PM
You'll need to POST to the relevant name/values in the roleConfigGroup [0] endpoint. Modify the configuration in the CM UI and then check the changes in that you've made by doing [1]. Then you should be able to use it in your curl -X POST [...] [0] https://cloudera.github.io/cm_api/apidocs/v13/path__clusters_-clusterName-_services_-serviceName-_roleConfigGroups_-roleConfigGroupName-_config.html [1] curl -X GET http://<server>:7180/api/v13/clusters/Cluster1/services/<servicename>/<servicename>/roleConfigGroups
... View more
10-14-2016
08:23 AM
I've checked our internal codebase, and it would appear to be MIA for a while. Happy to report that it's available in our latest v12 (v5.7 [0]) python API [1] . [0] http://cloudera.github.io/cm_api/docs/releases/ [1] https://github.com/cloudera/cm_api/blob/cm5-5.7.0/python/src/cm_api/endpoints/clusters.py#L624-L631
... View more
07-01-2016
09:40 AM
Within Cloudera Manage you could use the Custom Kerberos Keytab Retrieval Script, an example script is documented here http://www.cloudera.com/documentation/enterprise/latest/topics/sg_keytab_retrieval_script.html
... View more