Member since
09-28-2013
8
Posts
1
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
19611 | 08-20-2015 09:23 AM | |
8746 | 05-08-2015 08:58 AM | |
20551 | 03-13-2014 10:44 AM |
09-01-2015
08:41 AM
You should not do this yourself. You can control the amount of space that CM consumes in these directories via the Time-Series Storage configuration of HMON and SMON. There's a 10 GB minimum for both, meaning you can expect 20 GB to be consumed by these two roles eventually. It is possible, though discouraged to set a lower limit, though you have to use the cmon.conf safety valve. You can enter a number of bytes to use as a maximum -- something like below where XXX is the number of bytes. This requires an SMON or HMON restart, but it should very quickly cleanup to the limit specified. Again, this is something we don't really test with outside of some dev clusters, so proceed with caution. firehose_time_series_storage_bytes XXX chris
... View more
08-20-2015
09:23 AM
1 Kudo
You can kill the query from the Impala Daemon web UI of the Impala Daemon coordinating the query. You can see that from CM if you don't know it already. Any chance you can send me the CM server log so we can identify the error being hit when trying to cancel from the CM UI? Thanks, chris
... View more
05-08-2015
08:58 AM
Good to know. Yes, I believe this can happen if the agents have not been upgraded to CM 5.4. Impala changed the URL from which to fetch metrics in CDH 5.4 the correspondin change to the CM agent is in CM 5.4. Thanks for your help nailing this down. chris
... View more
05-08-2015
08:38 AM
Thnaks. That's helpful. I've got a few more questions: #1. What version of Impala are you running? If you hit 'XXX/jsonmetrics' on the catalog server web UI what do you see? What about 'XXX/jsonmetrics?json'. #2. Can you confirm that the CM agent process running is 5.4? That is: when you upgraded to 5.4 did you both upgrade the CM agent software and restart the CM agent software (service cloudera-scm-agent restart). #3. Can you post the contents of the cloudera-monitor.properties for the catalog server? You can get this by going to the catalog server status page -> processes tab -> configuration files -> cloudera-monitor.properties.
... View more
05-07-2015
10:20 PM
Could you post the exact text or a screenshot of the alert you're seeing? If you could post or email me the CM agent.log (/var/log/cloudera-scm-agent.log) that might help narrow this down as well. We did make a change in this area in CM 5.4, but it was to make monitoring of the TLS enabled Catalog Server web UI work properly.
... View more
03-13-2014
10:44 AM
Yes, 10 GB is the minimum value here, and yes both the Host Monitor and Service Monitor have a setting like this. So yes, the VM hosting your Service Monitor needs a volume to hold this store which will grow to approximately 10 GB over time. So does the VM hosting your Host Monitor. If it's the same VM, then you'd need 20 GB on that node. Note that things will perform much better if the Host Monitor and Service Monitor storage directories are on different volumes.
... View more