10-01-2018 03:42 PM
My storage /var/lib/cloudera-scm-eventserver filling up because of following files. Can I delete them?
[root@ip-10-0-2-241 v3]# ls -alh | grep "G "
-rw-r----- 1 cloudera-scm cloudera-scm 5.9G Jul 13 05:09 _hiag.fdt
-rw-r----- 1 cloudera-scm cloudera-scm 1.5G Jul 23 05:25 _iovt.fdt
-rw-r----- 1 cloudera-scm cloudera-scm 1.5G Aug 2 04:16 _jxli.fdt
-rw-r----- 1 cloudera-scm cloudera-scm 1.5G Aug 11 09:27 _l84b.fdt
-rw-r----- 1 cloudera-scm cloudera-scm 1.5G Aug 18 20:15 _mc70.fdt
-rw-r----- 1 cloudera-scm cloudera-scm 1.5G Aug 27 02:17 _njxe.fdt
If I cannot can i move them to different partition? if yes, how can I do that?
Need your help.
10-01-2018 09:07 PM
Please refer to following - Cloudera recommended settings:
Cloudera Management Services - Event ServerEntity Event Server
Default Storage Location /var/lib/cloudera-scm-eventserver/ on the host where the Event Server role is configured to run
Storage Configuration Defaults 5,000,000 events retained
Where to Control Data Retention or Minimum /Maximum
The amount of storage space the Event Server uses is influenced by configuring how many discrete events it may retain.
To configure data retention in Cloudera Manager Administration Console, select Home > Cloudera Management Service > Configuration > Event Server Group and edit the following property:
Maximum Number of Events in the Event Server Store
The maximum size of the Event Server store, in events. Once this size is exceeded, events are deleted starting with the oldest first until the size of the store is below this threshold
Sizing, Planning, and Best Practices
The Event Server is a managed Lucene index that collects relevant events that happen within your cluster, such as results of health tests, log events that are created when a log entry matches a set of rules for identifying messages of interest and makes them available for searching, filtering and additional action. You can view and filter events on the Diagnostics > Events tab of the Cloudera Manager Administration Console. You can also poll this data using the Cloudera Manager API.
10-02-2018 08:51 AM
Thanks irobot. This helps. I am newbi to Cloudera.
Can I change the defalut Storage location of /var/lib/cloudera-scm-eventserver. Now it is taking around 17GB. I want to add additional storage and point to that storage.
Thanks once again.
10-02-2018 09:04 AM
You are welcome, I wont recommend changing the default location but you can give it a try.
Change the event server log location and then restart event server. Make sure it starts and runs correctly. Let me know how it goes.