Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

What is the Cloudera Production cluster maintenance activities and time frames?

Solved Go to solution
Highlighted

What is the Cloudera Production cluster maintenance activities and time frames?

New Contributor

Community,

 

Any best practices for the maintenance for production clusters. When we should restart the services generally? - weekly once or monthly once.

 

Cleaning up log files. 

And, also found that yarr logs in HDFS not get deleted according to the retention period. Ref: YARN logs under /tmp/logs/{user.name}/logs not cleared properly

 

Note: Mainly looking for a cluster in Bank, with regular ingestion using Sqoop and analytics using spark and impala.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: What is the Cloudera Production cluster maintenance activities and time frames?

Guru
Hi Vinod,

You should NOT need to restart services on weekly or monthly basis, unless you have scheduled maintenance work like making configurations changes. CDH services are expected to continue their services without the need to restart, unless you face any issues like memory pressure, crashing etc, which will require further investigation.

Regarding YARN aggregation log not cleared properly, please refer to below post and KB:

https://community.cloudera.com/t5/Support-Questions/Yarn-Aggregate-Log-Retention-Setting/m-p/81382
https://my.cloudera.com/knowledge/YARN-logs-under-tmp-logs-user-name-logs-not-cleared-properly?id=75...

Cheers
Eric

View solution in original post

1 REPLY 1
Highlighted

Re: What is the Cloudera Production cluster maintenance activities and time frames?

Guru
Hi Vinod,

You should NOT need to restart services on weekly or monthly basis, unless you have scheduled maintenance work like making configurations changes. CDH services are expected to continue their services without the need to restart, unless you face any issues like memory pressure, crashing etc, which will require further investigation.

Regarding YARN aggregation log not cleared properly, please refer to below post and KB:

https://community.cloudera.com/t5/Support-Questions/Yarn-Aggregate-Log-Retention-Setting/m-p/81382
https://my.cloudera.com/knowledge/YARN-logs-under-tmp-logs-user-name-logs-not-cleared-properly?id=75...

Cheers
Eric

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here