Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Optimum size of application logs for Spark Streaming on YARN

Highlighted

Optimum size of application logs for Spark Streaming on YARN

Contributor

I have Spark Streaming jobs running on the cluster, When I want to see te container logs, its too slow to load in the esourceManager WebUI. Is there a optimum size to set up the file size and is there a best way to look at the streaming job logs other than ResourceManager WebUI?

 

Suri

Don't have an account?
Coming from Hortonworks? Activate your account here