Support Questions
Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Logging Spark Jobs with log4j

Highlighted

Logging Spark Jobs with log4j

oirasor
New Contributor

Created ‎01-18-2019 01:35 PM

Hi!

We need to log Spark jobs with log4j, saving the output into an external logfile in HDFS (we want to separate the application log from the native YARN logs).

We do not have Apache Flume and Apache Kafka on our cluster. (HDP 3) so we are looking for HDFS appender to use with log4j.

Any suggestions?

Thanks in advance.

R.A.

Reply
50 Views
0 Kudos
Tags (2)
Don't have an account?
Register
Coming from Hortonworks? Activate your account here