I have a Yarn+Spark cluster installed with Ambari (126.96.36.199-235). Upon this cluster I run Jupyter Notebook as a service.
On a notebook, I connect to Spark using
findSpark , I am getting a flood of error messages in the log:
jupyter: [dispatcher-event-loop-1] INFO org.apache.hadoop.yarn.util.RackResolver - Resolved <machine-ip> to /default-rack
I found this Jira task discussing exactly this problem, but I am not sure what is the easiest way to update this.
Is there any log4j file I can just update to disable RackResolver messages to notebooks?