Support Questions

Find answers, ask questions, and share your expertise

YARN Exception: Could not determine the proxy server for redirection

We are running a cluster with HDP
YARN is configured for HA with two Resourcemanagers.

When I run a spark-shell session and want to access the tracking URL of the Spark UI on the server where I started the spark-shell, I get the following error:

Problem accessing /. Reason:
    Server Error
Caused by:
javax.servlet.ServletException: Could not determine the proxy server for redirection
	at org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter.findRedirectUrl(
	at org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter.doFilter(
	at org.spark_project.jetty.servlet.ServletHandler$CachedChain.doFilter(
	at org.spark_project.jetty.servlet.ServletHandler.doHandle(
	at org.spark_project.jetty.server.handler.ContextHandler.doHandle(
	at org.spark_project.jetty.servlet.ServletHandler.doScope(
	at org.spark_project.jetty.server.handler.ContextHandler.doScope(
	at org.spark_project.jetty.server.handler.ScopedHandler.handle(
	at org.spark_project.jetty.server.handler.gzip.GzipHandler.handle(
	at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(
	at org.spark_project.jetty.server.handler.HandlerWrapper.handle(
	at org.spark_project.jetty.server.Server.handle(
	at org.spark_project.jetty.server.HttpChannel.handle(
	at org.spark_project.jetty.server.HttpConnection.onFillable(
	at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(
	at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(
	at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(
	at org.spark_project.jetty.util.thread.QueuedThreadPool$

However, the shell is working fine and I can also access the Spark UI following the link to the ApplicationMaster in the Resourcemanager UI.

We didn't have this problem before and I assume it started to exist after configuring YARN for HA (using Ambari wizzard).
Attached you can find the yarn-site.xml (exported with Ambari).

Is there any misconfiguration or does somebody know this problem?



Hi @Alexander Schätzle,

We had a jira for the same issue -

The fix went into HDP - But I am not sure about the exact build number. May be you can try with HDP- repo.


Ok, thanks for the hint, that seems to be the reason!

How can I find out which is the latest build number of I checked the github repo ( but the numbering is a bit confusing.

I can see that the latest release of 2.6.3 is but which build number is this? And is it possible to upgrade the installed build of 2.6.3 (build 235 in our case) to the latest version of 2.6.3?

Another question. The release notes of HDP 2.6.3 lists the patch for YARN-7269 as included in HDP 2.6.3. Should this not mean that it is included in the "official" version in the public repo? The build version in the public repo is 235. So if the patch is not included in build number 235, is the information in the release notes than not very confusing or even incorrect?


I checked the source code of HDP and I see that the code changes applied in the patch for are already present.

Do you see any other reason why this error then still happens?

Is there nobody with the same issue?

New Contributor

I see the same issue when I execute jupyter-console with pyspark kernel. Please see the attach.


I was not able to fix this issue up to now. The only solution I found currently is to disable Resource Manager HA.

New Contributor

Hi Alex, were you able to get this fixed ? I am getting similar error for hive on tez

javax.servlet.ServletException: Could not determine the proxy server for redirection
	at org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter.findRedirectUrl(
	at org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter.doFilter(
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(
	at org.apache.hadoop.http.HttpServer2$QuotingInputFilter.doFilter(
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(
	at org.apache.hadoop.http.NoCacheFilter.doFilter(
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(
	at org.eclipse.jetty.servlet.ServletHandler.doScope(
	at org.eclipse.jetty.server.session.SessionHandler.doScope(
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(
	at org.eclipse.jetty.server.handler.HandlerCollection.handle(
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(
	at org.eclipse.jetty.server.Server.handle(
	at org.eclipse.jetty.server.HttpChannel.handle(
	at org.eclipse.jetty.server.HttpConnection.onFillable(
	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(
	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
	at org.eclipse.jetty.util.thread.QueuedThreadPool$



Community Manager

As this is an older post you would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question. 

Cy Jervis, Manager, Community Program
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.