Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Link to history server point to old location. How to clear cache and fix it?

Link to history server point to old location. How to clear cache and fix it?

New Contributor

Hi.

I extend existed cluster and migrate Spark2 History Server from one host to another.
I have a problem with web link from spark streaming job history, when i click resource manager -> Applications -> finished and history link. This link point to old history server location.

New jobs have correct uri. And you can download spark-defaults.conf from host with correct host address spark.yarn.historyServer.address=server-node13.p:18080


I found old uri located in cache by path yarn.nodemanager.local-dirs, wich in my case:

cat /mnt/disk10/yarn/local/usercache/hadoop/filecache/21525/_spark_conf.zip/spark_conf_.properties
spark.yarn.historyServer.address=server-main3.p\:18081

So i clear cache dir on all local-dirs, /mnt/disk10/yarn/local/usercache and /mnt/disk10/yarn/local/filecache , but there is no effect

Please help me clear old address without application renaming. Thx.

Don't have an account?
Coming from Hortonworks? Activate your account here