We upgraded our cluster from 5.4 to 5.8.2 version, and after the upgrade we have some problem with Job Browser in the HUE.
The problem is that I can see the running jobs in the YARN resource manager UI, but I don't know why I can't see running jobs in the Hue.
I have googled a lot, but couldn't find anything related to it.
The only thing that I have found is the yarn resource manager format state store.
So I have executed following:
#1
stop ressource manager (yarn)
#2
yarn resourcemanager -format-state-store
#3
start ressourcemanager (yarn)
After this the problem has been solved.
But after some time (around 3-4 days) the issue appeared again.
I could reproduce this problem in two different environments.
Do you have some ideas ?
Thanks in advance!