Member since
01-27-2019
3
Posts
0
Kudos Received
0
Solutions
01-28-2019
08:10 PM
Hi @Geoffrey Shelton Okot, As I pointed out in my 1st post, I have already mounted "/var/lib" as fuse mount. I could see the /var/lib mount as fuse mount on entering "df -lh" command. Also, I could do a successful 'ls /var/lib' directory after mount. I don't think mount has any issues here as I could observe yarn resource manager service running successfully after the mount. Please note: /var/lib is the parent directory where Yarn RM, NM, Samza, my applications are writing. Since, I have mounted /var/lib as the fuse mount, all the other applications could run with no issues. Procedure I followed before I mount /var/lib as fuse mount point is: I have created a directory "/var/myapp/lib/". Stopped all the processes including yarn RM, Samza jobs, Hdfs NM. Copied all the files (cp -rfp to retain file ownership and permissions as it is) from /var/lib to "/var/myapp/lib/". Mounted the /var/lib pointing to the data directory "/var/myapp/lib/". After the above said operation, I could see all the processes starting with no issues except HDFS NM and samza job processes. The errors observed in the logs are quoted in my 1st post in this question. I wanted to understand, if the procedure I'm following is correct as the HDFS NM process is crashing with the message "recovering". Wondering if I'm missing any steps.
... View more