question Re: Ambari change permission of /mr-history folder which lead to permission denied in logs of MapReduce2 in Archives of Support Questions (Read Only)

Ambari change permission of /mr-history folder which lead to permission denied in logs of MapReduce2

pavel_hladik — Fri, 22 Jan 2016 14:00:54 GMT

Hi,

I migrated Ambari from 2.1 to 2.2 and have a strange issue with folders permission, using HDP 2.0.6 (HDFS, YARN and MapReduce2 on 2.1.0.2) on CentOS 6. When I start MapReduce2 service through init.d script everything is working well, but when I would to start it through Ambari 2.2 it automatically change the permission of /app-logs and /mr-history folders on HDFS to:

dr----x--t - yarn   hadoop 02014-02-1407:24 /app-logs
dr----x--t - mapred hadoop 02014-02-1208:52 /mr-history

The result of changing the permission on those folder, when I would start MapReduce2 service through Ambari is:

Error creating done directory:[hdfs://nnha:8020/mr-history/done]
Permission denied: user=mapred, access=EXECUTE, inode="/mr-history":mapred:hadoop:dr----x--t

When I change it back to default as follows:

hdfs dfs -chmod -R 1777 /app-logs
hdfs dfs -chmod -R 1777 /mr-history
hdfs dfs -chown -R yarn:hadoop /app-logs
hdfs dfs -chown -R mapred:hadoop /mr-history

Ambari change the permission of folders again to "dr----x--t", do you have please any recommendation?

Re: Ambari change permission of /mr-history folder which lead to permission denied in logs of MapReduce2

rahulpathak109 — Fri, 22 Jan 2016 18:05:58 GMT

I cannot reproduce this issue on HDP-2.3.2.0-2950. I have successfully upgraded Ambari from 2.1 to 2.2 on centos 6.

I restarted MapReduce2 service through UI and it went fine. Permission of /mr-history is as below

drwxrwxrwx - mapred hadoop 0 2015-10-27 12:40 /mr-history

Re: Ambari change permission of /mr-history folder which lead to permission denied in logs of MapReduce2

pavel_hladik — Sun, 24 Jan 2016 16:14:46 GMT

Didn't help me.

Re: Ambari change permission of /mr-history folder which lead to permission denied in logs of MapReduce2

aervits — Sun, 24 Jan 2016 20:10:50 GMT

@Pavel Hladík HDP 2.0 is not supported with Ambari 2.2, either downgrade Ambari or upgrade HDP.

Re: Ambari change permission of /mr-history folder which lead to permission denied in logs of MapReduce2

nsabharwal — Mon, 19 Aug 2019 11:42:49 GMT

@Pavel Hladík

Couple of things:

Take a look on the following matrix

1) HDP 2.1 is deprecated and it means that you may not get HDP 2.0 support

You cannot go beyond Ambari 2.1.2 without upgrading HDP.

It look like that you have having issue with History server (Introduced in HDP 2.0)

There is high probability that you may end up hitting more issues because of this mismatch.

Re: Ambari change permission of /mr-history folder which lead to permission denied in logs of MapReduce2

aervits — Wed, 03 Feb 2016 05:25:36 GMT

@Pavel Hladík are you still having issues with this? Can you accept the best answer or provide your own solution?

Re: Ambari change permission of /mr-history folder which lead to permission denied in logs of MapReduce2

pavel_hladik — Wed, 03 Feb 2016 15:07:45 GMT

Hi, I put my next question about downgrade to new question here.