The command of the process- [testuser@dhubm02 ~]$ ps aux --sort=-%mem | head |grep "yarn-ats" yarn-ats 26561 0.7 4.9 6129012 1577496 ? Sl 05:03 3:49 /usr/lib/jvm/java-1.8.0-openjdk/bin/java -Dproc_regionserver -XX:OnOutOfMemoryError=kill -9 %p -Dhdp.version=3.1.0.0-78 -XX:+UseConcMarkSweepGC -XX:ErrorFile=/var/log/hadoop-yarn/embedded-yarn-ats-hbase/hs_err_pid%p.log -Djava.io.tmpdir=/tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/var/log/hadoop-yarn/embedded-yarn-ats-hbase/gc.log-202007010503 -XX:CMSInitiatingOccupancyFraction=70 -XX:ReservedCodeCacheSize=256m -Xms3276m -Xmx3276m -Djava.security.auth.login.config=/usr/hdp/3.1.0.0-78/hadoop/conf/embedded-yarn-ats-hbase/yarn_hbase_regionserver_jaas.conf -Dhbase.log.dir=/var/log/hadoop-yarn/embedded-yarn-ats-hbase -Dhbase.log.file=hbase-yarn-ats-regionserver-dhubm02.avios.dta.iag-gdp.net.log -Dhbase.home.dir=/usr/hdp/3.1.0.0-78/hbase/bin/.. -Dhbase.id.str=yarn-ats -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.1.0.0-78/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.1.0.0-78/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.1.0.0-78/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS org.apache.hadoop.hbase.regionserver.HRegionServer start     Also noticed the below entry in - /var/log/hadoop-yarn/embedded-yarn-ats-hbase/gc.log-202007010503    2020-07-03T05:15:18.832+0000: 173484.604: [GC (Allocation Failure) 2020-07-03T05:15:18.833+0000: 173484.605: [ParNew: 901223K->19101K(996800K), 0.0230869 secs] 1054651K->173168K(3243904K), 0.0236997 secs] [Times: user=0.25 sys=0.00, real=0.03 secs] 2020-07-03T05:24:08.491+0000: 174014.262: [GC (Allocation Failure) 2020-07-03T05:24:08.491+0000: 174014.262: [ParNew: 905181K->15339K(996800K), 0.0224086 secs] 1059248K->170059K(3243904K), 0.0225202 secs] [Times: user=0.23 sys=0.00, real=0.03 secs] 2020-07-03T05:32:18.675+0000: 174504.447: [GC (Allocation Failure) 2020-07-03T05:32:18.676+0000: 174504.448: [ParNew: 901419K->16600K(996800K), 0.0228688 secs] 1056139K->171858K(3243904K), 0.0233860 secs] [Times: user=0.24 sys=0.00, real=0.02 secs] 2020-07-03T05:39:42.857+0000: 174948.629: [GC (Allocation Failure) 2020-07-03T05:39:42.857+0000: 174948.629: [ParNew: 902680K->17498K(996800K), 0.0220587 secs] 1057938K->173472K(3243904K), 0.0221793 secs] [Times: user=0.22 sys=0.00, real=0.02 secs] ... View more

Hi, Did you get a solution for this? Does knox support mfa from third party vendors? ... View more

Even I am facing the same issue. As soon as I enable the controller service its creating livy sessions. I havent started any processors. ... View more

Hi, Is this issue resolved? I am facing the same issue. After authentication with AD user credentials its showing logged in as knox and I cant access the logs in YARN and HDFS UI and its giving me this error  User [knox] is not authorized to view the logs for container_e18_1566456018580_0002_01_000001 in log file [hclustd01.test.codex-ifabric.net_45454_1566456791784] No logs available for container container_e18_1566456018580_0002_01_000001 ... View more

Lets say that the cluster and the AD is created in accountA and the s3 bucket is in accountB. I have used AWS microsoft active directory ... View more