you shouldn't be running services as root, for obvious reasons. If you are on an insecure cluster, then all YARN jobs submitted will run as the service wide user. If that is "root", then your entire cluster belongs to the first malicious person running a job. If you are running on a kerberos cluster -as you should- you need separate accounts for every individual user of the cluster, so you aren't saving on any setup effort ... View more

I just tried this recently. Couple of options: 1. Compilation on HDP 2.3: curl -o /etc/yum.repos.d/epel-apache-maven.repo https://repos.fedorapeople.org/repos/dchen/apache-maven/epel-apache-maven.repo yum -y install apache-maven-3.2* git clone https://github.com/apache/flink.git cd flink mvn clean install -DskipTests -Dhadoop.version=2.7.1.2.3.2.0-2950 -Pvendor-repos 2. Download prebuilt tarball: wget http://www.gtlib.gatech.edu/pub/apache/flink/flink-0.9.1/flink-0.9.1-bin-hadoop27.tgz tar xvzf flink-0.9.1-bin-hadoop27.tgz cd flink-0.9.1 export HADOOP_CONF_DIR=/etc/hadoop/conf ./bin/yarn-session.sh -n 1 -jm 768 -tm 1024 3. Experimental Ambari service: https://github.com/abajwa-hw/ambari-flink-service Once its up, run word count example export HADOOP_CONF_DIR=/etc/hadoop/conf ./bin/flink run ./examples/flink-java-examples-0.9.1-WordCount.jar ... View more

be aware there's a bug hitting 1.7.0_79+ on openjdk concerning token renewal : https://issues.apache.org/jira/browse/HADOOP-10786 also on java 1.8 ... View more