So, I see both Nodemanager and resourcemanager running on that host. Can you paste the screenshot from resourcemanager as well.. http://resourcemanagerhost:8088/cluster This should show how many nodemanagers have registered with your resourcemanager. If that shows 0 hosts as well, attach and /var/log/hadoop-yarn/yarn/yarn-yarn-nodemanager-<hostname>.log and /var/log/hadoop-yarn/yarn/yarn-yarn-resorucemanager-<hostname>.log ... View more

With 5 nodes, 2 master and 3 datanodes is a good setup. But accumulo by default here is asking for table metadata files to be stores as 5 replicas. While it will not effect running of your system, you will see underreplicated blocks. Take a look at https://issues.apache.org/jira/browse/ACCUMULO-683 This shows how you can switch the replication factor to 3 for table metadata. Making this change with repfactor on hdfs will not have much effect since any new metadata will again ask for replication factor 5. ... View more

hive shell tries to get one yarn container. If all your yarn containers are busy, then 'hive' can be in hang state until containers are available. Another issue could be hivemetastore not responding. please paste /tmp/hive/hive.log which can give some insights. If cluster is busy, --hiveconf hive.execution.engine=mr will not wait for getting a container. You can use that and then switch over to tez by setting execution engine again. ... View more

Yes, ubuntu16 is the problem here. As indicated on the other thread, support for this is going to take some time. Is this a production setup or testing one? If so, you can try with ubuntu14? ... View more

16.04 was only released on 21st of this month. OS level support requires a lot of testing. While workarounds might come sooner, official support will take some time. ( I don't have the any timeline for this if that is what you are looking for) ... View more

Take a look at https://community.hortonworks.com/articles/30213/us-presidential-election-tweet-analysis-using-hdfn.html ... View more