If were missing that file, it sounds like the package (RPM/Deb) was never correctly installed. Maybe you're better off trying to remove the service and re-add it if you have no data stored in Accumulo. I'm not sure what else to suggest at this point. ... View more

@Jonathan Hurley, no... this is expected. From a fresh HDP2.3.4 install I just did: # ls -l /usr/hdp/2.3.6.0-3796/etc/default/accumulo -rw-r--r--. 1 root root 975 Jun 23 16:12 /usr/hdp/2.3.6.0-3796/etc/default/accumulo # yum whatprovides /usr/hdp/2.3.6.0-3796/etc/default/accumulo accumulo_2_3_6_0_3796-1.7.0.2.3.6.0-3796.el6.x86_64 : Apache Accumulo is a distributed Key Value store based on Google's BigTable Repo : HDP-2.3 Matched from: Filename : /usr/hdp/2.3.6.0-3796/etc/default/accumulo accumulo_2_3_6_0_3796-1.7.0.2.3.6.0-3796.el6.x86_64 : Apache Accumulo is a distributed Key Value store based on Google's BigTable Repo : installed Matched from: Other : Provides-match: /usr/hdp/2.3.6.0-3796/etc/default/accumulo ... View more

You should be able to cross-reference the Region IDs with those region servers (nodes 9, 3, 2, and 12, respectively) to determine why they were left in a FAILED_OPEN state. ... View more

The InvalidToken error is not something to be worried about. A new Token will be fetched by the HDFS client automatically. You just see this scary-looking exception. ... View more

Typically, the following is sufficient to automatically repair offline/in-transition regions: hbase hbck -repair However, without logs, it's rather impossible to know why the Region is offline. There may be explanations in the Master log as to why this Region is not getting assigned. ... View more

Sorry, not the logs, but the filesystem layout and the configuration. Specifically, compare if /usr/hdp/2.3.4.0-3485/etc/default/accumulo exists on the nodes which are correctly running. My hunch is that you are missing a symlink or something beneath /usr/hdp/2.3.4.0-3485/etc/default or similar. And yes, under normal circumstances, the .err file should be present but empty. It is the redirection of STDERR for the Accumulo service which should have nothing while the process is happily running. ... View more

The content in the err files is definitely the issue here. Might you be able to cross-reference once of these nodes (that are failing) with one that does work? See if that file exists on the other node. If it does, I'd recommend copying it over. I have not run into this problem myself previously. ... View more

The TabletServer is the exception to this. It is the per-server process, not an HA component. ... View more