2016-08-22 07:41:02,565 [fs.VolumeManagerImpl] WARN : dfs.datanode.synconclose set to false in hdfs-site.xml: data loss is possible on hard system reset or power loss 2016-08-22 07:41:02,568 [conf.Property] DEBUG: Loaded class : org.apache.accumulo.server.fs.PerTableVolumeChooser 2016-08-22 07:41:02,678 [zookeeper.ZooUtil] DEBUG: Trying to read instance id from hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/instance_id 2016-08-22 07:41:02,701 [watcher.MonitorLog4jWatcher] INFO : Enabled log-forwarding 2016-08-22 07:41:02,722 [server.Accumulo] INFO : monitor starting 2016-08-22 07:41:02,722 [server.Accumulo] INFO : Instance 27dd6c38-9a25-4e75-96c0-8b689579b8da 2016-08-22 07:41:02,723 [zookeeper.ZooSession] DEBUG: Connecting to de-hd-cluster.name-node.com:2181,de-hd-cluster.data-node1.com:2181 with timeout 30000 with auth 2016-08-22 07:41:02,725 [server.Accumulo] INFO : Data Version 7 2016-08-22 07:41:02,725 [server.Accumulo] INFO : Attempting to talk to zookeeper 2016-08-22 07:41:02,742 [zookeeper.ZooKeeper] INFO : Client environment:zookeeper.version=3.4.6-169--1, built on 02/10/2016 05:49 GMT 2016-08-22 07:41:02,742 [zookeeper.ZooKeeper] INFO : Client environment:host.name=de-hd-cluster.name-node.com 2016-08-22 07:41:02,742 [zookeeper.ZooKeeper] INFO : Client environment:java.version=1.8.0_60 2016-08-22 07:41:02,742 [zookeeper.ZooKeeper] INFO : Client environment:java.vendor=Oracle Corporation 2016-08-22 07:41:02,742 [zookeeper.ZooKeeper] INFO : Client environment:java.home=/usr/jdk64/jdk1.8.0_60/jre 2016-08-22 07:41:02,742 [zookeeper.ZooKeeper] INFO : Client environment:java.class.path=/usr/hdp/current/accumulo-monitor/conf/server:/usr/hdp/2.4.0.0-169/accumulo/lib/accumulo-start.jar:/usr/hdp/2.4.0.0-169/accumulo/lib/slf4j-api.jar:/usr/hdp/2.4.0.0-169/accumulo/lib/slf4j-log4j12.jar:/usr/hdp/current/hadoop-client/lib/log4j-1.2.17.jar: 2016-08-22 07:41:02,743 [zookeeper.ZooKeeper] INFO : Client environment:java.library.path=/usr/hdp/current/hadoop-client/lib/native::/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2016-08-22 07:41:02,743 [zookeeper.ZooKeeper] INFO : Client environment:java.io.tmpdir=/tmp 2016-08-22 07:41:02,743 [zookeeper.ZooKeeper] INFO : Client environment:java.compiler= 2016-08-22 07:41:02,743 [zookeeper.ZooKeeper] INFO : Client environment:os.name=Linux 2016-08-22 07:41:02,743 [zookeeper.ZooKeeper] INFO : Client environment:os.arch=amd64 2016-08-22 07:41:02,743 [zookeeper.ZooKeeper] INFO : Client environment:os.version=4.4.0-34-generic 2016-08-22 07:41:02,743 [zookeeper.ZooKeeper] INFO : Client environment:user.name=accumulo 2016-08-22 07:41:02,743 [zookeeper.ZooKeeper] INFO : Client environment:user.home=/home/accumulo 2016-08-22 07:41:02,743 [zookeeper.ZooKeeper] INFO : Client environment:user.dir=/home/accumulo 2016-08-22 07:41:02,744 [zookeeper.ZooKeeper] INFO : Initiating client connection, connectString=de-hd-cluster.name-node.com:2181,de-hd-cluster.data-node1.com:2181 sessionTimeout=30000 watcher=org.apache.accumulo.fate.zookeeper.ZooSession$ZooWatcher@2b6c24dc 2016-08-22 07:41:02,764 [zookeeper.ClientCnxn] INFO : Opening socket connection to server de-hd-cluster.data-node1.com/10.79.210.75:2181. Will not attempt to authenticate using SASL (unknown error) 2016-08-22 07:41:02,764 [zookeeper.ClientCnxn] INFO : Socket connection established to de-hd-cluster.data-node1.com/10.79.210.75:2181, initiating session 2016-08-22 07:41:02,772 [zookeeper.ClientCnxn] INFO : Session establishment complete on server de-hd-cluster.data-node1.com/10.79.210.75:2181, sessionid = 0x156af79c1e70005, negotiated timeout = 30000 2016-08-22 07:41:02,868 [server.Accumulo] INFO : ZooKeeper connected and initialized, attempting to talk to HDFS 2016-08-22 07:41:02,869 [watcher.MonitorLog4jWatcher] INFO : Set watch for Monitor Log4j watcher 2016-08-22 07:41:02,890 [server.Accumulo] INFO : Connected to HDFS 2016-08-22 07:41:02,895 [server.Accumulo] INFO : crypto.block.stream.size = 1K 2016-08-22 07:41:02,895 [server.Accumulo] INFO : crypto.cipher.algorithm.name = NullCipher 2016-08-22 07:41:02,895 [server.Accumulo] INFO : crypto.cipher.key.length = 128 2016-08-22 07:41:02,895 [server.Accumulo] INFO : crypto.cipher.suite = NullCipher 2016-08-22 07:41:02,895 [server.Accumulo] INFO : crypto.default.key.strategy.cipher.suite = NullCipher 2016-08-22 07:41:02,895 [server.Accumulo] INFO : crypto.default.key.strategy.hdfs.uri = 2016-08-22 07:41:02,895 [server.Accumulo] INFO : crypto.default.key.strategy.key.location = /crypto/secret/keyEncryptionKey 2016-08-22 07:41:02,895 [server.Accumulo] INFO : crypto.module.class = NullCryptoModule 2016-08-22 07:41:02,895 [server.Accumulo] INFO : crypto.override.key.strategy.with.configured.strategy = false 2016-08-22 07:41:02,895 [server.Accumulo] INFO : crypto.secret.key.encryption.strategy.class = NullSecretKeyEncryptionStrategy 2016-08-22 07:41:02,895 [server.Accumulo] INFO : crypto.secure.rng = SHA1PRNG 2016-08-22 07:41:02,896 [server.Accumulo] INFO : crypto.secure.rng.provider = SUN 2016-08-22 07:41:02,896 [server.Accumulo] INFO : gc.cycle.delay = 5m 2016-08-22 07:41:02,896 [server.Accumulo] INFO : gc.cycle.start = 30s 2016-08-22 07:41:02,896 [server.Accumulo] INFO : gc.file.archive = false 2016-08-22 07:41:02,896 [server.Accumulo] INFO : gc.port.client = 50092 2016-08-22 07:41:02,896 [server.Accumulo] INFO : gc.threads.delete = 16 2016-08-22 07:41:02,896 [server.Accumulo] INFO : gc.trace.percent = 0.01 2016-08-22 07:41:02,896 [server.Accumulo] INFO : gc.trash.ignore = false 2016-08-22 07:41:02,896 [server.Accumulo] INFO : general.classpaths = $ACCUMULO_HOME/lib/accumulo-server.jar, $ACCUMULO_HOME/lib/accumulo-core.jar, $ACCUMULO_HOME/lib/accumulo-start.jar, $ACCUMULO_HOME/lib/accumulo-fate.jar, $ACCUMULO_HOME/lib/accumulo-proxy.jar, $ACCUMULO_HOME/lib/[^.].*.jar, $ZOOKEEPER_HOME/zookeeper[^.].*.jar, $HADOOP_CONF_DIR, /usr/hdp/current/hadoop-client/[^.].*.jar, /usr/hdp/current/hadoop-client/lib/(?!slf4j)[^.].*.jar, /usr/hdp/current/hadoop-hdfs-client/[^.].*.jar, /usr/hdp/current/hadoop-mapreduce-client/[^.].*.jar, /usr/hdp/current/hadoop-yarn-client/[^.].*.jar, /usr/hdp/current/hadoop-yarn-client/lib/jersey.*.jar, /usr/hdp/current/hive-client/lib/hive-accumulo-handler.jar, 2016-08-22 07:41:02,896 [server.Accumulo] INFO : general.delegation.token.lifetime = 7d 2016-08-22 07:41:02,896 [server.Accumulo] INFO : general.delegation.token.update.interval = 1d 2016-08-22 07:41:02,896 [server.Accumulo] INFO : general.dynamic.classpaths = $ACCUMULO_HOME/lib/ext/[^.].*.jar 2016-08-22 07:41:02,896 [server.Accumulo] INFO : general.kerberos.keytab = 2016-08-22 07:41:02,896 [server.Accumulo] INFO : general.kerberos.principal = 2016-08-22 07:41:02,896 [server.Accumulo] INFO : general.kerberos.renewal.period = 30s 2016-08-22 07:41:02,896 [server.Accumulo] INFO : general.legacy.metrics = false 2016-08-22 07:41:02,897 [server.Accumulo] INFO : general.maven.project.basedir = 2016-08-22 07:41:02,897 [server.Accumulo] INFO : general.rpc.server.type = 2016-08-22 07:41:02,897 [server.Accumulo] INFO : general.rpc.timeout = 120s 2016-08-22 07:41:02,897 [server.Accumulo] INFO : general.security.credential.provider.paths = 2016-08-22 07:41:02,897 [server.Accumulo] INFO : general.server.message.size.max = 1G 2016-08-22 07:41:02,897 [server.Accumulo] INFO : general.server.simpletimer.threadpool.size = 1 2016-08-22 07:41:02,897 [server.Accumulo] INFO : general.vfs.cache.dir = /tmp/accumulo-vfs-cache-accumulo 2016-08-22 07:41:02,897 [server.Accumulo] INFO : general.vfs.classpaths = 2016-08-22 07:41:02,897 [server.Accumulo] INFO : general.volume.chooser = org.apache.accumulo.server.fs.PerTableVolumeChooser 2016-08-22 07:41:02,897 [server.Accumulo] INFO : instance.dfs.dir = /accumulo 2016-08-22 07:41:02,897 [server.Accumulo] INFO : instance.dfs.uri = 2016-08-22 07:41:02,897 [server.Accumulo] INFO : instance.rpc.sasl.enabled = false 2016-08-22 07:41:02,898 [server.Accumulo] INFO : instance.rpc.ssl.clientAuth = false 2016-08-22 07:41:02,898 [server.Accumulo] INFO : instance.rpc.ssl.enabled = false 2016-08-22 07:41:02,898 [server.Accumulo] INFO : instance.secret = 2016-08-22 07:41:02,898 [server.Accumulo] INFO : instance.security.authenticator = org.apache.accumulo.server.security.handler.ZKAuthenticator 2016-08-22 07:41:02,898 [server.Accumulo] INFO : instance.security.authorizor = org.apache.accumulo.server.security.handler.ZKAuthorizor 2016-08-22 07:41:02,898 [server.Accumulo] INFO : instance.security.permissionHandler = org.apache.accumulo.server.security.handler.ZKPermHandler 2016-08-22 07:41:02,898 [server.Accumulo] INFO : instance.volumes = hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data 2016-08-22 07:41:02,898 [server.Accumulo] INFO : instance.volumes.replacements = 2016-08-22 07:41:02,898 [server.Accumulo] INFO : instance.zookeeper.host = de-hd-cluster.name-node.com:2181,de-hd-cluster.data-node1.com:2181 2016-08-22 07:41:02,898 [server.Accumulo] INFO : instance.zookeeper.timeout = 30s 2016-08-22 07:41:02,898 [server.Accumulo] INFO : logger.dir.walog = walogs 2016-08-22 07:41:02,898 [server.Accumulo] INFO : master.bulk.rename.threadpool.size = 20 2016-08-22 07:41:02,898 [server.Accumulo] INFO : master.bulk.retries = 3 2016-08-22 07:41:02,898 [server.Accumulo] INFO : master.bulk.threadpool.size = 5 2016-08-22 07:41:02,898 [server.Accumulo] INFO : master.bulk.timeout = 5m 2016-08-22 07:41:02,898 [server.Accumulo] INFO : master.fate.threadpool.size = 4 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.lease.recovery.interval = 5s 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.port.client = 9999 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.recovery.delay = 10s 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.recovery.max.age = 60m 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.recovery.time.max = 30m 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.replication.coordinator.minthreads = 4 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.replication.coordinator.port = 10001 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.replication.coordinator.threadcheck.time = 5s 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.replication.status.scan.interval = 30s 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.server.threadcheck.time = 1s 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.server.threads.minimum = 20 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.tablet.balancer = org.apache.accumulo.server.master.balancer.TableLoadBalancer 2016-08-22 07:41:02,899 [server.Accumulo] INFO : master.walog.closer.implementation = org.apache.accumulo.server.master.recovery.HadoopLogCloser 2016-08-22 07:41:02,899 [server.Accumulo] INFO : monitor.banner.background = #304065 2016-08-22 07:41:02,899 [server.Accumulo] INFO : monitor.banner.color = #c4c4c4 2016-08-22 07:41:02,899 [server.Accumulo] INFO : monitor.banner.text = 2016-08-22 07:41:02,899 [server.Accumulo] INFO : monitor.lock.check.interval = 5s 2016-08-22 07:41:02,899 [server.Accumulo] INFO : monitor.log.date.format = yyyy/MM/dd HH:mm:ss,SSS 2016-08-22 07:41:02,900 [server.Accumulo] INFO : monitor.port.client = 50095 2016-08-22 07:41:02,900 [server.Accumulo] INFO : monitor.port.log4j = 4560 2016-08-22 07:41:02,900 [server.Accumulo] INFO : monitor.ssl.exclude.ciphers = 2016-08-22 07:41:02,900 [server.Accumulo] INFO : monitor.ssl.include.ciphers = 2016-08-22 07:41:02,900 [server.Accumulo] INFO : monitor.ssl.include.protocols = TLSv1,TLSv1.1,TLSv1.2 2016-08-22 07:41:02,900 [server.Accumulo] INFO : monitor.ssl.keyStore = 2016-08-22 07:41:02,900 [server.Accumulo] INFO : monitor.ssl.keyStorePassword = 2016-08-22 07:41:02,900 [server.Accumulo] INFO : monitor.ssl.keyStoreType = jks 2016-08-22 07:41:02,900 [server.Accumulo] INFO : monitor.ssl.trustStore = 2016-08-22 07:41:02,900 [server.Accumulo] INFO : monitor.ssl.trustStorePassword = 2016-08-22 07:41:02,900 [server.Accumulo] INFO : monitor.ssl.trustStoreType = jks 2016-08-22 07:41:02,900 [server.Accumulo] INFO : replication.driver.delay = 0s 2016-08-22 07:41:02,900 [server.Accumulo] INFO : replication.max.unit.size = 64M 2016-08-22 07:41:02,900 [server.Accumulo] INFO : replication.max.work.queue = 1000 2016-08-22 07:41:02,901 [server.Accumulo] INFO : replication.name = 2016-08-22 07:41:02,901 [server.Accumulo] INFO : replication.receipt.service.port = 10002 2016-08-22 07:41:02,901 [server.Accumulo] INFO : replication.receiver.min.threads = 1 2016-08-22 07:41:02,901 [server.Accumulo] INFO : replication.receiver.threadcheck.time = 30s 2016-08-22 07:41:02,901 [server.Accumulo] INFO : replication.trace.percent = 0.1 2016-08-22 07:41:02,901 [server.Accumulo] INFO : replication.work.assigner = org.apache.accumulo.master.replication.UnorderedWorkAssigner 2016-08-22 07:41:02,901 [server.Accumulo] INFO : replication.work.assignment.sleep = 30s 2016-08-22 07:41:02,901 [server.Accumulo] INFO : replication.work.attempts = 10 2016-08-22 07:41:02,901 [server.Accumulo] INFO : replication.work.processor.delay = 0s 2016-08-22 07:41:02,901 [server.Accumulo] INFO : replication.work.processor.period = 0s 2016-08-22 07:41:02,901 [server.Accumulo] INFO : replication.worker.threads = 4 2016-08-22 07:41:02,901 [server.Accumulo] INFO : rpc.javax.net.ssl.keyStore = $ACCUMULO_CONF_DIR/ssl/keystore.jks 2016-08-22 07:41:02,901 [server.Accumulo] INFO : rpc.javax.net.ssl.keyStorePassword = 2016-08-22 07:41:02,901 [server.Accumulo] INFO : rpc.javax.net.ssl.keyStoreType = jks 2016-08-22 07:41:02,901 [server.Accumulo] INFO : rpc.javax.net.ssl.trustStore = $ACCUMULO_CONF_DIR/ssl/truststore.jks 2016-08-22 07:41:02,901 [server.Accumulo] INFO : rpc.javax.net.ssl.trustStorePassword = 2016-08-22 07:41:02,902 [server.Accumulo] INFO : rpc.javax.net.ssl.trustStoreType = jks 2016-08-22 07:41:02,902 [server.Accumulo] INFO : rpc.sasl.qop = auth 2016-08-22 07:41:02,902 [server.Accumulo] INFO : rpc.ssl.cipher.suites = 2016-08-22 07:41:02,902 [server.Accumulo] INFO : rpc.ssl.client.protocol = TLSv1 2016-08-22 07:41:02,902 [server.Accumulo] INFO : rpc.ssl.server.enabled.protocols = TLSv1,TLSv1.1,TLSv1.2 2016-08-22 07:41:02,902 [server.Accumulo] INFO : rpc.useJsse = false 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.balancer = org.apache.accumulo.server.master.balancer.DefaultLoadBalancer 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.bloom.enabled = false 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.bloom.error.rate = 0.5% 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.bloom.hash.type = murmur 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.bloom.key.functor = org.apache.accumulo.core.file.keyfunctor.RowFunctor 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.bloom.load.threshold = 1 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.bloom.size = 1048576 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.cache.block.enable = false 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.cache.index.enable = true 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.classpath.context = 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.compaction.major.everything.idle = 1h 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.compaction.major.ratio = 3 2016-08-22 07:41:02,902 [server.Accumulo] INFO : table.compaction.minor.idle = 5m 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.compaction.minor.logs.threshold = 3 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.durability = sync 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.failures.ignore = false 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.file.blocksize = 0B 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.file.compress.blocksize = 100K 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.file.compress.blocksize.index = 128K 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.file.compress.type = gz 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.file.max = 15 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.file.replication = 0 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.file.type = rf 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.formatter = org.apache.accumulo.core.util.format.DefaultFormatter 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.groups.enabled = 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.interepreter = org.apache.accumulo.core.util.interpret.DefaultScanInterpreter 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.majc.compaction.strategy = org.apache.accumulo.tserver.compaction.DefaultCompactionStrategy 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.replication = false 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.scan.max.memory = 512K 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.security.scan.visibility.default = 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.split.endrow.size.max = 10K 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.split.threshold = 1G 2016-08-22 07:41:02,903 [server.Accumulo] INFO : table.volume.chooser = org.apache.accumulo.server.fs.RandomVolumeChooser 2016-08-22 07:41:02,904 [server.Accumulo] INFO : table.walog.enabled = true 2016-08-22 07:41:02,904 [server.Accumulo] INFO : trace.password = 2016-08-22 07:41:02,904 [server.Accumulo] INFO : trace.port.client = 12234 2016-08-22 07:41:02,904 [server.Accumulo] INFO : trace.span.receivers = org.apache.accumulo.tracer.ZooTraceClient 2016-08-22 07:41:02,904 [server.Accumulo] INFO : trace.table = trace 2016-08-22 07:41:02,904 [server.Accumulo] INFO : trace.token.property.password = 2016-08-22 07:41:02,904 [server.Accumulo] INFO : trace.token.type = org.apache.accumulo.core.client.security.tokens.PasswordToken 2016-08-22 07:41:02,904 [server.Accumulo] INFO : trace.user = trace 2016-08-22 07:41:02,904 [server.Accumulo] INFO : trace.zookeeper.path = /tracers 2016-08-22 07:41:02,904 [server.Accumulo] INFO : tserver.archive.walogs = false 2016-08-22 07:41:02,904 [server.Accumulo] INFO : tserver.assignment.concurrent.max = 2 2016-08-22 07:41:02,904 [server.Accumulo] INFO : tserver.assignment.duration.warning = 10m 2016-08-22 07:41:02,904 [server.Accumulo] INFO : tserver.bloom.load.concurrent.max = 4 2016-08-22 07:41:02,904 [server.Accumulo] INFO : tserver.bulk.assign.threads = 1 2016-08-22 07:41:02,904 [server.Accumulo] INFO : tserver.bulk.process.threads = 1 2016-08-22 07:41:02,904 [server.Accumulo] INFO : tserver.bulk.retry.max = 5 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.bulk.timeout = 5m 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.cache.data.size = 128M 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.cache.index.size = 256M 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.client.timeout = 3s 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.compaction.major.concurrent.max = 3 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.compaction.major.delay = 30s 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.compaction.major.thread.files.open.max = 10 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.compaction.major.trace.percent = 0.1 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.compaction.minor.concurrent.max = 4 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.compaction.minor.trace.percent = 0.1 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.compaction.warn.time = 10m 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.default.blocksize = 1M 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.dir.memdump = /tmp 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.files.open.idle = 1m 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.hold.time.max = 5m 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.memory.manager = org.apache.accumulo.server.tabletserver.LargestFirstMemoryManager 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.memory.maps.max = 1G 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.memory.maps.native.enabled = true 2016-08-22 07:41:02,905 [server.Accumulo] INFO : tserver.metadata.readahead.concurrent.max = 8 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.migrations.concurrent.max = 1 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.monitor.fs = true 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.mutation.queue.max = 1M 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.port.client = 9997 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.port.search = false 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.readahead.concurrent.max = 16 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.recovery.concurrent.max = 2 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.replication.batchwriter.replayer.memory = 50M 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.replication.default.replayer = org.apache.accumulo.tserver.replication.BatchWriterReplicationReplayer 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.scan.files.open.max = 100 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.server.message.size.max = 1G 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.server.threadcheck.time = 1s 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.server.threads.minimum = 20 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.session.idle.max = 1m 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.sort.buffer.size = 200M 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.tablet.split.midpoint.files.max = 30 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.total.mutation.queue.max = 50M 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.wal.blocksize = 0 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.wal.replication = 0 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.wal.sync = true 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.wal.sync.method = hsync 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.walog.max.size = 1G 2016-08-22 07:41:02,906 [server.Accumulo] INFO : tserver.walog.maximum.wait.duration = 5m 2016-08-22 07:41:02,907 [server.Accumulo] INFO : tserver.walog.tolerated.creation.failures = 50 2016-08-22 07:41:02,907 [server.Accumulo] INFO : tserver.walog.tolerated.wait.increment = 1000ms 2016-08-22 07:41:02,907 [server.Accumulo] INFO : tserver.workq.threads = 2 2016-08-22 07:41:02,917 [tracer.ZooTraceClient] DEBUG: Scanning trace hosts in zookeeper: /tracers 2016-08-22 07:41:02,918 [tracer.ZooTraceClient] DEBUG: Trace hosts: [] 2016-08-22 07:41:02,918 [tracer.ZooTraceClient] DEBUG: Successfully initialized tracer hosts from ZooKeeper 2016-08-22 07:41:02,918 [trace.DistributedTrace] INFO : SpanReceiver org.apache.accumulo.tracer.ZooTraceClient was loaded successfully. 2016-08-22 07:41:02,931 [monitor.Monitor] INFO : Got Monitor lock. 2016-08-22 07:41:02,931 [monitor.Monitor] DEBUG: Creating monitor on port 50095 2016-08-22 07:41:02,945 [util.log] INFO : Logging initialized @1805ms 2016-08-22 07:41:03,018 [server.Server] INFO : jetty-9.1.5.v20140505 2016-08-22 07:41:03,044 [handler.ContextHandler] INFO : Started o.e.j.s.ServletContextHandler@240fc208{/,null,AVAILABLE} 2016-08-22 07:41:03,079 [server.ServerConnector] INFO : Started ServerConnector@b23183{HTTP/1.1}{de-hd-cluster.name-node.com:50095} 2016-08-22 07:41:03,079 [server.Server] INFO : Started @1942ms 2016-08-22 07:41:03,079 [monitor.Monitor] DEBUG: Using de-hd-cluster.name-node.com to advertise monitor location in ZooKeeper 2016-08-22 07:41:03,099 [monitor.Monitor] INFO : Set monitor address in zookeeper to de-hd-cluster.name-node.com:50095 2016-08-22 07:41:03,100 [monitor.LogService] DEBUG: Setting monitor log4j log-forwarding address to: de-hd-cluster.name-node.com:4560 2016-08-22 07:41:03,114 [watcher.MonitorLog4jWatcher] INFO : Changing monitor log4j address to de-hd-cluster.name-node.com:4560 2016-08-22 07:41:03,114 [watcher.MonitorLog4jWatcher] INFO : Enabled log-forwarding 2016-08-22 07:41:03,141 [monitor.LogService] DEBUG: Waiting for log message senders 2016-08-22 07:41:03,142 [monitor.LogService] DEBUG: Got a new connection 2016-08-22 07:41:03,146 [monitor.LogService] DEBUG: Waiting for log message senders 2016-08-22 07:41:03,146 [monitor.LogService] DEBUG: Got a new connection 2016-08-22 07:41:03,146 [monitor.LogService] DEBUG: Waiting for log message senders 2016-08-22 07:41:03,146 [monitor.LogService] DEBUG: Got a new connection 2016-08-22 07:41:03,146 [monitor.LogService] DEBUG: Waiting for log message senders 2016-08-22 07:41:03,302 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:41:06,506 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:41:08,182 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:41:15,983 [monitor.LogService] DEBUG: Got a new connection 2016-08-22 07:41:15,983 [monitor.LogService] DEBUG: Waiting for log message senders 2016-08-22 07:41:16,364 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:41:16,718 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:41:16,787 [monitor.LogService] DEBUG: Got a new connection 2016-08-22 07:41:16,787 [monitor.LogService] DEBUG: Waiting for log message senders 2016-08-22 07:41:19,914 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:41:21,705 [monitor.LogService] DEBUG: Got a new connection 2016-08-22 07:41:21,706 [monitor.LogService] DEBUG: Waiting for log message senders 2016-08-22 07:41:21,921 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:41:22,422 [fs.VolumeManagerImpl] WARN : tracer:de-hd-cluster.name-node.com dfs.datanode.synconclose set to false in hdfs-site.xml: data loss is possible on hard system reset or power loss 2016-08-22 07:41:22,518 [net.SocketNode] INFO : Caught java.io.EOFException closing conneciton. 2016-08-22 07:41:22,528 [monitor.LogService] DEBUG: Got a new connection 2016-08-22 07:41:22,528 [monitor.LogService] DEBUG: Waiting for log message senders 2016-08-22 07:41:22,665 [net.SocketNode] INFO : Caught java.io.EOFException closing conneciton. 2016-08-22 07:41:22,674 [monitor.LogService] DEBUG: Got a new connection 2016-08-22 07:41:22,674 [monitor.LogService] DEBUG: Waiting for log message senders 2016-08-22 07:41:22,844 [tracer.ZooTraceClient] DEBUG: Processing event for trace server zk watch 2016-08-22 07:41:22,844 [tracer.ZooTraceClient] DEBUG: Scanning trace hosts in zookeeper: /tracers 2016-08-22 07:41:22,845 [tracer.ZooTraceClient] DEBUG: Trace hosts: [10.79.210.78:12234] 2016-08-22 07:41:25,137 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:41:27,145 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:41:28,957 [monitor.LogService] DEBUG: Got a new connection 2016-08-22 07:41:28,957 [monitor.LogService] DEBUG: Waiting for log message senders 2016-08-22 07:41:29,875 [monitor.LogService] DEBUG: Got a new connection 2016-08-22 07:41:29,875 [monitor.LogService] DEBUG: Waiting for log message senders 2016-08-22 07:41:30,542 [net.SocketNode] INFO : Caught java.io.EOFException closing conneciton. 2016-08-22 07:41:30,542 [net.SocketNode] INFO : Caught java.io.EOFException closing conneciton. 2016-08-22 07:41:36,054 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:41:36,401 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:41:39,532 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:41:41,544 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:41:50,505 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:41:50,846 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:41:54,119 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:41:56,127 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:41:59,464 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:42:01,139 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:42:09,564 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:42:09,908 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:42:12,923 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:42:14,932 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:42:18,194 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:42:20,207 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:42:23,579 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:42:25,263 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:42:33,491 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:42:33,838 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:42:36,996 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:42:39,004 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:42:42,072 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:42:44,080 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:42:47,443 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:42:49,118 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:42:52,284 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:42:54,296 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:42:57,482 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:42:59,493 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:43:08,737 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:43:14,841 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:43:23,167 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:43:23,510 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_ 2016-08-22 07:43:26,533 [monitor.Monitor] INFO : Failed to obtain problem reports java.lang.RuntimeException: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:161) at org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:252) at org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:310) at org.apache.accumulo.monitor.Monitor.fetchData(Monitor.java:346) at org.apache.accumulo.monitor.Monitor$1.run(Monitor.java:486) at org.apache.accumulo.fate.util.LoggingRunnable.run(LoggingRunnable.java:35) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException at org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:230) at org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:80) at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:151) ... 6 more 2016-08-22 07:43:28,542 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~err_