2016-08-22 07:40:46,679 [fs.VolumeManagerImpl] WARN : dfs.datanode.synconclose set to false in hdfs-site.xml: data loss is possible on hard system reset or power loss
2016-08-22 07:40:46,681 [conf.Property] DEBUG: Loaded class : org.apache.accumulo.server.fs.PerTableVolumeChooser
2016-08-22 07:40:46,776 [zookeeper.ZooUtil] DEBUG: Trying to read instance id from hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/instance_id
2016-08-22 07:40:46,779 [watcher.MonitorLog4jWatcher] INFO : Enabled log-forwarding
2016-08-22 07:40:46,792 [server.Accumulo] INFO : master starting
2016-08-22 07:40:46,792 [server.Accumulo] INFO : Instance 27dd6c38-9a25-4e75-96c0-8b689579b8da
2016-08-22 07:40:46,794 [zookeeper.ZooSession] DEBUG: Connecting to de-hd-cluster.name-node.com:2181,de-hd-cluster.data-node1.com:2181 with timeout 30000 with auth
2016-08-22 07:40:46,795 [server.Accumulo] INFO : Data Version 7
2016-08-22 07:40:46,795 [server.Accumulo] INFO : Attempting to talk to zookeeper
2016-08-22 07:40:46,919 [watcher.MonitorLog4jWatcher] INFO : Set watch for Monitor Log4j watcher
2016-08-22 07:40:46,920 [server.Accumulo] INFO : ZooKeeper connected and initialized, attempting to talk to HDFS
2016-08-22 07:40:46,944 [server.Accumulo] INFO : Connected to HDFS
2016-08-22 07:40:46,947 [server.Accumulo] INFO : crypto.block.stream.size = 1K
2016-08-22 07:40:46,947 [server.Accumulo] INFO : crypto.cipher.algorithm.name = NullCipher
2016-08-22 07:40:46,947 [server.Accumulo] INFO : crypto.cipher.key.length = 128
2016-08-22 07:40:46,947 [server.Accumulo] INFO : crypto.cipher.suite = NullCipher
2016-08-22 07:40:46,948 [server.Accumulo] INFO : crypto.default.key.strategy.cipher.suite = NullCipher
2016-08-22 07:40:46,948 [server.Accumulo] INFO : crypto.default.key.strategy.hdfs.uri = 
2016-08-22 07:40:46,948 [server.Accumulo] INFO : crypto.default.key.strategy.key.location = /crypto/secret/keyEncryptionKey
2016-08-22 07:40:46,948 [server.Accumulo] INFO : crypto.module.class = NullCryptoModule
2016-08-22 07:40:46,948 [server.Accumulo] INFO : crypto.override.key.strategy.with.configured.strategy = false
2016-08-22 07:40:46,948 [server.Accumulo] INFO : crypto.secret.key.encryption.strategy.class = NullSecretKeyEncryptionStrategy
2016-08-22 07:40:46,948 [server.Accumulo] INFO : crypto.secure.rng = SHA1PRNG
2016-08-22 07:40:46,948 [server.Accumulo] INFO : crypto.secure.rng.provider = SUN
2016-08-22 07:40:46,948 [server.Accumulo] INFO : gc.cycle.delay = 5m
2016-08-22 07:40:46,948 [server.Accumulo] INFO : gc.cycle.start = 30s
2016-08-22 07:40:46,948 [server.Accumulo] INFO : gc.file.archive = false
2016-08-22 07:40:46,948 [server.Accumulo] INFO : gc.port.client = 50092
2016-08-22 07:40:46,949 [server.Accumulo] INFO : gc.threads.delete = 16
2016-08-22 07:40:46,949 [server.Accumulo] INFO : gc.trace.percent = 0.01
2016-08-22 07:40:46,949 [server.Accumulo] INFO : gc.trash.ignore = false
2016-08-22 07:40:46,949 [server.Accumulo] INFO : general.classpaths = 
$ACCUMULO_HOME/lib/accumulo-server.jar,
$ACCUMULO_HOME/lib/accumulo-core.jar,
$ACCUMULO_HOME/lib/accumulo-start.jar,
$ACCUMULO_HOME/lib/accumulo-fate.jar,
$ACCUMULO_HOME/lib/accumulo-proxy.jar,
$ACCUMULO_HOME/lib/[^.].*.jar,
$ZOOKEEPER_HOME/zookeeper[^.].*.jar,
$HADOOP_CONF_DIR,
/usr/hdp/current/hadoop-client/[^.].*.jar,
/usr/hdp/current/hadoop-client/lib/(?!slf4j)[^.].*.jar,
/usr/hdp/current/hadoop-hdfs-client/[^.].*.jar,
/usr/hdp/current/hadoop-mapreduce-client/[^.].*.jar,
/usr/hdp/current/hadoop-yarn-client/[^.].*.jar,
/usr/hdp/current/hadoop-yarn-client/lib/jersey.*.jar,
/usr/hdp/current/hive-client/lib/hive-accumulo-handler.jar,
2016-08-22 07:40:46,949 [server.Accumulo] INFO : general.delegation.token.lifetime = 7d
2016-08-22 07:40:46,949 [server.Accumulo] INFO : general.delegation.token.update.interval = 1d
2016-08-22 07:40:46,949 [server.Accumulo] INFO : general.dynamic.classpaths = $ACCUMULO_HOME/lib/ext/[^.].*.jar
2016-08-22 07:40:46,949 [server.Accumulo] INFO : general.kerberos.keytab = 
2016-08-22 07:40:46,949 [server.Accumulo] INFO : general.kerberos.principal = 
2016-08-22 07:40:46,949 [server.Accumulo] INFO : general.kerberos.renewal.period = 30s
2016-08-22 07:40:46,949 [server.Accumulo] INFO : general.legacy.metrics = false
2016-08-22 07:40:46,950 [server.Accumulo] INFO : general.maven.project.basedir = 
2016-08-22 07:40:46,950 [server.Accumulo] INFO : general.rpc.server.type = 
2016-08-22 07:40:46,950 [server.Accumulo] INFO : general.rpc.timeout = 120s
2016-08-22 07:40:46,950 [server.Accumulo] INFO : general.security.credential.provider.paths = 
2016-08-22 07:40:46,950 [server.Accumulo] INFO : general.server.message.size.max = 1G
2016-08-22 07:40:46,950 [server.Accumulo] INFO : general.server.simpletimer.threadpool.size = 1
2016-08-22 07:40:46,950 [server.Accumulo] INFO : general.vfs.cache.dir = /tmp/accumulo-vfs-cache-accumulo
2016-08-22 07:40:46,950 [server.Accumulo] INFO : general.vfs.classpaths = 
2016-08-22 07:40:46,950 [server.Accumulo] INFO : general.volume.chooser = org.apache.accumulo.server.fs.PerTableVolumeChooser
2016-08-22 07:40:46,950 [server.Accumulo] INFO : instance.dfs.dir = /accumulo
2016-08-22 07:40:46,950 [server.Accumulo] INFO : instance.dfs.uri = 
2016-08-22 07:40:46,950 [server.Accumulo] INFO : instance.rpc.sasl.enabled = false
2016-08-22 07:40:46,951 [server.Accumulo] INFO : instance.rpc.ssl.clientAuth = false
2016-08-22 07:40:46,951 [server.Accumulo] INFO : instance.rpc.ssl.enabled = false
2016-08-22 07:40:46,951 [server.Accumulo] INFO : instance.secret = <hidden>
2016-08-22 07:40:46,951 [server.Accumulo] INFO : instance.security.authenticator = org.apache.accumulo.server.security.handler.ZKAuthenticator
2016-08-22 07:40:46,951 [server.Accumulo] INFO : instance.security.authorizor = org.apache.accumulo.server.security.handler.ZKAuthorizor
2016-08-22 07:40:46,951 [server.Accumulo] INFO : instance.security.permissionHandler = org.apache.accumulo.server.security.handler.ZKPermHandler
2016-08-22 07:40:46,951 [server.Accumulo] INFO : instance.volumes = hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data
2016-08-22 07:40:46,951 [server.Accumulo] INFO : instance.volumes.replacements = 
2016-08-22 07:40:46,952 [server.Accumulo] INFO : instance.zookeeper.host = de-hd-cluster.name-node.com:2181,de-hd-cluster.data-node1.com:2181
2016-08-22 07:40:46,952 [server.Accumulo] INFO : instance.zookeeper.timeout = 30s
2016-08-22 07:40:46,952 [server.Accumulo] INFO : logger.dir.walog = walogs
2016-08-22 07:40:46,952 [server.Accumulo] INFO : master.bulk.rename.threadpool.size = 20
2016-08-22 07:40:46,952 [server.Accumulo] INFO : master.bulk.retries = 3
2016-08-22 07:40:46,952 [server.Accumulo] INFO : master.bulk.threadpool.size = 5
2016-08-22 07:40:46,952 [server.Accumulo] INFO : master.bulk.timeout = 5m
2016-08-22 07:40:46,952 [server.Accumulo] INFO : master.fate.threadpool.size = 4
2016-08-22 07:40:46,952 [server.Accumulo] INFO : master.lease.recovery.interval = 5s
2016-08-22 07:40:46,952 [server.Accumulo] INFO : master.port.client = 9999
2016-08-22 07:40:46,953 [server.Accumulo] INFO : master.recovery.delay = 10s
2016-08-22 07:40:46,953 [server.Accumulo] INFO : master.recovery.max.age = 60m
2016-08-22 07:40:46,953 [server.Accumulo] INFO : master.recovery.time.max = 30m
2016-08-22 07:40:46,953 [server.Accumulo] INFO : master.replication.coordinator.minthreads = 4
2016-08-22 07:40:46,953 [server.Accumulo] INFO : master.replication.coordinator.port = 10001
2016-08-22 07:40:46,953 [server.Accumulo] INFO : master.replication.coordinator.threadcheck.time = 5s
2016-08-22 07:40:46,953 [server.Accumulo] INFO : master.replication.status.scan.interval = 30s
2016-08-22 07:40:46,953 [server.Accumulo] INFO : master.server.threadcheck.time = 1s
2016-08-22 07:40:46,953 [server.Accumulo] INFO : master.server.threads.minimum = 20
2016-08-22 07:40:46,953 [server.Accumulo] INFO : master.tablet.balancer = org.apache.accumulo.server.master.balancer.TableLoadBalancer
2016-08-22 07:40:46,953 [server.Accumulo] INFO : master.walog.closer.implementation = org.apache.accumulo.server.master.recovery.HadoopLogCloser
2016-08-22 07:40:46,953 [server.Accumulo] INFO : monitor.banner.background = #304065
2016-08-22 07:40:46,953 [server.Accumulo] INFO : monitor.banner.color = #c4c4c4
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.banner.text = 
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.lock.check.interval = 5s
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.log.date.format = yyyy/MM/dd HH:mm:ss,SSS
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.port.client = 50095
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.port.log4j = 4560
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.ssl.exclude.ciphers = 
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.ssl.include.ciphers = 
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.ssl.include.protocols = TLSv1,TLSv1.1,TLSv1.2
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.ssl.keyStore = 
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.ssl.keyStorePassword = <hidden>
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.ssl.keyStoreType = jks
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.ssl.trustStore = 
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.ssl.trustStorePassword = <hidden>
2016-08-22 07:40:46,954 [server.Accumulo] INFO : monitor.ssl.trustStoreType = jks
2016-08-22 07:40:46,954 [server.Accumulo] INFO : replication.driver.delay = 0s
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.max.unit.size = 64M
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.max.work.queue = 1000
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.name = 
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.receipt.service.port = 10002
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.receiver.min.threads = 1
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.receiver.threadcheck.time = 30s
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.trace.percent = 0.1
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.work.assigner = org.apache.accumulo.master.replication.UnorderedWorkAssigner
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.work.assignment.sleep = 30s
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.work.attempts = 10
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.work.processor.delay = 0s
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.work.processor.period = 0s
2016-08-22 07:40:46,955 [server.Accumulo] INFO : replication.worker.threads = 4
2016-08-22 07:40:46,955 [server.Accumulo] INFO : rpc.javax.net.ssl.keyStore = $ACCUMULO_CONF_DIR/ssl/keystore.jks
2016-08-22 07:40:46,956 [server.Accumulo] INFO : rpc.javax.net.ssl.keyStorePassword = <hidden>
2016-08-22 07:40:46,956 [server.Accumulo] INFO : rpc.javax.net.ssl.keyStoreType = jks
2016-08-22 07:40:46,956 [server.Accumulo] INFO : rpc.javax.net.ssl.trustStore = $ACCUMULO_CONF_DIR/ssl/truststore.jks
2016-08-22 07:40:46,956 [server.Accumulo] INFO : rpc.javax.net.ssl.trustStorePassword = <hidden>
2016-08-22 07:40:46,956 [server.Accumulo] INFO : rpc.javax.net.ssl.trustStoreType = jks
2016-08-22 07:40:46,956 [server.Accumulo] INFO : rpc.sasl.qop = auth
2016-08-22 07:40:46,956 [server.Accumulo] INFO : rpc.ssl.cipher.suites = 
2016-08-22 07:40:46,956 [server.Accumulo] INFO : rpc.ssl.client.protocol = TLSv1
2016-08-22 07:40:46,956 [server.Accumulo] INFO : rpc.ssl.server.enabled.protocols = TLSv1,TLSv1.1,TLSv1.2
2016-08-22 07:40:46,956 [server.Accumulo] INFO : rpc.useJsse = false
2016-08-22 07:40:46,956 [server.Accumulo] INFO : table.balancer = org.apache.accumulo.server.master.balancer.DefaultLoadBalancer
2016-08-22 07:40:46,956 [server.Accumulo] INFO : table.bloom.enabled = false
2016-08-22 07:40:46,956 [server.Accumulo] INFO : table.bloom.error.rate = 0.5%
2016-08-22 07:40:46,956 [server.Accumulo] INFO : table.bloom.hash.type = murmur
2016-08-22 07:40:46,956 [server.Accumulo] INFO : table.bloom.key.functor = org.apache.accumulo.core.file.keyfunctor.RowFunctor
2016-08-22 07:40:46,956 [server.Accumulo] INFO : table.bloom.load.threshold = 1
2016-08-22 07:40:46,957 [server.Accumulo] INFO : table.bloom.size = 1048576
2016-08-22 07:40:46,957 [server.Accumulo] INFO : table.cache.block.enable = false
2016-08-22 07:40:46,957 [server.Accumulo] INFO : table.cache.index.enable = true
2016-08-22 07:40:46,957 [server.Accumulo] INFO : table.classpath.context = 
2016-08-22 07:40:46,957 [server.Accumulo] INFO : table.compaction.major.everything.idle = 1h
2016-08-22 07:40:46,957 [server.Accumulo] INFO : table.compaction.major.ratio = 3
2016-08-22 07:40:46,957 [server.Accumulo] INFO : table.compaction.minor.idle = 5m
2016-08-22 07:40:46,957 [server.Accumulo] INFO : table.compaction.minor.logs.threshold = 3
2016-08-22 07:40:46,957 [server.Accumulo] INFO : table.durability = sync
2016-08-22 07:40:46,957 [server.Accumulo] INFO : table.failures.ignore = false
2016-08-22 07:40:46,957 [server.Accumulo] INFO : table.file.blocksize = 0B
2016-08-22 07:40:46,957 [server.Accumulo] INFO : table.file.compress.blocksize = 100K
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.file.compress.blocksize.index = 128K
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.file.compress.type = gz
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.file.max = 15
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.file.replication = 0
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.file.type = rf
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.formatter = org.apache.accumulo.core.util.format.DefaultFormatter
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.groups.enabled = 
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.interepreter = org.apache.accumulo.core.util.interpret.DefaultScanInterpreter
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.majc.compaction.strategy = org.apache.accumulo.tserver.compaction.DefaultCompactionStrategy
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.replication = false
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.scan.max.memory = 512K
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.security.scan.visibility.default = 
2016-08-22 07:40:46,958 [server.Accumulo] INFO : table.split.endrow.size.max = 10K
2016-08-22 07:40:46,959 [server.Accumulo] INFO : table.split.threshold = 1G
2016-08-22 07:40:46,959 [server.Accumulo] INFO : table.volume.chooser = org.apache.accumulo.server.fs.RandomVolumeChooser
2016-08-22 07:40:46,961 [server.Accumulo] INFO : table.walog.enabled = true
2016-08-22 07:40:46,961 [server.Accumulo] INFO : trace.password = <hidden>
2016-08-22 07:40:46,961 [server.Accumulo] INFO : trace.port.client = 12234
2016-08-22 07:40:46,961 [server.Accumulo] INFO : trace.span.receivers = org.apache.accumulo.tracer.ZooTraceClient
2016-08-22 07:40:46,962 [server.Accumulo] INFO : trace.table = trace
2016-08-22 07:40:46,962 [server.Accumulo] INFO : trace.token.property.password = <hidden>
2016-08-22 07:40:46,962 [server.Accumulo] INFO : trace.token.type = org.apache.accumulo.core.client.security.tokens.PasswordToken
2016-08-22 07:40:46,962 [server.Accumulo] INFO : trace.user = trace
2016-08-22 07:40:46,962 [server.Accumulo] INFO : trace.zookeeper.path = /tracers
2016-08-22 07:40:46,962 [server.Accumulo] INFO : tserver.archive.walogs = false
2016-08-22 07:40:46,962 [server.Accumulo] INFO : tserver.assignment.concurrent.max = 2
2016-08-22 07:40:46,962 [server.Accumulo] INFO : tserver.assignment.duration.warning = 10m
2016-08-22 07:40:46,962 [server.Accumulo] INFO : tserver.bloom.load.concurrent.max = 4
2016-08-22 07:40:46,962 [server.Accumulo] INFO : tserver.bulk.assign.threads = 1
2016-08-22 07:40:46,962 [server.Accumulo] INFO : tserver.bulk.process.threads = 1
2016-08-22 07:40:46,962 [server.Accumulo] INFO : tserver.bulk.retry.max = 5
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.bulk.timeout = 5m
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.cache.data.size = 128M
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.cache.index.size = 256M
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.client.timeout = 3s
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.compaction.major.concurrent.max = 3
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.compaction.major.delay = 30s
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.compaction.major.thread.files.open.max = 10
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.compaction.major.trace.percent = 0.1
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.compaction.minor.concurrent.max = 4
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.compaction.minor.trace.percent = 0.1
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.compaction.warn.time = 10m
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.default.blocksize = 1M
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.dir.memdump = /tmp
2016-08-22 07:40:46,963 [server.Accumulo] INFO : tserver.files.open.idle = 1m
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.hold.time.max = 5m
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.memory.manager = org.apache.accumulo.server.tabletserver.LargestFirstMemoryManager
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.memory.maps.max = 1G
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.memory.maps.native.enabled = true
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.metadata.readahead.concurrent.max = 8
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.migrations.concurrent.max = 1
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.monitor.fs = true
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.mutation.queue.max = 1M
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.port.client = 9997
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.port.search = false
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.readahead.concurrent.max = 16
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.recovery.concurrent.max = 2
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.replication.batchwriter.replayer.memory = 50M
2016-08-22 07:40:46,964 [server.Accumulo] INFO : tserver.replication.default.replayer = org.apache.accumulo.tserver.replication.BatchWriterReplicationReplayer
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.scan.files.open.max = 100
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.server.message.size.max = 1G
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.server.threadcheck.time = 1s
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.server.threads.minimum = 20
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.session.idle.max = 1m
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.sort.buffer.size = 200M
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.tablet.split.midpoint.files.max = 30
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.total.mutation.queue.max = 50M
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.wal.blocksize = 0
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.wal.replication = 0
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.wal.sync = true
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.wal.sync.method = hsync
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.walog.max.size = 1G
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.walog.maximum.wait.duration = 5m
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.walog.tolerated.creation.failures = 50
2016-08-22 07:40:46,965 [server.Accumulo] INFO : tserver.walog.tolerated.wait.increment = 1000ms
2016-08-22 07:40:46,966 [server.Accumulo] INFO : tserver.workq.threads = 2
2016-08-22 07:40:46,984 [master.Master] INFO : Version 1.7.0.2.4.0.0-169
2016-08-22 07:40:46,984 [master.Master] INFO : Instance 27dd6c38-9a25-4e75-96c0-8b689579b8da
2016-08-22 07:40:46,988 [impl.ThriftTransportPool] DEBUG: Set thrift transport pool idle time to 120000
2016-08-22 07:40:46,997 [conf.AccumuloConfiguration] INFO : Loaded class : org.apache.accumulo.server.master.balancer.TableLoadBalancer
2016-08-22 07:40:47,006 [conf.AccumuloConfiguration] INFO : Loaded class : org.apache.accumulo.server.security.handler.ZKAuthorizor
2016-08-22 07:40:47,008 [conf.AccumuloConfiguration] INFO : Loaded class : org.apache.accumulo.server.security.handler.ZKAuthenticator
2016-08-22 07:40:47,010 [conf.AccumuloConfiguration] INFO : Loaded class : org.apache.accumulo.server.security.handler.ZKPermHandler
2016-08-22 07:40:47,135 [master.Master] INFO : SASL is not enabled, delegation tokens will not be available
2016-08-22 07:40:47,145 [tracer.ZooTraceClient] DEBUG: Scanning trace hosts in zookeeper: /tracers
2016-08-22 07:40:47,145 [tracer.ZooTraceClient] DEBUG: Trace hosts: []
2016-08-22 07:40:47,145 [tracer.ZooTraceClient] DEBUG: Successfully initialized tracer hosts from ZooKeeper
2016-08-22 07:40:47,145 [trace.DistributedTrace] INFO : SpanReceiver org.apache.accumulo.tracer.ZooTraceClient was loaded successfully.
2016-08-22 07:40:47,145 [master.Master] INFO : trying to get master lock
2016-08-22 07:40:47,156 [master.Master] DEBUG: Acquired master lock
2016-08-22 07:40:47,157 [master.EventCoordinator] INFO : State changed from INITIAL to HAVE_LOCK
2016-08-22 07:40:47,177 [master.EventCoordinator] INFO : State changed from HAVE_LOCK to NORMAL
2016-08-22 07:40:47,179 [master.Master] DEBUG: Finished gathering information from 0 servers in 0.00 seconds
2016-08-22 07:40:47,271 [rpc.RpcWrapper] DEBUG: Found oneway Thrift methods: [reportTabletStatus, reportSplitExtent]
2016-08-22 07:40:47,293 [balancer.TableLoadBalancer] INFO : Loaded class org.apache.accumulo.server.master.balancer.DefaultLoadBalancer for table !0
2016-08-22 07:40:47,302 [balancer.TableLoadBalancer] INFO : Loaded class org.apache.accumulo.server.master.balancer.DefaultLoadBalancer for table +rep
2016-08-22 07:40:47,328 [impl.MetricsConfig] INFO : loaded properties from hadoop-metrics2-accumulo.properties
2016-08-22 07:40:47,329 [balancer.TableLoadBalancer] INFO : Loaded class org.apache.accumulo.server.master.balancer.DefaultLoadBalancer for table +r
2016-08-22 07:40:47,341 [balancer.TableLoadBalancer] INFO : Loaded class org.apache.accumulo.server.master.balancer.DefaultLoadBalancer for table 1
2016-08-22 07:40:47,342 [master.Master] DEBUG: Finished gathering information from 0 servers in 0.00 seconds
2016-08-22 07:40:47,491 [timeline.HadoopTimelineMetricsSink] INFO : Initializing Timeline metrics sink.
2016-08-22 07:40:47,492 [timeline.HadoopTimelineMetricsSink] INFO : Identified hostname = de-hd-cluster.name-node.com, serviceName = accumulo
2016-08-22 07:40:47,492 [timeline.HadoopTimelineMetricsSink] INFO : Collector Uri: http://de-hd-cluster.name-node.com:6188/ws/v1/timeline/metrics
2016-08-22 07:40:47,499 [impl.MetricsSinkAdapter] INFO : Sink timeline started
2016-08-22 07:40:47,551 [impl.MetricsSystemImpl] INFO : Scheduled snapshot period at 60 second(s).
2016-08-22 07:40:47,551 [impl.MetricsSystemImpl] INFO : Accumulo metrics system started
2016-08-22 07:40:47,561 [rpc.TServerUtils] DEBUG: Instantiating default, unsecure custom half-async Thrift server
2016-08-22 07:40:47,566 [master.Master] INFO : Setting master lock data to de-hd-cluster.name-node.com:9999
2016-08-22 07:40:47,573 [zookeeper.ZooLock] DEBUG: Unexpected event watching lock node WatchedEvent state:SyncConnected type:NodeDataChanged path:/accumulo/27dd6c38-9a25-4e75-96c0-8b689579b8da/masters/lock/zlock-0000000033 /accumulo/27dd6c38-9a25-4e75-96c0-8b689579b8da/masters/lock/zlock-0000000033
2016-08-22 07:40:47,576 [replication.WorkDriver] INFO : Initializing work assigner implementation of org.apache.accumulo.master.replication.UnorderedWorkAssigner
2016-08-22 07:40:47,577 [replication.ReplicationDriver] DEBUG: Waiting 0ms before starting main replication loop
2016-08-22 07:40:47,577 [replication.ReplicationDriver] DEBUG: Starting replication loop
2016-08-22 07:40:47,577 [replication.WorkDriver] INFO : Starting replication work assignment thread using org.apache.accumulo.master.replication.UnorderedWorkAssigner
2016-08-22 07:40:47,581 [replication.WorkDriver] DEBUG: Sleeping 30000 ms before next work assignment
2016-08-22 07:40:47,581 [rpc.RpcWrapper] DEBUG: Found oneway Thrift methods: []
2016-08-22 07:40:47,583 [rpc.TServerUtils] DEBUG: Instantiating default, unsecure custom half-async Thrift server
2016-08-22 07:40:47,584 [master.Master] INFO : Started replication coordinator service at de-hd-cluster.name-node.com:10001
2016-08-22 07:40:47,623 [impl.ThriftScanner] DEBUG: Failed to locate tablet for table : !0 row : ~repl
2016-08-22 07:40:52,346 [master.Master] DEBUG: Finished gathering information from 0 servers in 0.00 seconds
2016-08-22 07:40:55,387 [master.Master] INFO : New servers: [de-hd-cluster.data-node3.com:9997[156af79c1e70001]]
2016-08-22 07:40:55,387 [master.EventCoordinator] INFO : There are now 1 tablet servers
2016-08-22 07:40:55,427 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.04 seconds
2016-08-22 07:40:55,429 [balancer.DefaultLoadBalancer] DEBUG: balance ended with 0 migrations
2016-08-22 07:40:55,429 [balancer.DefaultLoadBalancer] DEBUG: balance ended with 0 migrations
2016-08-22 07:40:55,429 [balancer.DefaultLoadBalancer] DEBUG: balance ended with 0 migrations
2016-08-22 07:40:55,429 [balancer.DefaultLoadBalancer] DEBUG: balance ended with 0 migrations
2016-08-22 07:40:55,505 [state.ZooTabletStateStore] DEBUG: root tablet logSet [hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9]
2016-08-22 07:40:55,505 [state.ZooTabletStateStore] DEBUG: Returning root tablet state: +r<<@(null,de-hd-cluster.data-node3.com:9997[25669407cc8000b],de-hd-cluster.data-node3.com:9997[25669407cc8000b])
2016-08-22 07:40:55,510 [recovery.RecoveryManager] DEBUG: Recovering hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9 to hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/recovery/91ece971-7485-4acf-aa7f-dcde00fafce9
2016-08-22 07:40:55,522 [conf.AccumuloConfiguration] INFO : Loaded class : org.apache.accumulo.server.master.recovery.HadoopLogCloser
2016-08-22 07:40:55,523 [recovery.RecoveryManager] INFO : Starting recovery of hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9 (in : 10s), tablet +r<< holds a reference
2016-08-22 07:40:55,524 [master.Master] DEBUG: [Root Table]: scan time 0.03 seconds
2016-08-22 07:40:55,524 [master.Master] DEBUG: [Root Table] sleeping for 60.00 seconds
2016-08-22 07:41:00,435 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.01 seconds
2016-08-22 07:41:00,436 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:41:03,113 [watcher.MonitorLog4jWatcher] INFO : Changing monitor log4j address to de-hd-cluster.name-node.com:4560
2016-08-22 07:41:03,113 [watcher.MonitorLog4jWatcher] INFO : Enabled log-forwarding
2016-08-22 07:41:05,531 [recovery.RecoveryManager] DEBUG: Unable to initate log sort for hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9: java.io.FileNotFoundException: File does not exist: /apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9
	at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
	at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:61)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.recoverLease(FSNamesystem.java:2835)
	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.recoverLease(NameNodeRpcServer.java:733)
	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.recoverLease(ClientNamenodeProtocolServerSideTranslatorPB.java:663)
	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)

2016-08-22 07:41:10,440 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:41:10,440 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:41:17,582 [replication.WorkDriver] DEBUG: Sleeping 30000 ms before next work assignment
2016-08-22 07:41:20,444 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:41:20,444 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:41:22,843 [tracer.ZooTraceClient] DEBUG: Processing event for trace server zk watch
2016-08-22 07:41:22,844 [tracer.ZooTraceClient] DEBUG: Scanning trace hosts in zookeeper: /tracers
2016-08-22 07:41:22,844 [tracer.ZooTraceClient] DEBUG: Trace hosts: [10.79.210.78:12234]
2016-08-22 07:41:30,449 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:41:30,449 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:41:40,453 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:41:40,453 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:41:47,583 [replication.WorkDriver] DEBUG: Sleeping 30000 ms before next work assignment
2016-08-22 07:41:50,457 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:41:50,457 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:41:55,626 [state.ZooTabletStateStore] DEBUG: root tablet logSet [hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9]
2016-08-22 07:41:55,626 [state.ZooTabletStateStore] DEBUG: Returning root tablet state: +r<<@(null,de-hd-cluster.data-node3.com:9997[25669407cc8000b],de-hd-cluster.data-node3.com:9997[25669407cc8000b])
2016-08-22 07:41:55,627 [recovery.RecoveryManager] DEBUG: Recovering hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9 to hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/recovery/91ece971-7485-4acf-aa7f-dcde00fafce9
2016-08-22 07:41:55,635 [conf.AccumuloConfiguration] INFO : Loaded class : org.apache.accumulo.server.master.recovery.HadoopLogCloser
2016-08-22 07:41:55,635 [recovery.RecoveryManager] INFO : Starting recovery of hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9 (in : 20s), tablet +r<< holds a reference
2016-08-22 07:41:55,636 [master.Master] DEBUG: [Root Table]: scan time 0.01 seconds
2016-08-22 07:41:55,636 [master.Master] DEBUG: [Root Table] sleeping for 60.00 seconds
2016-08-22 07:42:00,461 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:42:00,461 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:42:10,466 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:42:10,466 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:42:15,639 [recovery.RecoveryManager] DEBUG: Unable to initate log sort for hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9: java.io.FileNotFoundException: File does not exist: /apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9
	at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
	at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:61)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.recoverLease(FSNamesystem.java:2835)
	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.recoverLease(NameNodeRpcServer.java:733)
	at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.recoverLease(ClientNamenodeProtocolServerSideTranslatorPB.java:663)
	at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)

2016-08-22 07:42:17,584 [replication.WorkDriver] DEBUG: Sleeping 30000 ms before next work assignment
2016-08-22 07:42:20,469 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:42:20,470 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:42:30,474 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:42:30,474 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:42:40,477 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:42:40,478 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:42:47,584 [replication.WorkDriver] DEBUG: Sleeping 30000 ms before next work assignment
2016-08-22 07:42:50,481 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:42:50,481 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:42:55,738 [state.ZooTabletStateStore] DEBUG: root tablet logSet [hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9]
2016-08-22 07:42:55,871 [state.ZooTabletStateStore] DEBUG: Returning root tablet state: +r<<@(null,de-hd-cluster.data-node3.com:9997[25669407cc8000b],de-hd-cluster.data-node3.com:9997[25669407cc8000b])
2016-08-22 07:42:55,872 [recovery.RecoveryManager] DEBUG: Recovering hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9 to hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/recovery/91ece971-7485-4acf-aa7f-dcde00fafce9
2016-08-22 07:42:55,880 [conf.AccumuloConfiguration] INFO : Loaded class : org.apache.accumulo.server.master.recovery.HadoopLogCloser
2016-08-22 07:42:55,880 [recovery.RecoveryManager] INFO : Starting recovery of hdfs://de-hd-cluster.name-node.com:8020/apps/accumulo/data/wal/de-hd-cluster.data-node3.com+9997/91ece971-7485-4acf-aa7f-dcde00fafce9 (in : 40s), tablet +r<< holds a reference
2016-08-22 07:42:55,881 [master.Master] DEBUG: [Root Table]: scan time 0.14 seconds
2016-08-22 07:42:55,881 [master.Master] DEBUG: [Root Table] sleeping for 60.00 seconds
2016-08-22 07:43:00,484 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:43:00,485 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:43:10,488 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:43:14,434 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1
2016-08-22 07:43:17,585 [replication.WorkDriver] DEBUG: Sleeping 30000 ms before next work assignment
2016-08-22 07:43:24,438 [master.Master] DEBUG: Finished gathering information from 1 servers in 0.00 seconds
2016-08-22 07:43:24,438 [master.Master] DEBUG: not balancing because there are unhosted tablets: 1