2018-12-12 17:48:40,139 DEBUG - [main:] ~ FileName set to atlas-buildinfo.properties (AbstractFileConfiguration:588) 2018-12-12 17:48:40,144 DEBUG - [main:] ~ ConfigurationUtils.locate(): base is null, name is atlas-buildinfo.properties (ConfigurationUtils:449) 2018-12-12 17:48:40,144 DEBUG - [main:] ~ Could not locate file atlas-buildinfo.properties at null: no protocol: atlas-buildinfo.properties (DefaultFileSystem:281) 2018-12-12 17:48:40,151 DEBUG - [main:] ~ Loading configuration from the context classpath (atlas-buildinfo.properties) (ConfigurationUtils:550) 2018-12-12 17:48:40,152 DEBUG - [main:] ~ Base path set to jar:file:/mnt/disk1/apps/apache-atlas-1.1.0/server/webapp/atlas/WEB-INF/lib/atlas-webapp-1.1.0.jar!/atlas-buildinfo.properties (AbstractFileConfiguration:626) 2018-12-12 17:48:40,179 INFO - [main:] ~ Loading atlas-application.properties from file:/mnt/disk1/apps/apache-atlas-1.1.0/conf/atlas-application.properties (ApplicationProperties:98) 2018-12-12 17:48:40,180 DEBUG - [main:] ~ Base path set to file:///mnt/disk1/apps/apache-atlas-1.1.0/conf/ (AbstractFileConfiguration:626) 2018-12-12 17:48:40,180 DEBUG - [main:] ~ FileName set to atlas-application.properties (AbstractFileConfiguration:588) 2018-12-12 17:48:40,180 DEBUG - [main:] ~ URL set to file:/mnt/disk1/apps/apache-atlas-1.1.0/conf/atlas-application.properties (AbstractFileConfiguration:726) 2018-12-12 17:48:40,185 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache = true (ApplicationProperties:242) 2018-12-12 17:48:40,185 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache-clean-wait = 20 (ApplicationProperties:242) 2018-12-12 17:48:40,185 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache-size = 0.5 (ApplicationProperties:242) 2018-12-12 17:48:40,185 INFO - [main:] ~ Property (set to default) atlas.graph.cache.tx-cache-size = 15000 (ApplicationProperties:242) 2018-12-12 17:48:40,185 INFO - [main:] ~ Property (set to default) atlas.graph.cache.tx-dirty-size = 120 (ApplicationProperties:242) 2018-12-12 17:48:40,186 DEBUG - [main:] ~ Base path set to null (AbstractFileConfiguration:626) 2018-12-12 17:48:40,186 DEBUG - [main:] ~ FileName set to null (AbstractFileConfiguration:588) 2018-12-12 17:48:40,191 DEBUG - [main:] ~ Configuration loaded: (ApplicationProperties:116) 2018-12-12 17:48:40,191 DEBUG - [main:] ~ atlas.graphdb.backend = org.apache.atlas.repository.graphdb.janus.AtlasJanusGraphDatabase (ApplicationProperties:119) 2018-12-12 17:48:40,191 DEBUG - [main:] ~ atlas.graph.storage.backend = hbase (ApplicationProperties:119) 2018-12-12 17:48:40,191 DEBUG - [main:] ~ atlas.graph.storage.hbase.table = apache_atlas_janus (ApplicationProperties:119) 2018-12-12 17:48:40,191 DEBUG - [main:] ~ atlas.graph.storage.hostname = [emr-worker-2.cluster-82305, emr-worker-1.cluster-82305, emr-header-1.cluster-82305] (ApplicationProperties:119) 2018-12-12 17:48:40,191 DEBUG - [main:] ~ atlas.graph.storage.hbase.regions-per-server = 3 (ApplicationProperties:119) 2018-12-12 17:48:40,191 DEBUG - [main:] ~ atlas.graph.storage.lock.wait-time = 10000 (ApplicationProperties:119) 2018-12-12 17:48:40,191 DEBUG - [main:] ~ atlas.EntityAuditRepository.impl = org.apache.atlas.repository.audit.HBaseBasedAuditRepository (ApplicationProperties:119) 2018-12-12 17:48:40,192 DEBUG - [main:] ~ atlas.graph.index.search.backend = solr5 (ApplicationProperties:119) 2018-12-12 17:48:40,192 DEBUG - [main:] ~ atlas.graph.index.search.solr.mode = cloud (ApplicationProperties:119) 2018-12-12 17:48:40,192 DEBUG - [main:] ~ atlas.graph.index.search.solr.zookeeper-url = [10.4.3.63:2181, 10.4.3.64:2181, 10.4.3.65:2181] (ApplicationProperties:119) 2018-12-12 17:48:40,192 DEBUG - [main:] ~ atlas.graph.index.search.solr.zookeeper-connect-timeout = 60000 (ApplicationProperties:119) 2018-12-12 17:48:40,192 DEBUG - [main:] ~ atlas.graph.index.search.solr.zookeeper-session-timeout = 60000 (ApplicationProperties:119) 2018-12-12 17:48:40,192 DEBUG - [main:] ~ atlas.graph.index.search.solr.wait-searcher = true (ApplicationProperties:119) 2018-12-12 17:48:40,192 DEBUG - [main:] ~ atlas.graph.index.search.max-result-set-size = 150 (ApplicationProperties:119) 2018-12-12 17:48:40,192 DEBUG - [main:] ~ atlas.notification.embedded = true (ApplicationProperties:119) 2018-12-12 17:48:40,192 DEBUG - [main:] ~ atlas.kafka.data = /mnt/disk1/apps/apache-atlas-1.1.0/data/kafka (ApplicationProperties:119) 2018-12-12 17:48:40,192 DEBUG - [main:] ~ atlas.kafka.zookeeper.connect = localhost:9026 (ApplicationProperties:119) 2018-12-12 17:48:40,192 DEBUG - [main:] ~ atlas.kafka.bootstrap.servers = localhost:9027 (ApplicationProperties:119) 2018-12-12 17:48:40,193 DEBUG - [main:] ~ atlas.kafka.zookeeper.session.timeout.ms = 400 (ApplicationProperties:119) 2018-12-12 17:48:40,193 DEBUG - [main:] ~ atlas.kafka.zookeeper.connection.timeout.ms = 200 (ApplicationProperties:119) 2018-12-12 17:48:40,193 DEBUG - [main:] ~ atlas.kafka.zookeeper.sync.time.ms = 20 (ApplicationProperties:119) 2018-12-12 17:48:40,193 DEBUG - [main:] ~ atlas.kafka.auto.commit.interval.ms = 1000 (ApplicationProperties:119) 2018-12-12 17:48:40,193 DEBUG - [main:] ~ atlas.kafka.hook.group.id = atlas (ApplicationProperties:119) 2018-12-12 17:48:40,193 DEBUG - [main:] ~ atlas.kafka.enable.auto.commit = false (ApplicationProperties:119) 2018-12-12 17:48:40,193 DEBUG - [main:] ~ atlas.kafka.auto.offset.reset = earliest (ApplicationProperties:119) 2018-12-12 17:48:40,193 DEBUG - [main:] ~ atlas.kafka.session.timeout.ms = 30000 (ApplicationProperties:119) 2018-12-12 17:48:40,193 DEBUG - [main:] ~ atlas.kafka.offsets.topic.replication.factor = 1 (ApplicationProperties:119) 2018-12-12 17:48:40,193 DEBUG - [main:] ~ atlas.kafka.poll.timeout.ms = 1000 (ApplicationProperties:119) 2018-12-12 17:48:40,194 DEBUG - [main:] ~ atlas.notification.create.topics = true (ApplicationProperties:119) 2018-12-12 17:48:40,194 DEBUG - [main:] ~ atlas.notification.replicas = 1 (ApplicationProperties:119) 2018-12-12 17:48:40,194 DEBUG - [main:] ~ atlas.notification.topics = [ATLAS_HOOK, ATLAS_ENTITIES] (ApplicationProperties:119) 2018-12-12 17:48:40,194 DEBUG - [main:] ~ atlas.notification.log.failed.messages = true (ApplicationProperties:119) 2018-12-12 17:48:40,194 DEBUG - [main:] ~ atlas.notification.consumer.retry.interval = 500 (ApplicationProperties:119) 2018-12-12 17:48:40,194 DEBUG - [main:] ~ atlas.notification.hook.retry.interval = 1000 (ApplicationProperties:119) 2018-12-12 17:48:40,194 DEBUG - [main:] ~ atlas.enableTLS = false (ApplicationProperties:119) 2018-12-12 17:48:40,194 DEBUG - [main:] ~ atlas.authentication.method.kerberos = false (ApplicationProperties:119) 2018-12-12 17:48:40,194 DEBUG - [main:] ~ atlas.authentication.method.file = true (ApplicationProperties:119) 2018-12-12 17:48:40,195 DEBUG - [main:] ~ atlas.authentication.method.ldap.type = none (ApplicationProperties:119) 2018-12-12 17:48:40,195 DEBUG - [main:] ~ atlas.authentication.method.file.filename = /mnt/disk1/apps/apache-atlas-1.1.0/conf/users-credentials.properties (ApplicationProperties:119) 2018-12-12 17:48:40,195 DEBUG - [main:] ~ atlas.rest.address = http://10.4.3.64:21000 (ApplicationProperties:119) 2018-12-12 17:48:40,195 DEBUG - [main:] ~ atlas.audit.hbase.tablename = apache_atlas_entity_audit (ApplicationProperties:119) 2018-12-12 17:48:40,195 DEBUG - [main:] ~ atlas.audit.zookeeper.session.timeout.ms = 1000 (ApplicationProperties:119) 2018-12-12 17:48:40,195 DEBUG - [main:] ~ atlas.audit.hbase.zookeeper.quorum = [10.4.3.63:2181, 10.4.3.64:2181, 10.4.3.65:2181] (ApplicationProperties:119) 2018-12-12 17:48:40,195 DEBUG - [main:] ~ atlas.server.ha.enabled = false (ApplicationProperties:119) 2018-12-12 17:48:40,195 DEBUG - [main:] ~ atlas.authorizer.impl = simple (ApplicationProperties:119) 2018-12-12 17:48:40,195 DEBUG - [main:] ~ atlas.authorizer.simple.authz.policy.file = atlas-simple-authz-policy.json (ApplicationProperties:119) 2018-12-12 17:48:40,195 DEBUG - [main:] ~ atlas.rest-csrf.enabled = true (ApplicationProperties:119) 2018-12-12 17:48:40,195 DEBUG - [main:] ~ atlas.rest-csrf.browser-useragents-regex = [^Mozilla.*, ^Opera.*, ^Chrome.*] (ApplicationProperties:119) 2018-12-12 17:48:40,195 DEBUG - [main:] ~ atlas.rest-csrf.methods-to-ignore = [GET, OPTIONS, HEAD, TRACE] (ApplicationProperties:119) 2018-12-12 17:48:40,196 DEBUG - [main:] ~ atlas.rest-csrf.custom-header = X-XSRF-HEADER (ApplicationProperties:119) 2018-12-12 17:48:40,196 DEBUG - [main:] ~ atlas.metric.query.cache.ttlInSecs = 900 (ApplicationProperties:119) 2018-12-12 17:48:40,196 DEBUG - [main:] ~ atlas.search.gremlin.enable = false (ApplicationProperties:119) 2018-12-12 17:48:40,196 DEBUG - [main:] ~ atlas.graph.cache.db-cache = true (ApplicationProperties:119) 2018-12-12 17:48:40,196 DEBUG - [main:] ~ atlas.graph.cache.db-cache-clean-wait = 20 (ApplicationProperties:119) 2018-12-12 17:48:40,196 DEBUG - [main:] ~ atlas.graph.cache.db-cache-size = 0.5 (ApplicationProperties:119) 2018-12-12 17:48:40,196 DEBUG - [main:] ~ atlas.graph.cache.tx-cache-size = 15000 (ApplicationProperties:119) 2018-12-12 17:48:40,196 DEBUG - [main:] ~ atlas.graph.cache.tx-dirty-size = 120 (ApplicationProperties:119) 2018-12-12 17:48:40,198 DEBUG - [main:] ~ ==> InMemoryJAASConfiguration.init() (InMemoryJAASConfiguration:180) 2018-12-12 17:48:40,200 DEBUG - [main:] ~ ==> InMemoryJAASConfiguration.init() (InMemoryJAASConfiguration:193) 2018-12-12 17:48:40,205 DEBUG - [main:] ~ ==> InMemoryJAASConfiguration.initialize() (InMemoryJAASConfiguration:250) 2018-12-12 17:48:40,205 DEBUG - [main:] ~ <== InMemoryJAASConfiguration.initialize({}) (InMemoryJAASConfiguration:377) 2018-12-12 17:48:40,205 DEBUG - [main:] ~ <== InMemoryJAASConfiguration.init() (InMemoryJAASConfiguration:202) 2018-12-12 17:48:40,205 DEBUG - [main:] ~ <== InMemoryJAASConfiguration.init() (InMemoryJAASConfiguration:189) 2018-12-12 17:48:40,208 INFO - [main:] ~ ######################################################################################## Atlas Server (STARTUP) project.name: apache-atlas project.description: Metadata Management and Data Governance Platform over Hadoop build.user: yiyang build.epoch: 1543909512845 project.version: 1.1.0 build.version: 1.1.0 vc.revision: release vc.source.url: scm:git:git://git.apache.org/atlas.git/atlas-webapp ######################################################################################## (Atlas:215) 2018-12-12 17:48:40,208 INFO - [main:] ~ >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> (Atlas:216) 2018-12-12 17:48:40,208 INFO - [main:] ~ Server starting with TLS ? false on port 21000 (Atlas:217) 2018-12-12 17:48:40,208 INFO - [main:] ~ <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< (Atlas:218) 2018-12-12 17:48:40,759 INFO - [main:] ~ Set web app root system property: 'webapp.root' = [/mnt/disk1/apps/apache-atlas-1.1.0/server/webapp/atlas] (ContextHandler$Context:2167) 2018-12-12 17:48:40,771 DEBUG - [main:] ~ setsid exited with exit code 0 (Shell:397) 2018-12-12 17:48:40,816 DEBUG - [main:] ~ field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[Rate of successful kerberos logins and latency (milliseconds)]) (MutableMetricsFactory:42) 2018-12-12 17:48:40,817 DEBUG - [main:] ~ field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[Rate of failed kerberos logins and latency (milliseconds)]) (MutableMetricsFactory:42) 2018-12-12 17:48:40,818 DEBUG - [main:] ~ field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.getGroups with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, valueName=Time, value=[GetGroups]) (MutableMetricsFactory:42) 2018-12-12 17:48:40,818 DEBUG - [main:] ~ UgiMetrics, User and group related metrics (MetricsSystemImpl:232) 2018-12-12 17:48:40,897 DEBUG - [main:] ~ Creating new Groups object (Groups:301) 2018-12-12 17:48:40,899 DEBUG - [main:] ~ Trying to load the custom-built native-hadoop library... (NativeCodeLoader:46) 2018-12-12 17:48:40,899 DEBUG - [main:] ~ Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path (NativeCodeLoader:55) 2018-12-12 17:48:40,900 DEBUG - [main:] ~ java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (NativeCodeLoader:56) 2018-12-12 17:48:40,900 WARN - [main:] ~ Unable to load native-hadoop library for your platform... using builtin-java classes where applicable (NativeCodeLoader:62) 2018-12-12 17:48:40,900 DEBUG - [main:] ~ Falling back to shell based (JniBasedUnixGroupsMappingWithFallback:41) 2018-12-12 17:48:40,900 DEBUG - [main:] ~ Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping (JniBasedUnixGroupsMappingWithFallback:45) 2018-12-12 17:48:40,924 DEBUG - [main:] ~ Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=300000; warningDeltaMs=5000 (Groups:112) 2018-12-12 17:48:40,927 DEBUG - [main:] ~ hadoop login (UserGroupInformation$HadoopLoginModule:221) 2018-12-12 17:48:40,927 DEBUG - [main:] ~ hadoop login commit (UserGroupInformation$HadoopLoginModule:156) 2018-12-12 17:48:40,931 DEBUG - [main:] ~ using local user:UnixPrincipal: root (UserGroupInformation$HadoopLoginModule:186) 2018-12-12 17:48:40,931 DEBUG - [main:] ~ Using user: "UnixPrincipal: root" with name root (UserGroupInformation$HadoopLoginModule:192) 2018-12-12 17:48:40,931 DEBUG - [main:] ~ User entry: "root" (UserGroupInformation$HadoopLoginModule:202) 2018-12-12 17:48:40,932 DEBUG - [main:] ~ UGI loginUser:root (auth:SIMPLE) (UserGroupInformation:826) 2018-12-12 17:48:40,932 INFO - [main:] ~ Logged in user root (auth:SIMPLE) (LoginProcessor:77) 2018-12-12 17:48:40,933 INFO - [main:] ~ Initializing Spring root WebApplicationContext (ContextHandler$Context:2167) 2018-12-12 17:48:41,512 INFO - [main:] ~ Not running setup per configuration atlas.server.run.setup.on.start. (SetupSteps$SetupRequired:189) 2018-12-12 17:48:42,526 INFO - [main:] ~ Instantiated HBase compatibility layer supporting runtime HBase version 1.1.2: org.janusgraph.diskstorage.hbase.HBaseCompat1_0 (HBaseCompatLoader:79) 2018-12-12 17:48:42,552 DEBUG - [main:] ~ HBase configuration: set a total of 0 configuration values (HBaseStoreManager:311) 2018-12-12 17:48:42,552 INFO - [main:] ~ Copied host list from root.storage.hostname to hbase.zookeeper.quorum: emr-worker-2.cluster-82305,emr-worker-1.cluster-82305,emr-header-1.cluster-82305 (HBaseStoreManager:318) 2018-12-12 17:48:42,606 INFO - [main:] ~ Failed to obtain graph instance, retrying 3 times, error: java.lang.IllegalArgumentException: Could not instantiate implementation: org.janusgraph.diskstorage.hbase.HBaseStoreManager (AtlasGraphProvider:86) 2018-12-12 17:49:12,608 DEBUG - [main:] ~ Returning cached HBase compatibility layer: org.janusgraph.diskstorage.hbase.HBaseCompat1_0@4693a9ef (HBaseCompatLoader:40) 2018-12-12 17:49:12,621 DEBUG - [main:] ~ HBase configuration: set a total of 0 configuration values (HBaseStoreManager:311) 2018-12-12 17:49:12,621 INFO - [main:] ~ Copied host list from root.storage.hostname to hbase.zookeeper.quorum: emr-worker-2.cluster-82305,emr-worker-1.cluster-82305,emr-header-1.cluster-82305 (HBaseStoreManager:318) 2018-12-12 17:49:12,622 INFO - [main:] ~ Failed to obtain graph instance on retry 1 of 3 error: java.lang.IllegalArgumentException: Could not instantiate implementation: org.janusgraph.diskstorage.hbase.HBaseStoreManager (AtlasGraphProvider:104) 2018-12-12 17:49:42,623 DEBUG - [main:] ~ Returning cached HBase compatibility layer: org.janusgraph.diskstorage.hbase.HBaseCompat1_0@4693a9ef (HBaseCompatLoader:40) 2018-12-12 17:49:42,636 DEBUG - [main:] ~ HBase configuration: set a total of 0 configuration values (HBaseStoreManager:311) 2018-12-12 17:49:42,636 INFO - [main:] ~ Copied host list from root.storage.hostname to hbase.zookeeper.quorum: emr-worker-2.cluster-82305,emr-worker-1.cluster-82305,emr-header-1.cluster-82305 (HBaseStoreManager:318) 2018-12-12 17:49:42,637 INFO - [main:] ~ Failed to obtain graph instance on retry 2 of 3 error: java.lang.IllegalArgumentException: Could not instantiate implementation: org.janusgraph.diskstorage.hbase.HBaseStoreManager (AtlasGraphProvider:104) 2018-12-12 17:50:12,638 DEBUG - [main:] ~ Returning cached HBase compatibility layer: org.janusgraph.diskstorage.hbase.HBaseCompat1_0@4693a9ef (HBaseCompatLoader:40) 2018-12-12 17:50:12,650 DEBUG - [main:] ~ HBase configuration: set a total of 0 configuration values (HBaseStoreManager:311) 2018-12-12 17:50:12,651 INFO - [main:] ~ Copied host list from root.storage.hostname to hbase.zookeeper.quorum: emr-worker-2.cluster-82305,emr-worker-1.cluster-82305,emr-header-1.cluster-82305 (HBaseStoreManager:318) 2018-12-12 17:50:12,652 INFO - [main:] ~ Failed to obtain graph instance on retry 3 of 3 error: java.lang.IllegalArgumentException: Could not instantiate implementation: org.janusgraph.diskstorage.hbase.HBaseStoreManager (AtlasGraphProvider:104) 2018-12-12 17:50:12,652 INFO - [main:] ~ Max retries exceeded. (AtlasGraphProvider:107)