Created 04-26-2017 03:01 PM
Atlas is installed in HDP2.5 with Kerberos. Atlas service in Ambari runs ok. I can not open Atlas UI.
More information in /var/log/atlas/application.log:
2017-04-25 11:14:05,984 WARN - [main:] ~ FAILED o.e.j.w.WebAppContext@72e1bcb8{/,file:/usr/hdp/2.5.3.0-37/atlas/server/webapp/atlas/,STARTING}{/usr/hdp/current/atlas-server/server/webapp/atlas}: java.lang.ExceptionInInitializerError (AbstractLifeCycle:212) java.lang.ExceptionInInitializerError …… Caused by: java.lang.IllegalArgumentException: Could not instantiate implementation: com.thinkaurelius.titan.diskstorage.solr.Solr5Index at com.thinkaurelius.titan.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:55) ... 32 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ... 42 more Caused by: org.apache.solr.common.SolrException: Cannot connect to cluster at sandbox.mydomain.local:2181: cluster not found/not ready at com.thinkaurelius.titan.diskstorage.solr.Solr5Index.<init>(Solr5Index.java:213) ... 47 more |
After run atlas service check in Ambari, following errors:
2017-04-25 13:18:43,255 - Stack Feature Version Info: stack_version=2.5, version=None, current_cluster_version=2.5.3.0-37 -> 2.5 2017-04-25 13:18:43,257 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2017-04-25 13:18:43,262 - Execute['/usr/bin/kinit -kt /etc/security/keytabs/smokeuser.headless.keytab ambari-qa@MYDOMAIN.LOCAL'] {'user': 'ambari-qa'} 2017-04-25 13:18:43,312 - Execute['curl --negotiate -u : -b ~/cookiejar.txt -c ~/cookiejar.txt -s -o /dev/null -w "%{http_code}" http://sandbox.mydomain.local:21000/'] {'tries': 5, 'user': 'ambari-qa', 'try_sleep': 10} 2017-04-25 13:19:13,363 - Retrying after 10 seconds. Reason: Execution of 'curl --negotiate -u : -b ~/cookiejar.txt -c ~/cookiejar.txt -s -o /dev/null -w "%{http_code}" http://sandbox.mydomain.local:21000/' returned 52. 000 2017-04-25 13:19:53,453 - Retrying after 10 seconds. Reason: Execution of 'curl --negotiate -u : -b ~/cookiejar.txt -c ~/cookiejar.txt -s -o /dev/null -w "%{http_code}" http://sandbox.mydomain.local:21000/' returned 52. 000 2017-04-25 13:20:33,828 - Retrying after 10 seconds. Reason: Execution of 'curl --negotiate -u : -b ~/cookiejar.txt -c ~/cookiejar.txt -s -o /dev/null -w "%{http_code}" http://sandbox.mydomain.local:21000/' returned 52. 000 2017-04-25 13:21:13,913 - Retrying after 10 seconds. Reason: Execution of 'curl --negotiate -u : -b ~/cookiejar.txt -c ~/cookiejar.txt -s -o /dev/null -w "%{http_code}" http://sandbox.mydomain.local:21000/' returned 52. 000 Command completed successfully! |
Atlas advanced config, Advanced application-properties, is as follows:
atlas-application.properties # Generated by Apache Ambari. Tue Apr 25 11:13:21 2017 atlas.audit.hbase.tablename=ATLAS_ENTITY_AUDIT_EVENTS atlas.audit.hbase.zookeeper.quorum=sandbox.mydomain.local atlas.audit.zookeeper.session.timeout.ms=1000 atlas.auth.policy.file=/etc/atlas/conf/policy-store.txt atlas.authentication.keytab=/etc/security/keytabs/atlas.service.keytab atlas.authentication.method.file=true atlas.authentication.method.file.filename=/etc/atlas/conf/users-credentials.properties atlas.authentication.method.kerberos=true atlas.authentication.method.kerberos.keytab=/etc/security/keytabs/spnego.service.keytab atlas.authentication.method.kerberos.name.rules=RULE:[1:$1@$0](ambari-qa@MYDOMAIN.LOCAL)s/.*/ambari-qa/\ RULE:[1:$1@$0](hbase@MYDOMAIN.LOCAL)s/.*/hbase/\ RULE:[1:$1@$0](hdfs@MYDOMAIN.LOCAL)s/.*/hdfs/\ RULE:[1:$1@$0](.*@MYDOMAIN.LOCAL)s/@.*//\ RULE:[2:$1@$0](amshbase@MYDOMAIN.LOCAL)s/.*/ams/\ RULE:[2:$1@$0](amshbase@MYDOMAIN.LOCAL)s/.*/hbase/\ RULE:[2:$1@$0](amszk@MYDOMAIN.LOCAL)s/.*/ams/\ RULE:[2:$1@$0](atlas@MYDOMAIN.LOCAL)s/.*/atlas/\ RULE:[2:$1@$0](dn@MYDOMAIN.LOCAL)s/.*/hdfs/\ RULE:[2:$1@$0](hbase@MYDOMAIN.LOCAL)s/.*/hbase/\ RULE:[2:$1@$0](hive@MYDOMAIN.LOCAL)s/.*/hive/\ RULE:[2:$1@$0](jhs@MYDOMAIN.LOCAL)s/.*/mapred/\ RULE:[2:$1@$0](jn@MYDOMAIN.LOCAL)s/.*/hdfs/\ RULE:[2:$1@$0](nfs@MYDOMAIN.LOCAL)s/.*/hdfs/\ RULE:[2:$1@$0](nm@MYDOMAIN.LOCAL)s/.*/yarn/\ RULE:[2:$1@$0](nn@MYDOMAIN.LOCAL)s/.*/hdfs/\ RULE:[2:$1@$0](oozie@MYDOMAIN.LOCAL)s/.*/oozie/\ RULE:[2:$1@$0](rangeradmin@MYDOMAIN.LOCAL)s/.*/ranger/\ RULE:[2:$1@$0](rangertagsync@MYDOMAIN.LOCAL)s/.*/rangertagsync/\ RULE:[2:$1@$0](rangerusersync@MYDOMAIN.LOCAL)s/.*/rangerusersync/\ RULE:[2:$1@$0](rm@MYDOMAIN.LOCAL)s/.*/yarn/\ RULE:[2:$1@$0](yarn@MYDOMAIN.LOCAL)s/.*/yarn/\ DEFAULT atlas.authentication.method.kerberos.principal=HTTP/_HOST@MYDOMAIN.LOCAL atlas.authentication.method.ldap=false atlas.authentication.method.ldap.ad.base.dn= atlas.authentication.method.ldap.ad.bind.dn= atlas.authentication.method.ldap.ad.bind.password= atlas.authentication.method.ldap.ad.default.role=ROLE_USER atlas.authentication.method.ldap.ad.domain= atlas.authentication.method.ldap.ad.referral=ignore atlas.authentication.method.ldap.ad.url= atlas.authentication.method.ldap.ad.user.searchfilter=(sAMAccountName={0}) atlas.authentication.method.ldap.base.dn=dc=mydomain,dc=local atlas.authentication.method.ldap.bind.dn=cn=atlasldap,dc=mydomain,dc=local atlas.authentication.method.ldap.bind.password=reverse atlas.authentication.method.ldap.default.role=ROLE_USER atlas.authentication.method.ldap.groupRoleAttribute=cn atlas.authentication.method.ldap.groupSearchBase=dc=mydomain,dc=local atlas.authentication.method.ldap.groupSearchFilter=(member=cn={0},ou=users,dc=mydomain,dc=local atlas.authentication.method.ldap.referral=ignore atlas.authentication.method.ldap.type=ldap atlas.authentication.method.ldap.url=ldaps://sandbox.mydomain.local:636 atlas.authentication.method.ldap.user.searchfilter=(uid={0}) atlas.authentication.method.ldap.userDNpattern=uid={0],ou=users,dc=mydomain,dc=local atlas.authentication.principal=atlas/_HOST@MYDOMAIN.LOCAL atlas.authorizer.impl=ranger atlas.cluster.name=sandbox atlas.enableTLS=false atlas.graph.index.search.backend=solr5 atlas.graph.index.search.solr.mode=cloud atlas.graph.index.search.solr.zookeeper-url=sandbox.mydomain.local:2181 atlas.graph.storage.backend=hbase atlas.graph.storage.hbase.table=atlas_titan atlas.graph.storage.hostname=sandbox.mydomain.local atlas.jaas.KafkaClient.loginModuleControlFlag=required atlas.jaas.KafkaClient.loginModuleName=com.sun.security.auth.module.Krb5LoginModule atlas.jaas.KafkaClient.option.keyTab=/etc/security/keytabs/atlas.service.keytab atlas.jaas.KafkaClient.option.principal=atlas/_HOST@MYDOMAIN.LOCAL atlas.jaas.KafkaClient.option.serviceName=kafka atlas.jaas.KafkaClient.option.storeKey=true atlas.jaas.KafkaClient.option.useKeyTab=true atlas.kafka.auto.commit.enable=false atlas.kafka.bootstrap.servers=sandbox.mydomain.local:6667 atlas.kafka.hook.group.id=atlas atlas.kafka.sasl.kerberos.service.name=kafka atlas.kafka.security.protocol=PLAINTEXTSASL atlas.kafka.zookeeper.connect=sandbox.mydomain.local:2181 atlas.kafka.zookeeper.connection.timeout.ms=200 atlas.kafka.zookeeper.session.timeout.ms=400 atlas.kafka.zookeeper.sync.time.ms=20 atlas.lineage.schema.query.hive_table=hive_table where __guid='%s'\, columns atlas.lineage.schema.query.Table=Table where __guid='%s'\, columns atlas.notification.create.topics=true atlas.notification.embedded=false atlas.notification.replicas=1 atlas.notification.topics=ATLAS_HOOK,ATLAS_ENTITIES atlas.rest.address=http://sandbox.mydomain.local:21000 atlas.server.address.id1=sandbox.mydomain.local:21000 atlas.server.bind.address=sandbox.mydomain.local atlas.server.ha.enabled=false atlas.server.http.port=21000 atlas.server.https.port=21443 atlas.server.ids=id1 atlas.solr.kerberos.enable=true |
Created 04-26-2017 04:45 PM
Can you check if Ambari Infra ( Solr) is up ? If yes since it kerberos env you take spnego tgt and can you try to access Solr UI ?
Created 04-28-2017 10:02 AM
When change atlas.graph.index.search.solr.mode: <zk_host1>:2181/infra-solr,<zk_host2>:2181/infra-solr,<zk_host3>:2181/infra-solr, then restart ambari infra solr and atlas, still the same error.