Member since
01-31-2022
4
Posts
0
Kudos Received
0
Solutions
02-15-2022
03:54 PM
I've already got Atlas working and different hooks configured in other services in my Kerberized CDP Private Cloud Base 7.1.6. I still don't have as many entities as I would expect to see. I tried to sync the Hive Metastore but can't pass an authentication error and cannot find which log to look to get more information. I've the superuser ticket generated with kinit and when I run the import-hive.sh script in the server where the Hive Metastore is installed, the following message is printed: [root@<metastore-server> ~]# /opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/hook-bin/import-hive.sh -d inventarios Using Hive configuration directory [/etc/hive/conf] /etc/hive/conf:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/hadoop/libexec/../../hadoop/lib/*:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/hadoop/libexec/../../hadoop/.//*:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/hadoop/libexec/../../hadoop-hdfs/./:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/hadoop/libexec/../../hadoop-hdfs/lib/*:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/hadoop/libexec/../../hadoop-hdfs/.//*:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//*:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/hadoop/libexec/../../hadoop-yarn/./:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/hadoop/libexec/../../hadoop-yarn/lib/*:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/hadoop/libexec/../../hadoop-yarn/.//* Log file for import is /var/log/atlas/import-hive.log SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/jars/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/jars/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console. Set system property 'log4j2.debug' to show Log4j2 internal initialization logging. 10:10:59.450 [main] ERROR org.apache.atlas.hive.bridge.HiveMetaStoreBridge - Import failed com.sun.jersey.api.client.ClientHandlerException: java.io.IOException: org.apache.hadoop.security.authentication.client.AuthenticationException: Error while authenticating with endpoint: https://<atlas-server>:31443/api/atlas/v2/entity/uniqueAttribute/type/hive_db?attr%3AqualifiedName=inventarios%40cm&ignoreRelationships=true&minExtInfo=true at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155) ~[jersey-client-1.19.jar:1.19] at com.sun.jersey.api.client.Client.handle(Client.java:652) ~[jersey-client-1.19.jar:1.19] at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682) ~[jersey-client-1.19.jar:1.19] at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74) ~[jersey-client-1.19.jar:1.19] at com.sun.jersey.api.client.WebResource$Builder.method(WebResource.java:634) ~[jersey-client-1.19.jar:1.19] at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:402) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:366) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:352) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:245) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.AtlasClientV2.getEntityByAttribute(AtlasClientV2.java:376) ~[atlas-client-v2-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.findEntity(HiveMetaStoreBridge.java:820) ~[hive-bridge-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.findDatabase(HiveMetaStoreBridge.java:785) ~[hive-bridge-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.registerDatabase(HiveMetaStoreBridge.java:455) ~[hive-bridge-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importDatabases(HiveMetaStoreBridge.java:323) ~[hive-bridge-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importHiveMetadata(HiveMetaStoreBridge.java:293) ~[hive-bridge-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:193) [hive-bridge-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] Caused by: java.io.IOException: org.apache.hadoop.security.authentication.client.AuthenticationException: Error while authenticating with endpoint: https://<atlas-server>:31443/api/atlas/v2/entity/uniqueAttribute/type/hive_db?attr%3AqualifiedName=inventarios%40cm&ignoreRelationships=true&minExtInfo=true at org.apache.atlas.security.SecureClientUtils$1$1.run(SecureClientUtils.java:101) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.security.SecureClientUtils$1$1.run(SecureClientUtils.java:94) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_181] at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_181] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898) ~[hadoop-common-3.1.1.7.1.6.0-297.jar:?] at org.apache.atlas.security.SecureClientUtils$1.getHttpURLConnection(SecureClientUtils.java:94) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:165) ~[jersey-client-1.19.jar:1.19] at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ~[jersey-client-1.19.jar:1.19] ... 15 more Caused by: org.apache.hadoop.security.authentication.client.AuthenticationException: Error while authenticating with endpoint: https://<atlas-server>:31443/api/atlas/v2/entity/uniqueAttribute/type/hive_db?attr%3AqualifiedName=inventarios%40cm&ignoreRelationships=true&minExtInfo=true at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_181] at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:1.8.0_181] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:1.8.0_181] at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[?:1.8.0_181] at org.apache.hadoop.security.authentication.client.KerberosAuthenticator.wrapExceptionWithMessage(KerberosAuthenticator.java:237) ~[hadoop-auth-3.1.1.7.1.6.0-297.jar:?] at org.apache.hadoop.security.authentication.client.KerberosAuthenticator.authenticate(KerberosAuthenticator.java:220) ~[hadoop-auth-3.1.1.7.1.6.0-297.jar:?] at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator.authenticate(DelegationTokenAuthenticator.java:143) ~[hadoop-common-3.1.1.7.1.6.0-297.jar:?] at org.apache.hadoop.security.authentication.client.AuthenticatedURL.openConnection(AuthenticatedURL.java:348) ~[hadoop-auth-3.1.1.7.1.6.0-297.jar:?] at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticatedURL.openConnection(DelegationTokenAuthenticatedURL.java:329) ~[hadoop-common-3.1.1.7.1.6.0-297.jar:?] at org.apache.atlas.security.SecureClientUtils$1$1.run(SecureClientUtils.java:99) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.security.SecureClientUtils$1$1.run(SecureClientUtils.java:94) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_181] at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_181] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898) ~[hadoop-common-3.1.1.7.1.6.0-297.jar:?] at org.apache.atlas.security.SecureClientUtils$1.getHttpURLConnection(SecureClientUtils.java:94) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:165) ~[jersey-client-1.19.jar:1.19] at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ~[jersey-client-1.19.jar:1.19] ... 15 more Caused by: org.apache.hadoop.security.authentication.client.AuthenticationException: Authentication failed, URL: https://<atlas-server>:31443/api/atlas/v2/entity/uniqueAttribute/type/hive_db?attr%3AqualifiedName=inventarios%40cm&ignoreRelationships=true&minExtInfo=true&user.name=superuser, status: 500, message: Server Error at org.apache.hadoop.security.authentication.client.AuthenticatedURL.extractToken(AuthenticatedURL.java:401) ~[hadoop-auth-3.1.1.7.1.6.0-297.jar:?] at org.apache.hadoop.security.authentication.client.PseudoAuthenticator.authenticate(PseudoAuthenticator.java:74) ~[hadoop-auth-3.1.1.7.1.6.0-297.jar:?] at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator.authenticate(DelegationTokenAuthenticator.java:143) ~[hadoop-common-3.1.1.7.1.6.0-297.jar:?] at org.apache.hadoop.security.authentication.client.KerberosAuthenticator.authenticate(KerberosAuthenticator.java:214) ~[hadoop-auth-3.1.1.7.1.6.0-297.jar:?] at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator.authenticate(DelegationTokenAuthenticator.java:143) ~[hadoop-common-3.1.1.7.1.6.0-297.jar:?] at org.apache.hadoop.security.authentication.client.AuthenticatedURL.openConnection(AuthenticatedURL.java:348) ~[hadoop-auth-3.1.1.7.1.6.0-297.jar:?] at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticatedURL.openConnection(DelegationTokenAuthenticatedURL.java:329) ~[hadoop-common-3.1.1.7.1.6.0-297.jar:?] at org.apache.atlas.security.SecureClientUtils$1$1.run(SecureClientUtils.java:99) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at org.apache.atlas.security.SecureClientUtils$1$1.run(SecureClientUtils.java:94) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_181] at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_181] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898) ~[hadoop-common-3.1.1.7.1.6.0-297.jar:?] at org.apache.atlas.security.SecureClientUtils$1.getHttpURLConnection(SecureClientUtils.java:94) ~[atlas-client-common-2.1.0.7.1.6.0-297.jar:2.1.0.7.1.6.0-297] at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:165) ~[jersey-client-1.19.jar:1.19] at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ~[jersey-client-1.19.jar:1.19] ... 15 more Failed to import Hive Meta Data!!! I'm still trying to find where to look for more information about the error, since the authentication attempt doesn't appears on the /var/log/atlas/application.log. Thank you in advance for your help.
... View more
Labels:
02-09-2022
04:26 PM
Thank you shehbazk! This solved the issue
... View more
02-01-2022
11:42 AM
Update: I was able to find another log which actually presents an error; although I've still been unable to solve the issue. The error seems to be over the Jetty's WebApp Context. Log file: /var/run/cloudera-scm-agent/process/6759-atlas-ATLAS_SERVER/logs/stderr.log + classpath='/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/conf:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/server/webapp/atlas/WEB-INF/classes:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/server/webapp/atlas/WEB-INF/lib/*:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/libext/*:/var/run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/hbase-conf:/var/run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/conf' + ATLAS_START_COMMAND='/usr/java/jdk1.8.0_181-cloudera/bin/java -Dproc_atlasmetadata -Datlas.log.dir=/var/log/atlas -Datlas.log.file=application.log -Datlas.home=/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas -Datlas.conf=/var/run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/conf -Xms8192m -Xmx8192m -XX:MaxNewSize=614m -XX:MetaspaceSize=100M -XX:MaxMetaspaceSize=512m -server -XX:SoftRefLRUPolicyMSPerMB=0 -XX:+CMSClassUnloadingEnabled -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:+PrintTenuringDistribution -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=dumps/atlas_server.hprof -Xloggc:/var/log/atlas/gc-worker.log -verbose:gc -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1m -XX:+PrintGCDetails -XX:+PrintHeapAtGC -XX:+PrintGCTimeStamps -Dsun.security.krb5.disableReferrals=true -Djdk.tls.ephemeralDHKeySize=2048 -Dlog4j.configuration=file:/var/run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/conf/atlas-log4j.properties -Djava.security.auth.login.config=/var/run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/conf/atlas_jaas.conf -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/atlas_atlas-ATLAS_SERVER-350b5a9cc90886417b36cedb69cedd15_pid29622.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh -classpath /opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/conf:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/server/webapp/atlas/WEB-INF/classes:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/server/webapp/atlas/WEB-INF/lib/*:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/libext/*:/var/run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/hbase-conf:/var/run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/conf org.apache.atlas.Atlas -app /opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/server/webapp/atlas' + exec /usr/java/jdk1.8.0_181-cloudera/bin/java -Dproc_atlasmetadata -Datlas.log.dir=/var/log/atlas -Datlas.log.file=application.log -Datlas.home=/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas -Datlas.conf=/var/run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/conf -Xms8192m -Xmx8192m -XX:MaxNewSize=614m -XX:MetaspaceSize=100M -XX:MaxMetaspaceSize=512m -server -XX:SoftRefLRUPolicyMSPerMB=0 -XX:+CMSClassUnloadingEnabled -XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled -XX:+PrintTenuringDistribution -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=dumps/atlas_server.hprof -Xloggc:/var/log/atlas/gc-worker.log -verbose:gc -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=1m -XX:+PrintGCDetails -XX:+PrintHeapAtGC -XX:+PrintGCTimeStamps -Dsun.security.krb5.disableReferrals=true -Djdk.tls.ephemeralDHKeySize=2048 -Dlog4j.configuration=file:/var/run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/conf/atlas-log4j.properties -Djava.security.auth.login.config=/var/run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/conf/atlas_jaas.conf -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/atlas_atlas-ATLAS_SERVER-350b5a9cc90886417b36cedb69cedd15_pid29622.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh -classpath '/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/conf:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/server/webapp/atlas/WEB-INF/classes:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/server/webapp/atlas/WEB-INF/lib/*:/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/libext/*:/var/run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/hbase-conf:/var/run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/conf' org.apache.atlas.Atlas -app /opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/server/webapp/atlas log4j:WARN No such property [maxFileSize] in org.apache.log4j.PatternLayout. log4j:WARN No such property [maxBackupIndex] in org.apache.log4j.PatternLayout. log4j:ERROR Could not find value for key log4j.appender.METRICS.layout log4j:WARN No such property [maxFileSize] in org.apache.log4j.PatternLayout. log4j:WARN No such property [maxBackupIndex] in org.apache.log4j.PatternLayout. log4j:WARN No such property [maxFileSize] in org.apache.log4j.PatternLayout. log4j:WARN No such property [maxBackupIndex] in org.apache.log4j.PatternLayout. log4j:ERROR Could not find value for key log4j.appender.LARGE_MESSAGE log4j:ERROR Could not instantiate appender named "LARGE_MESSAGE". 2022-02-01 10:20:53,954 WARN - [main:] ~ Failed startup of context o.e.j.w.WebAppContext@50313382{/,file:///opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/server/webapp/atlas/,UNAVAILABLE}{/opt/cloudera/parcels/CDH-7.1.6-1.cdh7.1.6.p0.10506313/lib/atlas/server/webapp/atlas} (WebAppContext:533) java.net.ConnectException: Connection timed out (Connection timed out) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at sun.net.NetworkClient.doConnect(NetworkClient.java:180) at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) at sun.net.www.http.HttpClient.<init>(HttpClient.java:242) at sun.net.www.http.HttpClient.New(HttpClient.java:339) at sun.net.www.http.HttpClient.New(HttpClient.java:357) at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1220) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:984) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.setupCurrentEntity(XMLEntityManager.java:647) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startEntity(XMLEntityManager.java:1304) at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.startDTDEntity(XMLEntityManager.java:1270) at com.sun.org.apache.xerces.internal.impl.XMLDTDScannerImpl.setInputSource(XMLDTDScannerImpl.java:264) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.dispatch(XMLDocumentScannerImpl.java:1161) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$DTDDriver.next(XMLDocumentScannerImpl.java:1045) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(XMLDocumentScannerImpl.java:959) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:602) at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:112) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:505) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:842) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:771) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1213) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:643) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl.parse(SAXParserImpl.java:327) at org.eclipse.jetty.xml.XmlParser.parse(XmlParser.java:244) at org.eclipse.jetty.webapp.Descriptor.parse(Descriptor.java:53) at org.eclipse.jetty.webapp.WebDescriptor.parse(WebDescriptor.java:213) at org.eclipse.jetty.webapp.MetaData.setWebXml(MetaData.java:193) at org.eclipse.jetty.webapp.WebXmlConfiguration.preConfigure(WebXmlConfiguration.java:55) at org.eclipse.jetty.webapp.WebAppContext.preConfigure(WebAppContext.java:488) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:523) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169) at org.eclipse.jetty.server.Server.start(Server.java:408) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97) at org.eclipse.jetty.server.Server.doStart(Server.java:372) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:113) at org.apache.atlas.Atlas.main(Atlas.java:133) 2022-02-01 10:20:53,981 WARN - [main:] ~ Weak cipher suite TLS_RSA_WITH_AES_256_CBC_SHA256 enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,981 WARN - [main:] ~ Weak cipher suite TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,981 WARN - [main:] ~ Weak cipher suite TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,981 WARN - [main:] ~ Weak cipher suite TLS_RSA_WITH_AES_256_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,982 WARN - [main:] ~ Weak cipher suite TLS_RSA_WITH_AES_256_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,982 WARN - [main:] ~ Weak cipher suite TLS_ECDH_ECDSA_WITH_AES_256_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,982 WARN - [main:] ~ Weak cipher suite TLS_ECDH_RSA_WITH_AES_256_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,982 WARN - [main:] ~ Weak cipher suite TLS_DHE_RSA_WITH_AES_256_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,982 WARN - [main:] ~ Weak cipher suite TLS_RSA_WITH_AES_128_CBC_SHA256 enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,983 WARN - [main:] ~ Weak cipher suite TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,983 WARN - [main:] ~ Weak cipher suite TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,983 WARN - [main:] ~ Weak cipher suite TLS_RSA_WITH_AES_128_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,983 WARN - [main:] ~ Weak cipher suite TLS_RSA_WITH_AES_128_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,983 WARN - [main:] ~ Weak cipher suite TLS_ECDH_ECDSA_WITH_AES_128_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,984 WARN - [main:] ~ Weak cipher suite TLS_ECDH_RSA_WITH_AES_128_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,984 WARN - [main:] ~ Weak cipher suite TLS_DHE_RSA_WITH_AES_128_CBC_SHA enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,985 WARN - [main:] ~ Weak cipher suite TLS_RSA_WITH_AES_256_GCM_SHA384 enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) 2022-02-01 10:20:53,985 WARN - [main:] ~ Weak cipher suite TLS_RSA_WITH_AES_128_GCM_SHA256 enabled for Server@7fc4780b[provider=null,keyStore=file:///run/cloudera-scm-agent/process/6758-atlas-ATLAS_SERVER/cm-auto-host_keystore.jks,trustStore=file:///var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks] (SslContextFactory:291) Exception in thread "main" org.apache.atlas.exception.AtlasBaseException: EmbeddedServer.Start: failed! at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:119) at org.apache.atlas.Atlas.main(Atlas.java:133) Caused by: java.lang.NullPointerException at org.apache.atlas.BeanUtil.getBean(BeanUtil.java:36) at org.apache.atlas.web.service.EmbeddedServer.auditServerStatus(EmbeddedServer.java:132) at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:115) ... 1 more
... View more
01-31-2022
01:05 PM
From Cloudera Manager it appears like Atlas Service is in good health, but it doesn't start at all. When I try to access the Web UI, it shows an Http Error 503 Service Unavailable but the application.log doesn't show any error; it just halts. Here is the application.log whe I restart Atlas service from Cloudera Manager: 2022-01-31 12:04:28,657 INFO - [shutdown-hook-0:] ~ ==> Shutdown of Atlas (Atlas$1:63) 2022-01-31 12:04:28,668 INFO - [shutdown-hook-0:] ~ <== Shutdown of Atlas (Atlas$1:69) 2022-01-31 12:09:49,319 INFO - [main:] ~ Loading atlas-application.properties from file:/var/run/cloudera-scm-agent/process/6754-atlas-ATLAS_SERVER/conf/atlas-application.properties (ApplicationProperties:137) 2022-01-31 12:09:49,327 INFO - [main:] ~ Using graphdb backend 'janus' (ApplicationProperties:317) 2022-01-31 12:09:49,327 INFO - [main:] ~ Using storage backend 'hbase2' (ApplicationProperties:328) 2022-01-31 12:09:49,327 INFO - [main:] ~ Using index backend 'solr' (ApplicationProperties:339) 2022-01-31 12:09:49,328 INFO - [main:] ~ Atlas is running in MODE: PROD. (ApplicationProperties:343) 2022-01-31 12:09:49,328 INFO - [main:] ~ Setting solr-wait-searcher property 'true' (ApplicationProperties:349) 2022-01-31 12:09:49,329 INFO - [main:] ~ Setting index.search.map-name property 'false' (ApplicationProperties:353) 2022-01-31 12:09:49,329 INFO - [main:] ~ Using atlas.graph.index.search.max-result-set-size = 500000 (ApplicationProperties:363) 2022-01-31 12:09:49,329 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache = true (ApplicationProperties:375) 2022-01-31 12:09:49,329 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache-clean-wait = 20 (ApplicationProperties:375) 2022-01-31 12:09:49,329 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache-size = 0.5 (ApplicationProperties:375) 2022-01-31 12:09:49,329 INFO - [main:] ~ Property (set to default) atlas.graph.cache.tx-cache-size = 15000 (ApplicationProperties:375) 2022-01-31 12:09:49,329 INFO - [main:] ~ Property (set to default) atlas.graph.cache.tx-dirty-size = 120 (ApplicationProperties:375) 2022-01-31 12:09:49,335 INFO - [main:] ~ ######################################################################################## Atlas Server (STARTUP) project.name: apache-atlas project.description: Metadata Management and Data Governance Platform over Hadoop build.user: jenkins build.epoch: 1615291035511 project.version: 2.1.0.7.1.6.0-297 build.version: 2.1.0.7.1.6.0-297 vc.revision: 0b549aa29de55ea44b7e05e11c689dfc424802b0 vc.source.url: scm:git:git://git.apache.org/atlas.git/atlas-webapp ######################################################################################## (Atlas:215) 2022-01-31 12:09:49,335 INFO - [main:] ~ >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> (Atlas:216) 2022-01-31 12:09:49,335 INFO - [main:] ~ Server starting with TLS ? true on port 31443 (Atlas:217) 2022-01-31 12:09:49,336 INFO - [main:] ~ <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< (Atlas:218) 2022-01-31 12:09:49,362 INFO - [main:] ~ Attempting to retrieve password for key keystore.password from cert.stores.credential.provider.path configured credential provider path localjceks://file//var/run/cloudera-scm-agent/process/6754-atlas-ATLAS_SERVER/conf/atlascreds.localjceks (SecurityUtil:63) 2022-01-31 12:09:49,630 INFO - [main:] ~ Attempting to retrieve password for key truststore.password from cert.stores.credential.provider.path configured credential provider path localjceks://file//var/run/cloudera-scm-agent/process/6754-atlas-ATLAS_SERVER/conf/atlascreds.localjceks (SecurityUtil:63) 2022-01-31 12:09:49,779 INFO - [main:] ~ Attempting to retrieve password for key keystore.password from cert.stores.credential.provider.path configured credential provider path localjceks://file//var/run/cloudera-scm-agent/process/6754-atlas-ATLAS_SERVER/conf/atlascreds.localjceks (SecurityUtil:63) 2022-01-31 12:09:49,871 INFO - [main:] ~ Attempting to retrieve password for key password from cert.stores.credential.provider.path configured credential provider path localjceks://file//var/run/cloudera-scm-agent/process/6754-atlas-ATLAS_SERVER/conf/atlascreds.localjceks (SecurityUtil:63) 2022-01-31 12:09:49,959 INFO - [main:] ~ Attempting to retrieve password for key truststore.password from cert.stores.credential.provider.path configured credential provider path localjceks://file//var/run/cloudera-scm-agent/process/6754-atlas-ATLAS_SERVER/conf/atlascreds.localjceks (SecurityUtil:63)
... View more
Labels: