Created 01-17-2017 04:02 PM
After enabling TLS with the following properties in Atlas on HDP 2.5.3:
keystore.file=/etc/atlas/conf/keystore.jks truststore.file=/etc/atlas/conf/truststore.jks cert.stores.credential.provider.path=/etc/atlas/conf/stores.jceks
Atlas server doesn't start anymore.
Logs:
2017-01-17 15:35:46,681 DEBUG - [main:] ~ cert.stores.credential.provider.path = /etc/atlas/conf/stores.jceks (ApplicationProperties:102) 2017-01-17 15:35:46,682 DEBUG - [main:] ~ keystore.file = /etc/atlas/conf/keystore.jks (ApplicationProperties:102) 2017-01-17 15:35:46,682 DEBUG - [main:] ~ truststore.file = /etc/atlas/conf/truststore.jks (ApplicationProperties:102) 2017-01-17 15:35:46,684 DEBUG - [main:] ~ ==> InMemoryJAASConfiguration.init() (InMemoryJAASConfiguration:168) 2017-01-17 15:35:46,695 DEBUG - [main:] ~ ==> InMemoryJAASConfiguration.init() (InMemoryJAASConfiguration:181) 2017-01-17 15:35:46,716 DEBUG - [main:] ~ ==> InMemoryJAASConfiguration.initialize() (InMemoryJAASConfiguration:220) 2017-01-17 15:35:46,889 DEBUG - [main:] ~ Setting hadoop.security.token.service.use_ip to true (SecurityUtil:116) 2017-01-17 15:35:46,898 DEBUG - [main:] ~ Failed to detect a valid hadoop home directory (Shell:477) java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset. at org.apache.hadoop.util.Shell.checkHadoopHomeInner(Shell.java:425) at org.apache.hadoop.util.Shell.checkHadoopHome(Shell.java:396) at org.apache.hadoop.util.Shell.<clinit>(Shell.java:473) at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79) at org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:1443) at org.apache.hadoop.security.SecurityUtil.setConfigurationInternal(SecurityUtil.java:96) at org.apache.hadoop.security.SecurityUtil.<clinit>(SecurityUtil.java:80) at org.apache.atlas.security.InMemoryJAASConfiguration.initialize(InMemoryJAASConfiguration.java:312) at org.apache.atlas.security.InMemoryJAASConfiguration.<init>(InMemoryJAASConfiguration.java:216) at org.apache.atlas.security.InMemoryJAASConfiguration.init(InMemoryJAASConfiguration.java:184) at org.apache.atlas.security.InMemoryJAASConfiguration.init(InMemoryJAASConfiguration.java:172) at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:60) at org.apache.atlas.Atlas.main(Atlas.java:107) 2017-01-17 15:35:47,015 DEBUG - [main:] ~ setsid exited with exit code 0 (Shell:768) 2017-01-17 15:35:47,041 DEBUG - [main:] ~ Adding client: [KafkaClient{-1}] loginModule: [com.sun.security.auth.module.Krb5LoginModule] controlFlag: [LoginModuleControlFlag: required] Options: [principal] => [atlas/nmara-hdp-m4.field.hortonworks.com@FIELD.HORTONWORKS.COM] Options: [storeKey] => [true] Options: [keyTab] => [/etc/security/keytabs/atlas.service.keytab] Options: [useKeyTab] => [true] Options: [serviceName] => [kafka] (InMemoryJAASConfiguration:334) 2017-01-17 15:35:47,041 DEBUG - [main:] ~ <== InMemoryJAASConfiguration.initialize() (InMemoryJAASConfiguration:347) 2017-01-17 15:35:47,042 DEBUG - [main:] ~ <== InMemoryJAASConfiguration.init() (InMemoryJAASConfiguration:190) 2017-01-17 15:35:47,042 DEBUG - [main:] ~ <== InMemoryJAASConfiguration.init() (InMemoryJAASConfiguration:177) 2017-01-17 15:35:47,044 INFO - [main:] ~ Not running setup per configuration atlas.server.run.setup.on.start. (Atlas:134) 2017-01-17 15:35:47,044 INFO - [main:] ~ ######################################################################################## Atlas Server (STARTUP) project.name: apache-atlas project.description: Metadata Management and Data Governance Platform over Hadoop build.user: jenkins build.epoch: 1480481030662 project.version: 0.7.0.2.5.3.0-37 build.version: 0.7.0.2.5.3.0-37-rf427fc5f5b82c6582d1520a279f523d1b1c874f6 vc.revision: f427fc5f5b82c6582d1520a279f523d1b1c874f6 vc.source.url: scm:git:git://git.apache.org/incubator-atlas.git/atlas-webapp ######################################################################################## (Atlas:202) 2017-01-17 15:35:47,045 INFO - [main:] ~ >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> (Atlas:203) 2017-01-17 15:35:47,045 INFO - [main:] ~ Server starting with TLS ? true on port 21443 (Atlas:204) 2017-01-17 15:35:47,045 INFO - [main:] ~ <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< (Atlas:205) 2017-01-17 15:35:47,079 DEBUG - [main:] ~ Logging to org.slf4j.impl.Log4jLoggerAdapter(org.eclipse.jetty.util.log) via org.eclipse.jetty.util.log.Slf4jLog (log:176) 2017-01-17 15:35:47,088 INFO - [main:] ~ Logging initialized @1508ms (log:186) 2017-01-17 15:35:47,107 DEBUG - [main:] ~ org.eclipse.jetty.server.Server@1b68b9a4 added {qtp878274034{STOPPED,8<=0<=200,i=0,q=0},AUTO} (ContainerLifeCycle:324) 2017-01-17 15:35:47,112 INFO - [main:] ~ Attempting to retrieve password from configured credential provider path (SecureEmbeddedServer:118) 2017-01-17 15:35:47,195 INFO - [pool-1-thread-1:] ~ ==> Shutdown of Atlas (Atlas:60) 2017-01-17 15:35:47,195 ERROR - [pool-1-thread-1:] ~ Failed to shutdown (Atlas:64) java.lang.NullPointerException at org.apache.atlas.Atlas.shutdown(Atlas.java:73) at org.apache.atlas.Atlas.access$100(Atlas.java:42) at org.apache.atlas.Atlas$1.run(Atlas.java:62) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2017-01-17 15:35:47,196 INFO - [pool-1-thread-1:] ~ <== Shutdown of Atlas (Atlas:66) 2017-01-17 15:35:47,197 DEBUG - [Thread-0:] ~ ShutdownHookManger complete shutdown. (ShutdownHookManager:84)
It shutdown just after attempting to get passwords from the jceks file.
Created 01-17-2017 05:35 PM
From the logs, it looks like HADOOP_HOME is not set in your env. can you please set this and try restarting atlas?
java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset.
Also, please copy hdfs-site.xml to /etc/atlas/conf and make sure right permissions are given to all the files under /etc/atlas/conf. Restart Atlas now, this should resolve the issue.
Created 01-18-2017 10:32 AM
@Nixon Rodrigues putting jceks://file before the path solved the problem, thanks!