Support Questions

Find answers, ask questions, and share your expertise

Cloudera service fails to start with systemctl

avatar
New Contributor

When restarting the Cloudera service:

sudo systemctl restart cloudera-scm-server.service

fails, and the following is the output of systemctl restart:

$ sudo systemctl status cloudera-scm-server.service cloudera-scm-server.service - LSB: Cloudera SCM Server
   Loaded: loaded (/etc/rc.d/init.d/cloudera-scm-server; bad; vendor preset: disabled)   Active: failed (Result: exit-code) since Thu 2020-07-09 17:16:56 IST; 2min 49s ago
     Docs: man:systemd-sysv-generator(8)  Process: 9330 ExecStop=/etc/rc.d/init.d/cloudera-scm-server stop (code=exited, status=0/SUCCESS)  Process: 13876 ExecStart=/etc/rc.d/init.d/cloudera-scm-server start (code=exited, status=1/FAILURE)Jul 09 17:16:51 invpbg077 systemd[1]: Starting LSB: Cloudera SCM Server...Jul 09 17:16:51 invpbg077 su[13903]: (to cloudera-scm) root on none
Jul 09 17:16:56 invpbg077 cloudera-scm-server[13876]: Starting cloudera-scm-server: [FAILED]Jul 09 17:16:56 invpbg077 systemd[1]: cloudera-scm-server.service: control process exited, code=exited 
status=1Jul 09 17:16:56 invpbg077 systemd[1]: Failed to start LSB: Cloudera SCM Server.Jul 09 17:16:56 invpbg077 systemd[1]: Unit cloudera-scm-server.service entered failed state.Jul 09 17:16:56 invpbg077 systemd[1]: cloudera-scm-server.service failed.

Couldn't find anything helpful about "LSB: Cloudera SCM Server".

If Cloudera logs are relevant, this is what I get from /var/logs/cloudera-scm-server/cloudera-scm-server.log

2020-07-09 17:16:54,582 ERROR main:org.hibernate.engine.jdbc.spi.SqlExceptionHelper: ERROR: relation "cm_version" does not exist
  Position: 21
2020-07-09 17:16:54,584 WARN main:com.cloudera.server.cmf.bootstrap.EntityManagerFactoryBean: Failed to determine prior version. This is expected if you are starting Cloudera Manager for the first time. Please also ignore any error messages about missing tables. Moving ahead assuming no upgrade: org.hibernate.exception.SQLGrammarException: could not extract ResultSet2020-07-09 17:16:54,597 INFO main:com.cloudera.enterprise.dbutil.DbUtil: Schema version table already exists.
2020-07-09 17:16:54,597 INFO main:com.cloudera.enterprise.dbutil.DbUtil: DB Schema version 42.
2020-07-09 17:16:54,598 INFO main:org.springframework.beans.factory.support.DefaultListableBeanFactory: Destroying singletons in 
org.springframework.beans.factory.support.DefaultListableBeanFactory@6200f9cb: defining beans [commandLineConfigurationBean,entityManagerFactoryBean,com.cloudera.server.cmf.TrialState,com.cloudera.server.cmf.TrialManager,com.cloudera.cmf.crypto.LicenseLoader]; root of factory hierarchy2020-07-09 17:16:54,599 ERROR main:com.cloudera.server.cmf.Main: Server failed.org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'com.cloudera.server.cmf.TrialState': Cannot resolve reference to bean 'entityManagerFactoryBean' while setting constructor argument; nested exception is 
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'entityManagerFactoryBean': FactoryBean threw exception on object creation; nested exception is java.lang.IllegalStateException
    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:328)    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:106)    at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:616)    at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:148)    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1003)    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:907)    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:485)    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:293)    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:290)    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:192)    at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:585)    at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:895)    at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:425)    at com.cloudera.server.cmf.Main.bootstrapSpringContext(Main.java:393)    at com.cloudera.server.cmf.Main.<init>(Main.java:243)    at com.cloudera.server.cmf.Main.main(Main.java:216)Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'entityManagerFactoryBean': FactoryBean threw exception on object creation; nested exception is java.lang.IllegalStateException
    at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:149)    at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:102)    at org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1440)    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:247)    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:192)    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:322)
    ... 17 more
Caused by: java.lang.IllegalStateException
    at com.google.common.base.Preconditions.checkState(Preconditions.java:133)    at com.cloudera.server.cmf.bootstrap.EntityManagerFactoryBean.checkVersionDoFail(EntityManagerFactoryBean.java:291)
1 REPLY 1

avatar
Master Guru

@IZ_AMD This seems the issue with DB it could be either the permission issue on DB or schema issue. 

You have to check if scm_prepare script ran successfully as well. I would suggest to configure the DB again if this is new install. 

https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ig_installing_configuring_dbs.ht...


Cheers!
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.