Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Internal error while querying the Host Monitor

Internal error while querying the Host Monitor

Explorer

Login to Cloudera Manager the righ side of the penal show internal error while querying the Host Monitor and  QUERY ERROR.

 I alos notice the host public ip change after servers were rebooted.  Please help.

 

screen1.GIF

 

Garry

11 REPLIES 11

Re: Internal error while querying the Host Monitor

Master Collaborator

That's correct. See the section 'Stopping and Starting Instances' in the documentation: http://www.cloudera.com/content/cloudera/en/products-and-services/cloudera-live/aws-documentation.ht...

Re: Internal error while querying the Host Monitor

Explorer

Cloudera Live restart failed.

 

Completed only 3/4 steps. First failure: Failed to execute command Start on service Sqoop 2

 

Re: Internal error while querying the Host Monitor

Explorer

When try to restart Sqoop2 only got following error.

 

Service did not start successfully; not all of the required roles started: Service has only 0 Sqoop 2 Server roles running instead of minimum required 1.

Re: Internal error while querying the Host Monitor

Explorer

If sqoop service is not started I am not able to do the exercise 1.  Please help to solve the restart sqoop service proble,  Thank you.

 

Garry

Re: Internal error while querying the Host Monitor

Master Collaborator

The Sqoop service in Cloudera Manager is actually Sqoop 2. Exercise 1
requires Sqoop 1, which is a command-line tool only. You should still be
able to complete the exercise.

To diagnose the problem with Sqoop 2 will require more information. Can you
click on the service, and follow the links to inspect the logs from the
service and post any errors you find?

Re: Internal error while querying the Host Monitor

Explorer

Hi Sean,

 

Re: Internal error while querying the Host Monitor

Explorer

Hi Sean,

     The agent status looks good

[ec2-user@cloudera1 logs]$ /etc/init.d/cloudera-scm-agent status
cloudera-scm-agent (pid  1470) is running...

 

 Following is from Cloudera Manager log details and looks like it needs upgrade of Repository structure

 

 

Sqoop server failed to start
java.lang.RuntimeException: Failure in server initialization
	at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:63)
	at org.apache.sqoop.server.ServerInitializer.contextInitialized(ServerInitializer.java:41)
	at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4210)
	at org.apache.catalina.core.StandardContext.start(StandardContext.java:4709)
	at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:802)
	at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
	at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:583)
	at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:943)
	at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:778)
	at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:504)
	at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1317)
	at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:324)
	at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
	at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1068)
	at org.apache.catalina.core.StandardHost.start(StandardHost.java:822)
	at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1060)
	at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463)
	at org.apache.catalina.core.StandardService.start(StandardService.java:525)
	at org.apache.catalina.core.StandardServer.start(StandardServer.java:759)
	at org.apache.catalina.startup.Catalina.start(Catalina.java:595)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
	at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
Caused by: org.apache.sqoop.common.SqoopException: REPO_0002:Repository structures are not in suitable state, might require upgrade
	at org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:130)
	at org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:78)
	at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:56)
	... 25 more

 

Re: Internal error while querying the Host Monitor

Master Collaborator
Okay. I'll need to investigate that. I assume you haven't upgraded the
version of CDH on your cluster, or anything like that? If you need to use
Sqoop 2 specifically, you may be able to work around this by going to the
Sqoop 2 service in CM, clicking the Actions drop-down menu in the top-right
corner, and there's an option named more-or-less 'Update Sqoop Metadata'
that deals with any schema changes after a CDH upgrade.

However as I said, the Sqoop service in CM is independent of the Sqoop
command-line tool needed in exercise 1 so you should be able to continue.

Re: Internal error while querying the Host Monitor

Explorer

Here is the begging of log when restart was executed.

2015-09-17 11:38:24,656 INFO org.apache.sqoop.repository.derby.DerbyRepositoryHandler: Can't fetch repository structure version.
org.apache.commons.dbcp.SQLNestedException: Borrow prepareStatement from pool failed
        at org.apache.commons.dbcp.PoolingConnection.prepareStatement(PoolingConnection.java:113)
        at org.apache.commons.dbcp.DelegatingConnection.prepareStatement(DelegatingConnection.java:281)
        at org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.prepareStatement(PoolingDataSource.java:313)
        at org.apache.sqoop.repository.derby.DerbyRepositoryHandler.detectRepositoryVersion(DerbyRepositoryHandler.java:185)
        at org.apache.sqoop.repository.derby.DerbyRepositoryHandler.isRepositorySuitableForUse(DerbyRepositoryHandler.java:914)
        at org.apache.sqoop.repository.JdbcRepository$2.doIt(JdbcRepository.java:147)
        at org.apache.sqoop.repository.JdbcRepository.doWithConnection(JdbcRepository.java:92)
        at org.apache.sqoop.repository.JdbcRepository.doWithConnection(JdbcRepository.java:63)
        at org.apache.sqoop.repository.JdbcRepository.isRepositorySuitableForUse(JdbcRepository.java:144)
        at org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:129)
        at org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:78)
        at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:56)
        at org.apache.sqoop.server.ServerInitializer.contextInitialized(ServerInitializer.java:41)
        at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4210)
        at org.apache.catalina.core.StandardContext.start(StandardContext.java:4709)
        at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:802)
        at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
        at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:583)
        at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:943)
        at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:778)
        at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:504)
        at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1317)
        at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:324)
        at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
        at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1068)
        at org.apache.catalina.core.StandardHost.start(StandardHost.java:822)
        at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1060)
        at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463)
        at org.apache.catalina.core.StandardService.start(StandardService.java:525)
        at org.apache.catalina.core.StandardServer.start(StandardServer.java:759)
        at org.apache.catalina.startup.Catalina.start(Catalina.java:595)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
        at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
Caused by: java.sql.SQLSyntaxErrorException: Schema 'SQOOP' does not exist

        at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
        at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source)
        at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source)
        at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source)
        at org.apache.derby.impl.jdbc.ConnectionChild.handleException(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedPreparedStatement.<init>(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedPreparedStatement20.<init>(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedPreparedStatement30.<init>(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedPreparedStatement40.<init>(Unknown Source)
        at org.apache.derby.jdbc.Driver40.newEmbedPreparedStatement(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedConnection.prepareStatement(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedConnection.prepareStatement(Unknown Source)
        at org.apache.commons.dbcp.PoolingConnection.makeObject(PoolingConnection.java:285)
        at org.apache.commons.pool.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:1179)
        at org.apache.commons.dbcp.PoolingConnection.prepareStatement(PoolingConnection.java:107)
        ... 36 more
Caused by: java.sql.SQLException: Schema 'SQOOP' does not exist
        at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
        at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
        ... 52 more
Caused by: ERROR 42Y07: Schema 'SQOOP' does not exist
        at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
        at org.apache.derby.impl.sql.catalog.DataDictionaryImpl.getSchemaDescriptor(Unknown Source)
        at org.apache.derby.impl.sql.compile.QueryTreeNode.getSchemaDescriptor(Unknown Source)
        at org.apache.derby.impl.sql.compile.QueryTreeNode.getSchemaDescriptor(Unknown Source)
        at org.apache.derby.impl.sql.compile.FromBaseTable.bindTableDescriptor(Unknown Source)
        at org.apache.derby.impl.sql.compile.FromBaseTable.bindNonVTITables(Unknown Source)
        at org.apache.derby.impl.sql.compile.FromList.bindTables(Unknown Source)
        at org.apache.derby.impl.sql.compile.SelectNode.bindNonVTITables(Unknown Source)
        at org.apache.derby.impl.sql.compile.DMLStatementNode.bindTables(Unknown Source)
        at org.apache.derby.impl.sql.compile.DMLStatementNode.bind(Unknown Source)
        at org.apache.derby.impl.sql.compile.CursorNode.bindStatement(Unknown Source)
        at org.apache.derby.impl.sql.GenericStatement.prepMinion(Unknown Source)
        at org.apache.derby.impl.sql.GenericStatement.prepare(Unknown Source)
        at org.apache.derby.impl.sql.conn.GenericLanguageConnectionContext.prepareInternalStatement(Unknown Source)
        ... 46 more