Reply
Explorer
Posts: 16
Registered: ‎09-16-2015

Internal error while querying the Host Monitor

Login to Cloudera Manager the righ side of the penal show internal error while querying the Host Monitor and  QUERY ERROR.

 I alos notice the host public ip change after servers were rebooted.  Please help.

 

screen1.GIF

 

Garry

Cloudera Employee
Posts: 435
Registered: ‎07-12-2013

Re: Internal error while querying the Host Monitor

That's correct. See the section 'Stopping and Starting Instances' in the documentation: http://www.cloudera.com/content/cloudera/en/products-and-services/cloudera-live/aws-documentation.ht...

Explorer
Posts: 16
Registered: ‎09-16-2015

Re: Internal error while querying the Host Monitor

Cloudera Live restart failed.

 

Completed only 3/4 steps. First failure: Failed to execute command Start on service Sqoop 2

 

Explorer
Posts: 16
Registered: ‎09-16-2015

Re: Internal error while querying the Host Monitor

When try to restart Sqoop2 only got following error.

 

Service did not start successfully; not all of the required roles started: Service has only 0 Sqoop 2 Server roles running instead of minimum required 1.
Explorer
Posts: 16
Registered: ‎09-16-2015

Re: Internal error while querying the Host Monitor

If sqoop service is not started I am not able to do the exercise 1.  Please help to solve the restart sqoop service proble,  Thank you.

 

Garry

Cloudera Employee
Posts: 435
Registered: ‎07-12-2013

Re: Internal error while querying the Host Monitor

[ Edited ]

The Sqoop service in Cloudera Manager is actually Sqoop 2. Exercise 1
requires Sqoop 1, which is a command-line tool only. You should still be
able to complete the exercise.

To diagnose the problem with Sqoop 2 will require more information. Can you
click on the service, and follow the links to inspect the logs from the
service and post any errors you find?

Explorer
Posts: 16
Registered: ‎09-16-2015

Re: Internal error while querying the Host Monitor

Hi Sean,

 

Explorer
Posts: 16
Registered: ‎09-16-2015

Re: Internal error while querying the Host Monitor

Hi Sean,

     The agent status looks good

[ec2-user@cloudera1 logs]$ /etc/init.d/cloudera-scm-agent status
cloudera-scm-agent (pid  1470) is running...

 

 Following is from Cloudera Manager log details and looks like it needs upgrade of Repository structure

 

 

Sqoop server failed to start
java.lang.RuntimeException: Failure in server initialization
	at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:63)
	at org.apache.sqoop.server.ServerInitializer.contextInitialized(ServerInitializer.java:41)
	at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4210)
	at org.apache.catalina.core.StandardContext.start(StandardContext.java:4709)
	at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:802)
	at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
	at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:583)
	at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:943)
	at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:778)
	at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:504)
	at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1317)
	at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:324)
	at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
	at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1068)
	at org.apache.catalina.core.StandardHost.start(StandardHost.java:822)
	at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1060)
	at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463)
	at org.apache.catalina.core.StandardService.start(StandardService.java:525)
	at org.apache.catalina.core.StandardServer.start(StandardServer.java:759)
	at org.apache.catalina.startup.Catalina.start(Catalina.java:595)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
	at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
Caused by: org.apache.sqoop.common.SqoopException: REPO_0002:Repository structures are not in suitable state, might require upgrade
	at org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:130)
	at org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:78)
	at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:56)
	... 25 more

 

Cloudera Employee
Posts: 435
Registered: ‎07-12-2013

Re: Internal error while querying the Host Monitor

Okay. I'll need to investigate that. I assume you haven't upgraded the
version of CDH on your cluster, or anything like that? If you need to use
Sqoop 2 specifically, you may be able to work around this by going to the
Sqoop 2 service in CM, clicking the Actions drop-down menu in the top-right
corner, and there's an option named more-or-less 'Update Sqoop Metadata'
that deals with any schema changes after a CDH upgrade.

However as I said, the Sqoop service in CM is independent of the Sqoop
command-line tool needed in exercise 1 so you should be able to continue.

Explorer
Posts: 16
Registered: ‎09-16-2015

Re: Internal error while querying the Host Monitor

Here is the begging of log when restart was executed.

2015-09-17 11:38:24,656 INFO org.apache.sqoop.repository.derby.DerbyRepositoryHandler: Can't fetch repository structure version.
org.apache.commons.dbcp.SQLNestedException: Borrow prepareStatement from pool failed
        at org.apache.commons.dbcp.PoolingConnection.prepareStatement(PoolingConnection.java:113)
        at org.apache.commons.dbcp.DelegatingConnection.prepareStatement(DelegatingConnection.java:281)
        at org.apache.commons.dbcp.PoolingDataSource$PoolGuardConnectionWrapper.prepareStatement(PoolingDataSource.java:313)
        at org.apache.sqoop.repository.derby.DerbyRepositoryHandler.detectRepositoryVersion(DerbyRepositoryHandler.java:185)
        at org.apache.sqoop.repository.derby.DerbyRepositoryHandler.isRepositorySuitableForUse(DerbyRepositoryHandler.java:914)
        at org.apache.sqoop.repository.JdbcRepository$2.doIt(JdbcRepository.java:147)
        at org.apache.sqoop.repository.JdbcRepository.doWithConnection(JdbcRepository.java:92)
        at org.apache.sqoop.repository.JdbcRepository.doWithConnection(JdbcRepository.java:63)
        at org.apache.sqoop.repository.JdbcRepository.isRepositorySuitableForUse(JdbcRepository.java:144)
        at org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:129)
        at org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:78)
        at org.apache.sqoop.core.SqoopServer.initialize(SqoopServer.java:56)
        at org.apache.sqoop.server.ServerInitializer.contextInitialized(ServerInitializer.java:41)
        at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4210)
        at org.apache.catalina.core.StandardContext.start(StandardContext.java:4709)
        at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:802)
        at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:779)
        at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:583)
        at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:943)
        at org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:778)
        at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:504)
        at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1317)
        at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:324)
        at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:142)
        at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1068)
        at org.apache.catalina.core.StandardHost.start(StandardHost.java:822)
        at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1060)
        at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:463)
        at org.apache.catalina.core.StandardService.start(StandardService.java:525)
        at org.apache.catalina.core.StandardServer.start(StandardServer.java:759)
        at org.apache.catalina.startup.Catalina.start(Catalina.java:595)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
        at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
Caused by: java.sql.SQLSyntaxErrorException: Schema 'SQOOP' does not exist

        at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
        at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source)
        at org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown Source)
        at org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown Source)
        at org.apache.derby.impl.jdbc.ConnectionChild.handleException(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedPreparedStatement.<init>(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedPreparedStatement20.<init>(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedPreparedStatement30.<init>(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedPreparedStatement40.<init>(Unknown Source)
        at org.apache.derby.jdbc.Driver40.newEmbedPreparedStatement(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedConnection.prepareStatement(Unknown Source)
        at org.apache.derby.impl.jdbc.EmbedConnection.prepareStatement(Unknown Source)
        at org.apache.commons.dbcp.PoolingConnection.makeObject(PoolingConnection.java:285)
        at org.apache.commons.pool.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:1179)
        at org.apache.commons.dbcp.PoolingConnection.prepareStatement(PoolingConnection.java:107)
        ... 36 more
Caused by: java.sql.SQLException: Schema 'SQOOP' does not exist
        at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
        at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
        ... 52 more
Caused by: ERROR 42Y07: Schema 'SQOOP' does not exist
        at org.apache.derby.iapi.error.StandardException.newException(Unknown Source)
        at org.apache.derby.impl.sql.catalog.DataDictionaryImpl.getSchemaDescriptor(Unknown Source)
        at org.apache.derby.impl.sql.compile.QueryTreeNode.getSchemaDescriptor(Unknown Source)
        at org.apache.derby.impl.sql.compile.QueryTreeNode.getSchemaDescriptor(Unknown Source)
        at org.apache.derby.impl.sql.compile.FromBaseTable.bindTableDescriptor(Unknown Source)
        at org.apache.derby.impl.sql.compile.FromBaseTable.bindNonVTITables(Unknown Source)
        at org.apache.derby.impl.sql.compile.FromList.bindTables(Unknown Source)
        at org.apache.derby.impl.sql.compile.SelectNode.bindNonVTITables(Unknown Source)
        at org.apache.derby.impl.sql.compile.DMLStatementNode.bindTables(Unknown Source)
        at org.apache.derby.impl.sql.compile.DMLStatementNode.bind(Unknown Source)
        at org.apache.derby.impl.sql.compile.CursorNode.bindStatement(Unknown Source)
        at org.apache.derby.impl.sql.GenericStatement.prepMinion(Unknown Source)
        at org.apache.derby.impl.sql.GenericStatement.prepare(Unknown Source)
        at org.apache.derby.impl.sql.conn.GenericLanguageConnectionContext.prepareInternalStatement(Unknown Source)
        ... 46 more