Member since
12-18-2018
9
Posts
1
Kudos Received
2
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 13502 | 02-28-2019 01:31 AM | |
| 5600 | 01-13-2019 06:54 PM |
11-18-2019
12:36 AM
I start the embeded ldap server ,config sanbox.xml to match my test cluster . curl the webhdfs ，OK curl the admin0-ui, NOT OK after seeing the guide on https://knox.apache.org/ ,still can not figure out why curl -i -k -u admin:admin-password -X GET 'https://192.168.1.109:8443/gateway/sandbox/webhdfs/v1/?op=LISTSTATUS' HTTP/1.1 200 OK Date: Mon, 18 Nov 2019 08:25:26 GMT Set-Cookie: KNOXSESSIONID=node0wgxdedldxiq17d8hqt51ez5y0.node0; Path=/gateway/sandbox; Secure; HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT Set-Cookie: rememberMe=deleteMe; Path=/gateway/sandbox; Max-Age=0; Expires=Sun, 17-Nov-2019 08:25:26 GMT Cache-Control: no-cache Expires: Mon, 18 Nov 2019 08:25:26 GMT Date: Mon, 18 Nov 2019 08:25:26 GMT Pragma: no-cache Expires: Mon, 18 Nov 2019 08:25:26 GMT Date: Mon, 18 Nov 2019 08:25:26 GMT Pragma: no-cache Content-Type: application/json;charset=utf-8 X-FRAME-OPTIONS: SAMEORIGIN Transfer-Encoding: chunked Server: Jetty(9.4.19.v20190610) {"FileStatuses":{"FileStatus":[{"accessTime":0,"blockSize":0,"childrenNum":9,"fileId":16417,"group":"hbase","length":0,"modificationTime":1573116518085,"owner":"hbase","pathSuffix":"hbase","permission":"755","replication":0,"storagePolicy":0,"type":"DIRECTORY"},{"accessTime":0,"blockSize":0,"childrenNum":8,"fileId":16386,"group":"supergroup","length":0,"modificationTime":1570700396229,"owner":"hdfs","pathSuffix":"tmp","permission":"1777","replication":0,"storagePolicy":0,"type":"DIRECTORY"}, curl -i -k -u admin:admin-password -X GET 'https://192.168.1.109:8443/gateway/manager/admin-ui' HTTP/1.1 302 Found Date: Mon, 18 Nov 2019 07:48:00 GMT Location: https://192.168.1.109:8443/gateway/manager/admin-ui/ Content-Length: 0 Server: Jetty(9.4.19.v20190610) curl -i -k -u admin:admin-password -X GET 'https://192.168.1.109:8443/gateway/manager/admin-ui/' HTTP/1.1 302 Found Date: Mon, 18 Nov 2019 08:35:42 GMT X-Frame-Options: DENY X-XSS-Protection: 1;mode=block Location: https://192.168.1.109:8443/gateway/knoxsso/api/v1/websso?originalUrl=https://192.168.1.109:8443/gateway/manager/admin-ui/ Content-Length: 0 Server: Jetty(9.4.19.v20190610) gate-way start logs: 2019-11-18 08:24:22,742 INFO knox.gateway (GatewayServer.java:logSysProp(219)) - System Property: user.name=admin 2019-11-18 08:24:22,746 INFO knox.gateway (GatewayServer.java:logSysProp(219)) - System Property: user.dir=/usr/local/datadisk/knox-1.3.0 2019-11-18 08:24:22,746 INFO knox.gateway (GatewayServer.java:logSysProp(219)) - System Property: java.runtime.name=Java(TM) SE Runtime Environment 2019-11-18 08:24:22,746 INFO knox.gateway (GatewayServer.java:logSysProp(219)) - System Property: java.runtime.version=1.8.0_181-b13 2019-11-18 08:24:22,746 INFO knox.gateway (GatewayServer.java:logSysProp(219)) - System Property: java.home=/usr/local/datadisk/jdk1.8.0_181/jre 2019-11-18 08:24:22,886 INFO knox.gateway (GatewayConfigImpl.java:loadConfigResource(406)) - Loading configuration resource jar:file:/usr/local/datadisk/knox-1.3.0/bin/../lib/gateway-server-1.3.0.jar!/conf/gateway-default.xml 2019-11-18 08:24:22,961 INFO knox.gateway (GatewayConfigImpl.java:loadConfigFile(394)) - Loading configuration file /usr/local/datadisk/knox-1.3.0/conf/gateway-site.xml 2019-11-18 08:24:22,971 INFO knox.gateway (GatewayConfigImpl.java:initGatewayHomeDir(334)) - Using /usr/local/datadisk/knox-1.3.0/bin/.. as GATEWAY_HOME via system property. 2019-11-18 08:24:22,972 INFO knox.gateway (GatewayConfigImpl.java:init(327)) - Cookie scoping feature enabled: false 2019-11-18 08:24:23,397 INFO knox.gateway (RemoteAliasService.java:init(258)) - Remote Alias Service enabled 2019-11-18 08:24:23,399 WARN knox.gateway (ZookeeperRemoteAliasService.java:init(349)) - There is no registry client defined for remote configuration monitoring. 2019-11-18 08:24:23,406 INFO knox.gateway (JettySSLService.java:init(72)) - Credential store for the gateway instance found - no need to create one. 2019-11-18 08:24:23,408 INFO knox.gateway (JettySSLService.java:init(91)) - Keystore for the gateway instance found - no need to create one. 2019-11-18 08:24:23,410 INFO knox.gateway (JettySSLService.java:logAndValidateCertificate(112)) - The Gateway SSL certificate is issued to hostname: localhost. 2019-11-18 08:24:23,411 INFO knox.gateway (JettySSLService.java:logAndValidateCertificate(115)) - The Gateway SSL certificate is valid between: 11/13/19 1:40 AM and 11/12/20 1:40 AM. 2019-11-18 08:24:24,425 INFO knox.gateway (DefaultTopologyService.java:init(630)) - Monitoring simple descriptors in directory: /usr/local/datadisk/knox-1.3.0/conf/descriptors 2019-11-18 08:24:24,534 INFO knox.gateway (DefaultTopologyService.java:init(635)) - Monitoring shared provider configurations in directory: /usr/local/datadisk/knox-1.3.0/conf/shared-providers 2019-11-18 08:24:24,537 WARN knox.gateway (DefaultRemoteConfigurationMonitor.java:<init>(132)) - There is no registry client defined for remote configuration monitoring. 2019-11-18 08:24:24,538 WARN knox.gateway (RemoteConfigurationMonitorFactory.java:get(67)) - An error occurred while attempting to initialize the remote configuration monitor: Missing required configuration. 2019-11-18 08:24:24,664 INFO knox.gateway (GatewayServer.java:startGateway(360)) - Starting gateway... 2019-11-18 08:24:24,665 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.security.impl.DefaultMasterService 2019-11-18 08:24:24,665 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.security.impl.DefaultKeystoreService 2019-11-18 08:24:24,665 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.service.config.remote.zk.CuratorClientService 2019-11-18 08:24:24,665 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.security.impl.RemoteAliasService 2019-11-18 08:24:24,665 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.security.impl.DefaultCryptoService 2019-11-18 08:24:24,665 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.security.impl.JettySSLService 2019-11-18 08:24:24,666 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.token.impl.DefaultTokenAuthorityService 2019-11-18 08:24:24,668 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.registry.impl.DefaultServiceRegistryService 2019-11-18 08:24:24,668 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.hostmap.impl.DefaultHostMapperService 2019-11-18 08:24:24,668 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.DefaultServerInfoService 2019-11-18 08:24:24,668 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.topology.impl.DefaultClusterConfigurationMonitorService 2019-11-18 08:24:24,668 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.topology.impl.DefaultTopologyService 2019-11-18 08:24:24,669 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.registry.impl.DefaultServiceDefinitionRegistry 2019-11-18 08:24:24,669 INFO knox.gateway (AbstractGatewayServices.java:start(60)) - Starting service: org.apache.knox.gateway.services.metrics.impl.DefaultMetricsService 2019-11-18 08:24:24,747 INFO util.log (Log.java:initialized(193)) - Logging initialized @2381ms to org.eclipse.jetty.util.log.Slf4jLog 2019-11-18 08:24:24,849 INFO knox.gateway (GatewayServer.java:start(596)) - Loading topologies from directory: /usr/local/datadisk/knox-1.3.0/conf/topologies 2019-11-18 08:24:24,934 INFO knox.gateway (GatewayServer.java:handleCreateDeployment(961)) - Loading topology sandbox from /usr/local/datadisk/knox-1.3.0/data/deployments/sandbox.topo.16e68d83088 2019-11-18 08:24:24,934 INFO knox.gateway (GatewayServer.java:internalActivateTopology(829)) - Activating topology sandbox 2019-11-18 08:24:24,935 INFO knox.gateway (GatewayServer.java:internalActivateArchive(839)) - Activating topology sandbox archive %2F 2019-11-18 08:24:25,046 INFO knox.gateway (GatewayServer.java:handleCreateDeployment(961)) - Loading topology knoxsso from /usr/local/datadisk/knox-1.3.0/data/deployments/knoxsso.topo.16e7c8f7a00 2019-11-18 08:24:25,046 INFO knox.gateway (GatewayServer.java:internalActivateTopology(829)) - Activating topology knoxsso 2019-11-18 08:24:25,046 INFO knox.gateway (GatewayServer.java:internalActivateArchive(839)) - Activating topology knoxsso archive %2Fknoxauth 2019-11-18 08:24:25,047 INFO knox.gateway (GatewayServer.java:internalActivateArchive(839)) - Activating topology knoxsso archive %2F 2019-11-18 08:24:25,049 INFO knox.gateway (GatewayServer.java:handleCreateDeployment(944)) - Deploying topology manager to /usr/local/datadisk/knox-1.3.0/data/deployments/manager.topo.16e7d9bb9e0 2019-11-18 08:24:25,049 INFO knox.gateway (GatewayServer.java:internalDeactivateTopology(863)) - Deactivating topology manager 2019-11-18 08:24:25,466 INFO knox.gateway (DefaultGatewayServices.java:initializeContribution(159)) - Credential store found for the cluster: manager - no need to create one. 2019-11-18 08:24:26,209 INFO knox.gateway (DefaultGatewayServices.java:initializeContribution(159)) - Credential store found for the cluster: manager - no need to create one. 2019-11-18 08:24:26,707 INFO knox.gateway (GatewayServer.java:internalActivateTopology(829)) - Activating topology manager 2019-11-18 08:24:26,707 INFO knox.gateway (GatewayServer.java:internalActivateArchive(839)) - Activating topology manager archive %2Fadmin-ui 2019-11-18 08:24:26,708 INFO knox.gateway (GatewayServer.java:internalActivateArchive(839)) - Activating topology manager archive %2F 2019-11-18 08:24:26,709 INFO knox.gateway (GatewayServer.java:cleanupTopologyDeployments(352)) - Deleting backup deployed topology /usr/local/datadisk/knox-1.3.0/data/deployments/manager.topo.16e62d11560 2019-11-18 08:24:26,711 INFO knox.gateway (GatewayServer.java:handleCreateDeployment(944)) - Deploying topology admin to /usr/local/datadisk/knox-1.3.0/data/deployments/admin.topo.16e7d9bb9e0 2019-11-18 08:24:26,711 INFO knox.gateway (GatewayServer.java:internalDeactivateTopology(863)) - Deactivating topology admin 2019-11-18 08:24:26,802 INFO knox.gateway (DefaultGatewayServices.java:initializeContribution(159)) - Credential store found for the cluster: admin - no need to create one. 2019-11-18 08:24:27,280 INFO knox.gateway (GatewayServer.java:internalActivateTopology(829)) - Activating topology admin 2019-11-18 08:24:27,280 INFO knox.gateway (GatewayServer.java:internalActivateArchive(839)) - Activating topology admin archive %2F 2019-11-18 08:24:27,281 INFO knox.gateway (GatewayServer.java:cleanupTopologyDeployments(352)) - Deleting backup deployed topology /usr/local/datadisk/knox-1.3.0/data/deployments/admin.topo.16e62d11560 2019-11-18 08:24:27,336 INFO knox.gateway (GatewayServer.java:start(627)) - Topology port mapping feature enabled: true 2019-11-18 08:24:27,338 INFO server.Server (Server.java:doStart(370)) - jetty-9.4.19.v20190610; built: 2019-06-10T16:30:51.723Z; git: afcf563148970e98786327af5e07c261fda175d3; jvm 1.8.0_181-b13 2019-11-18 08:24:27,509 INFO annotations.AnnotationConfiguration (AnnotationConfiguration.java:scanForAnnotations(481)) - Scanning elapsed time=53ms 2019-11-18 08:24:27,713 INFO ContextHandler.gateway_sandbox (ContextHandler.java:log(2351)) - No Spring WebApplicationInitializer types detected on classpath 2019-11-18 08:24:27,740 INFO server.session (DefaultSessionIdManager.java:doStart(365)) - DefaultSessionIdManager workerName=node0 2019-11-18 08:24:27,740 INFO server.session (DefaultSessionIdManager.java:doStart(370)) - No SessionScavenger set, using defaults 2019-11-18 08:24:27,742 INFO server.session (HouseKeeper.java:startScavenging(149)) - node0 Scavenging every 600000ms 2019-11-18 08:24:27,752 INFO ContextHandler.gateway_sandbox (ContextHandler.java:log(2351)) - Initializing Shiro environment 2019-11-18 08:24:27,752 INFO env.EnvironmentLoader (EnvironmentLoader.java:initEnvironment(133)) - Starting Shiro environment initialization. 2019-11-18 08:24:27,880 INFO env.EnvironmentLoader (EnvironmentLoader.java:initEnvironment(147)) - Shiro environment initialized in 127 ms. 2019-11-18 08:24:27,963 INFO handler.ContextHandler (ContextHandler.java:doStart(857)) - Started o.e.j.w.WebAppContext@60baef24{/gateway/sandbox,file:///usr/local/datadisk/knox-1.3.0/data/deployments/sandbox.topo.16e68d83088/%252F/,AVAILABLE}{/usr/local/datadisk/knox-1.3.0/data/deployments/sandbox.topo.16e68d83088/%2F} 2019-11-18 08:24:27,995 INFO annotations.AnnotationConfiguration (AnnotationConfiguration.java:scanForAnnotations(481)) - Scanning elapsed time=17ms 2019-11-18 08:24:28,000 INFO ContextHandler.gateway_knoxsso_knoxauth (ContextHandler.java:log(2351)) - No Spring WebApplicationInitializer types detected on classpath 2019-11-18 08:24:28,037 INFO ContextHandler.gateway_knoxsso_knoxauth (ContextHandler.java:log(2351)) - Initializing Shiro environment 2019-11-18 08:24:28,038 INFO env.EnvironmentLoader (EnvironmentLoader.java:initEnvironment(133)) - Starting Shiro environment initialization. 2019-11-18 08:24:28,044 INFO env.EnvironmentLoader (EnvironmentLoader.java:initEnvironment(147)) - Shiro environment initialized in 6 ms. 2019-11-18 08:24:28,055 INFO handler.ContextHandler (ContextHandler.java:doStart(857)) - Started o.e.j.w.WebAppContext@1473b8c0{/gateway/knoxsso/knoxauth,file:///usr/local/datadisk/knox-1.3.0/data/deployments/knoxsso.topo.16e7c8f7a00/%252Fknoxauth/,AVAILABLE}{/usr/local/datadisk/knox-1.3.0/data/deployments/knoxsso.topo.16e7c8f7a00/%2Fknoxauth} 2019-11-18 08:24:28,075 INFO annotations.AnnotationConfiguration (AnnotationConfiguration.java:scanForAnnotations(481)) - Scanning elapsed time=9ms 2019-11-18 08:24:28,098 INFO ContextHandler.gateway_knoxsso (ContextHandler.java:log(2351)) - No Spring WebApplicationInitializer types detected on classpath 2019-11-18 08:24:28,100 INFO ContextHandler.gateway_knoxsso (ContextHandler.java:log(2351)) - Initializing Shiro environment 2019-11-18 08:24:28,100 INFO env.EnvironmentLoader (EnvironmentLoader.java:initEnvironment(133)) - Starting Shiro environment initialization. 2019-11-18 08:24:28,105 INFO env.EnvironmentLoader (EnvironmentLoader.java:initEnvironment(147)) - Shiro environment initialized in 5 ms. 2019-11-18 08:24:28,107 INFO handler.ContextHandler (ContextHandler.java:doStart(857)) - Started o.e.j.w.WebAppContext@5b5c0057{/gateway/knoxsso,file:///usr/local/datadisk/knox-1.3.0/data/deployments/knoxsso.topo.16e7c8f7a00/%252F/,AVAILABLE}{/usr/local/datadisk/knox-1.3.0/data/deployments/knoxsso.topo.16e7c8f7a00/%2F} 2019-11-18 08:24:28,130 INFO annotations.AnnotationConfiguration (AnnotationConfiguration.java:scanForAnnotations(481)) - Scanning elapsed time=12ms 2019-11-18 08:24:28,136 INFO ContextHandler.gateway_manager_admin_ui (ContextHandler.java:log(2351)) - No Spring WebApplicationInitializer types detected on classpath 2019-11-18 08:24:28,170 INFO handler.ContextHandler (ContextHandler.java:doStart(857)) - Started o.e.j.w.WebAppContext@f096f37{/gateway/manager/admin-ui,file:///usr/local/datadisk/knox-1.3.0/data/deployments/manager.topo.16e7d9bb9e0/%252Fadmin-ui/,AVAILABLE}{/usr/local/datadisk/knox-1.3.0/data/deployments/manager.topo.16e7d9bb9e0/%2Fadmin-ui} 2019-11-18 08:24:28,188 INFO annotations.AnnotationConfiguration (AnnotationConfiguration.java:scanForAnnotations(481)) - Scanning elapsed time=8ms 2019-11-18 08:24:28,192 INFO ContextHandler.gateway_manager (ContextHandler.java:log(2351)) - No Spring WebApplicationInitializer types detected on classpath 2019-11-18 08:24:28,228 INFO handler.ContextHandler (ContextHandler.java:doStart(857)) - Started o.e.j.w.WebAppContext@3effd4f3{/gateway/manager,file:///usr/local/datadisk/knox-1.3.0/data/deployments/manager.topo.16e7d9bb9e0/%252F/,AVAILABLE}{/usr/local/datadisk/knox-1.3.0/data/deployments/manager.topo.16e7d9bb9e0/%2F} 2019-11-18 08:24:28,250 INFO annotations.AnnotationConfiguration (AnnotationConfiguration.java:scanForAnnotations(481)) - Scanning elapsed time=8ms 2019-11-18 08:24:28,256 INFO ContextHandler.gateway_admin (ContextHandler.java:log(2351)) - No Spring WebApplicationInitializer types detected on classpath 2019-11-18 08:24:28,282 INFO ContextHandler.gateway_admin (ContextHandler.java:log(2351)) - Initializing Shiro environment 2019-11-18 08:24:28,282 INFO env.EnvironmentLoader (EnvironmentLoader.java:initEnvironment(133)) - Starting Shiro environment initialization. 2019-11-18 08:24:28,287 INFO env.EnvironmentLoader (EnvironmentLoader.java:initEnvironment(147)) - Shiro environment initialized in 5 ms. 2019-11-18 08:24:28,289 INFO handler.ContextHandler (ContextHandler.java:doStart(857)) - Started o.e.j.w.WebAppContext@1a28b346{/gateway/admin,file:///usr/local/datadisk/knox-1.3.0/data/deployments/admin.topo.16e7d9bb9e0/%252F/,AVAILABLE}{/usr/local/datadisk/knox-1.3.0/data/deployments/admin.topo.16e7d9bb9e0/%2F} 2019-11-18 08:24:28,296 INFO ssl.SslContextFactory (SslContextFactory.java:load(370)) - x509=X509@3bec5821(gateway-identity,h=[hk-test-cdh109, localhost],w=[]) for SslContextFactory@4086d8fb[provider=null,keyStore=file:///usr/local/datadisk/knox-1.3.0/data/security/keystores/gateway.jks,trustStore=null] 2019-11-18 08:24:28,340 INFO server.AbstractConnector (AbstractConnector.java:doStart(292)) - Started ServerConnector@3af37506{SSL,[ssl, http/1.1]}{0.0.0.0:8443} 2019-11-18 08:24:28,340 INFO server.Server (Server.java:doStart(410)) - Started @5977ms 2019-11-18 08:24:28,341 INFO knox.gateway (GatewayServer.java:start(662)) - Monitoring topologies in directory: /usr/local/datadisk/knox-1.3.0/conf/topologies 2019-11-18 08:24:28,343 INFO knox.gateway (GatewayServer.java:startGateway(385)) - Started gateway on port 8,443. 2019-11-18 08:25:26,319 INFO knox.gateway (KnoxLdapRealm.java:getUserDn(688)) - Computed userDn: uid=admin,ou=people,dc=hadoop,dc=apache,dc=org using dnTemplate for principal: admin 2019-11-18 08:26:46,570 INFO knox.gateway (KnoxLdapRealm.java:getUserDn(688)) - Computed userDn: uid=admin,ou=people,dc=hadoop,dc=apache,dc=org using dnTemplate for principal: admin 2019-11-18 08:35:42,564 WARN federation.jwt (SSOCookieFederationFilter.java:init(80)) - Configuration for authentication provider URL is missing - will derive default URL.
... View more
Labels:
- Labels:
-
Apache Knox
05-23-2019
02:23 AM
this is really helpful
... View more
02-28-2019
01:31 AM
1 Kudo
solved. while choosing Repository Location: check the "Public Cloudera Repository"
... View more
02-27-2019
05:48 AM
when i install cm agent using cloudera manager,got "Installation failed. Failed to copy installation files." click the ditails: Failed to copy installation files. View
/tmp/scm_prepare_node.SkukORUR
Could not verify key bundle check the log /var/log/cloudera-scm-server# tail -f cloudera-scm-server.log
2019-02-27 21:26:32,543 INFO scm-web-227:com.cloudera.cmf.command.flow.CmdStep: Executing command work: Install on ip-172-22-1-148.
2019-02-27 21:26:32,543 INFO scm-web-227:com.cloudera.server.cmf.node.NodeConfiguratorService: Adding password-based configurator for ip-172-22-1-148
2019-02-27 21:26:32,544 INFO scm-web-227:com.cloudera.server.cmf.node.NodeConfiguratorService: Submitted configurator for ip-172-22-1-148 with id 69
2019-02-27 21:26:32,547 INFO NodeConfiguratorThread-68-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-22-1-148: Transitioning from INIT (PT0.004S) to CONNECT
2019-02-27 21:26:32,548 INFO NodeConfiguratorThread-68-0:net.schmizz.sshj.transport.TransportImpl: Client identity string: SSH-2.0-SSHJ_0_14_0
2019-02-27 21:26:32,552 INFO scm-web-227:com.cloudera.enterprise.JavaMelodyFacade: Exiting HTTP Operation: Method:POST, Path:/add-hosts-wizard/install, Status:200
2019-02-27 21:26:32,553 INFO NodeConfiguratorThread-68-0:net.schmizz.sshj.transport.TransportImpl: Server identity string: SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.4
2019-02-27 21:26:32,560 INFO NodeConfiguratorThread-68-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-22-1-148: Transitioning from CONNECT (PT0.013S) to AUTHENTICATE
2019-02-27 21:26:32,603 INFO NodeConfiguratorThread-68-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-22-1-148: Transitioning from AUTHENTICATE (PT0.043S) to MAKE_TEMP_DIR
2019-02-27 21:26:32,681 INFO NodeConfiguratorThread-68-0:com.cloudera.server.cmf.node.NodeConfigurator: Executing mktemp -d /tmp/scm_prepare_node.XXXXXXXX on ip-172-22-1-148
2019-02-27 21:26:32,684 INFO NodeConfiguratorThread-68-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-22-1-148: Transitioning from MAKE_TEMP_DIR (PT0.081S) to COPY_FILES
2019-02-27 21:26:32,854 INFO NodeConfiguratorThread-68-0:com.cloudera.server.cmf.node.NodeConfigurator: Using key bundle from URL: http://archive.cloudera.com/cm6/6.1.1/allkeys.asc
2019-02-27 21:26:32,904 WARN NodeConfiguratorThread-68-0:com.cloudera.server.cmf.node.NodeConfigurator: Unhandled exception
java.lang.SecurityException: Could not verify key bundle
at com.cloudera.server.cmf.node.NodeConfigurator.verifyGpgKeyBundle(NodeConfigurator.java:685)
at com.cloudera.server.cmf.node.NodeConfigurator.copyFiles(NodeConfigurator.java:629)
at com.cloudera.server.cmf.node.NodeConfigurator.configure(NodeConfigurator.java:992)
at com.cloudera.server.cmf.node.NodeConfigurator.run(NodeConfigurator.java:1062)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
at com.cloudera.cmf.crypto.ClearSignedFileProcessor.getFileSignature(ClearSignedFileProcessor.java:197)
at com.cloudera.server.cmf.node.NodeConfigurator.verifyGpgKeyBundle(NodeConfigurator.java:682)
... 8 more
2019-02-27 21:26:32,904 INFO NodeConfiguratorThread-68-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: ip-172-22-1-148: Setting COPY_FILES as failed and done state
2019-02-27 21:26:32,904 INFO NodeConfiguratorThread-68-0:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION
2019-02-27 21:26:33,048 INFO scm-web-236:com.cloudera.enterprise.JavaMelodyFacade: Entering HTTP Operation: Method:POST, Path:/express-wizard/updateHostsState
2019-02-27 21:26:33,051 INFO scm-web-236:com.cloudera.enterprise.JavaMelodyFacade: Exiting HTTP Operation: Method:POST, Path:/express-wizard/updateHostsState, Status:200
2019-02-27 21:26:37,561 ERROR CommandPusher:com.cloudera.cmf.command.flow.WorkOutputs: CMD id: 21 Failed to complete installation on host ip-172-22-1-148.
2019-02-27 21:26:37,562 ERROR CommandPusher:com.cloudera.cmf.model.DbCommand: Command 21(GlobalHostInstall) has completed. finalstate:FINISHED, success:false, msg:Failed to complete installation.
2019-02-27 21:26:38,179 INFO scm-web-229:com.cloudera.enterprise.JavaMelodyFacade: Entering HTTP Operation: Method:POST, Path:/add-hosts-wizard/installprogressdata.json
2019-02-27 21:26:38,181 INFO scm-web-229:com.cloudera.enterprise.JavaMelodyFacade: Exiting HTTP Operation: Method:POST, Path:/add-hosts-wizard/installprogressdata.json, Status:200
2019-02-27 21:26:38,292 INFO scm-web-237:com.cloudera.enterprise.JavaMelodyFacade: Entering HTTP Operation: Method:POST, Path:/express-wizard/updateHostsState
2019-02-27 21:26:38,293 INFO scm-web-237:com.cloudera.enterprise.JavaMelodyFacade: Exiting HTTP Operation: Method:POST, Path:/express-wizard/updateHostsState, Status:200 i tryed wget https://archive.cloudera.com/cm6/6.1.1/ubuntu1604/apt/archive.key ;apt-key add archive.key did not work
... View more
Labels:
- Labels:
-
Cloudera Manager
01-13-2019
06:54 PM
Got it myself , the error above is due to lack of lib, ( do not konw which exacly) solved after install the following sudo apt-get install git ant gcc g++ libffi-dev libkrb5-dev libmysqlclient-dev libsasl2-dev libsasl2-modules-gssapi-mit libsqlite3-dev libssl-dev libxml2-dev libxslt-dev make maven libldap2-dev python-dev python-setuptools libgmp3-dev
... View more
01-13-2019
06:39 PM
It also works for me . big 3KQ !
... View more
01-10-2019
05:28 AM
I am also trying DBbeaver
... View more
01-08-2019
02:15 AM
I config prostro on hue ：Hue Service → Configuration → Service-Wide → Advanced → Hue Service Advanced Configuration Snippet (Safety Valve) for hue_safety_valve.ini，
when I add the following:
[notebook]
[[interpreters]]
[[[presto]]]
name=Presto JDBC
interface=jdbc
options='{"url": "jdbc:presto://172.31.17.252:9080/", "driver": "com.facebook.presto.jdbc.PrestoDriver"}'
thus the hue-->query-->editor only show "prosto JDBC ", how to config presto without losting the hive and impala button on edior ????
I try to config all these
[notebook]
## Show the notebook menu or not
# show_notebooks=true
## Flag to enable the selection of queries from files, saved queries into the editor or as snippet.
# enable_external_statements=true
## Flag to enable the bulk submission of queries as a background task through Oozie.
# enable_batch_execute=true
## Flag to turn on the SQL indexer.
# enable_sql_indexer=false
## Flag to turn on the Presentation mode of the editor.
# enable_presentation=true
## Flag to enable the SQL query builder of the table assist.
# enable_query_builder=true
## Flag to enable the creation of a coordinator for the current SQL query.
# enable_query_scheduling=false
## Main flag to override the automatic starting of the DBProxy server.
# enable_dbproxy_server=true
## Classpath to be appended to the default DBProxy server classpath.
# dbproxy_extra_classpath=
## Comma separated list of interpreters that should be shown on the wheel. This list takes precedence over the
## order in which the interpreter entries appear. Only the first 5 interpreters will appear on the wheel.
# interpreters_shown_on_wheel=
# One entry for each type of snippet.
[[interpreters]]
# Define the name and how to connect and execute the language.
[[[hive]]]
# The name of the snippet.
name=Hive
# The backend connection to use to communicate with the server.
interface=hiveserver2
[[[impala]]]
name=Impala
interface=hiveserver2
# [[[sparksql]]]
# name=SparkSql
# interface=hiveserver2
[[[spark]]]
name=Scala
interface=livy
[[[pyspark]]]
name=PySpark
interface=livy
[[[r]]]
name=R
interface=livy
[[[jar]]]
name=Spark Submit Jar
interface=livy-batch
[[[py]]]
name=Spark Submit Python
interface=livy-batch
[[[text]]]
name=Text
interface=text
[[[markdown]]]
name=Markdown
interface=text
[[[mysql]]]
name = MySQL
interface=rdbms
[[[sqlite]]]
name = SQLite
interface=rdbms
[[[postgresql]]]
name = PostgreSQL
interface=rdbms
[[[oracle]]]
name = Oracle
interface=rdbms
[[[solr]]]
name = Solr SQL
interface=solr
## Name of the collection handler
# options='{"collection": "default"}'
[[[pig]]]
name=Pig
interface=oozie
[[[java]]]
name=Java
interface=oozie
[[[spark2]]]
name=Spark
interface=oozie
[[[mapreduce]]]
name=MapReduce
interface=oozie
[[[sqoop1]]]
name=Sqoop1
interface=oozie
[[[distcp]]]
name=Distcp
interface=oozie
[[[shell]]]
name=Shell
interface=oozie
[[[presto]]]
name=Presto JDBC
interface=jdbc
options='{"url": "jdbc:presto://172.31.17.252:9080/hive/tmp", "driver": "com.facebook.presto.jdbc.PrestoDriver","user":"", "password":""}'
thus The hive impala return，but I when click prestoJDBC on editor ,I got this in hue server log file :
Error running autocomplete
Traceback (most recent call last):
File "/home/ubuntu/data_disk/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop/libs/notebook/src/notebook/decorators.py", line 97, in decorator
return func(*args, **kwargs)
File "/home/ubuntu/data_disk/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop/libs/notebook/src/notebook/api.py", line 572, in autocomplete
autocomplete_data = get_api(request, snippet).autocomplete(snippet, database, table, column, nested)
File "/home/ubuntu/data_disk/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop/libs/notebook/src/notebook/connectors/base.py", line 269, in get_api
return JdbcApi(request.user, interpreter=interpreter)
File "/home/ubuntu/data_disk/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop/libs/notebook/src/notebook/connectors/jdbc.py", line 66, in __init__
self.db = API_CACHE[self.cache_key] = Jdbc(self.options['driver'], self.options['url'], username, self.options['password'])
File "/home/ubuntu/data_disk/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/desktop/libs/librdbms/src/librdbms/jdbc.py", line 67, in __init__
self.gateway = JavaGateway.launch_gateway(classpath=classpath)
File "/home/ubuntu/data_disk/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/build/env/lib/python2.7/site-packages/py4j-0.9-py2.7.egg/py4j/java_gateway.py", line 1537, in launch_gateway
daemonize_redirect=daemonize_redirect)
File "/home/ubuntu/data_disk/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/hue/build/env/lib/python2.7/site-packages/py4j-0.9-py2.7.egg/py4j/java_gateway.py", line 178, in launch_gateway
close_fds=True)
File "/usr/lib/python2.7/subprocess.py", line 711, in __init__
errread, errwrite)
File "/usr/lib/python2.7/subprocess.py", line 1343, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory
what file missing ??????
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Impala
-
Cloudera Hue