Member since
09-20-2014
39
Posts
5
Kudos Received
5
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 10830 | 09-07-2016 03:18 AM | |
| 7734 | 02-01-2016 03:08 AM | |
| 2891 | 07-23-2015 09:35 AM | |
| 2924 | 12-18-2014 08:09 AM | |
| 8519 | 09-21-2014 07:50 AM |
09-07-2016
03:18 AM
1 Kudo
So we have found the problem, sorry for early post, but maybe for somebody else it can be helpful: For all the aliases stored in keystores must be used the same password, as said here: http://www.cloudera.com/documentation/enterprise/5-7-x/topics/cm_sg_tls_browser.html Set -keypass to the same value as -storepass. Cloudera Manager assumes that the same password is used to access both the key and the keystore, and therefore, does not support separate values for -keypass and -storepass. We changed these passwords so they are the same now, changed the passwords also in our external MySQL database and then restart the Cloudera Manager server and it worked fine.
... View more
09-07-2016
02:23 AM
Hello all, I have an installation of Cloudera Express and our admins have performed OpenStack upgrade during the last weekend. After the upgrade and reboot of the whole (virtualized) system, once I wanted to start Cloudera Manager server again (by service cloudera-scm-server start), I have encountered this error issue below, taken from: /opt/cloudera/cloudera-manager/cm-5.7.1/log/cloudera-scm-server/cloudera-scm-server.log I have Cloudera Express 5.7.1 on CentOS 6.6 with Java 1.8.0_60, Python 2.6.6 and using external MySQL 5.1.73. I had also all levels of TLS for Cloudera Manager set up before the upgrade, now it looks like the error in the keystore. I just want to add that no IP adresses used in the appropriate certificates didn't change, so I think this is not affecting it. Can you please help me? Many thanks in advance! 2016-09-07 09:12:53,340 INFO MainThread:com.cloudera.server.cmf.Main: Agent connections will use TLS
2016-09-07 09:12:53,340 INFO MainThread:com.cloudera.server.cmf.Main: Agent TLS certificates will be validated.
2016-09-07 09:12:53,340 INFO MainThread:com.cloudera.server.cmf.Main: Agent RPC connections will use port: 7182
2016-09-07 09:12:53,391 INFO MainThread:org.mortbay.log: jetty-6.1.26.cloudera.4
2016-09-07 09:12:53,447 WARN MainThread:org.mortbay.log: failed SslSelectChannelConnector@0.0.0.0:7182: java.security.UnrecoverableKeyException: Cannot recover key
2016-09-07 09:12:53,448 WARN MainThread:org.mortbay.log: failed Server@1e454228: java.security.UnrecoverableKeyException: Cannot recover key
2016-09-07 09:12:53,448 ERROR MainThread:com.cloudera.server.cmf.Main: Failed to start Agent listener.
2016-09-07 09:12:53,448 ERROR MainThread:com.cloudera.server.cmf.Main: Server failed.
org.apache.avro.AvroRuntimeException: java.security.UnrecoverableKeyException: Cannot recover key
at com.cloudera.server.common.HttpConnectorServer.start(HttpConnectorServer.java:89)
at com.cloudera.server.cmf.Main.startAgentServer(Main.java:571)
at com.cloudera.server.cmf.Main.startAvro(Main.java:483)
at com.cloudera.server.cmf.Main.run(Main.java:619)
at com.cloudera.server.cmf.Main.main(Main.java:217)
Caused by: java.security.UnrecoverableKeyException: Cannot recover key
at sun.security.provider.KeyProtector.recover(KeyProtector.java:328)
at sun.security.provider.JavaKeyStore.engineGetKey(JavaKeyStore.java:146)
at sun.security.provider.JavaKeyStore$JKS.engineGetKey(JavaKeyStore.java:56)
at sun.security.provider.KeyStoreDelegator.engineGetKey(KeyStoreDelegator.java:96)
at sun.security.provider.JavaKeyStore$DualFormatJKS.engineGetKey(JavaKeyStore.java:70)
at java.security.KeyStore.getKey(KeyStore.java:1023)
at sun.security.ssl.SunX509KeyManagerImpl.<init>(SunX509KeyManagerImpl.java:133)
at sun.security.ssl.KeyManagerFactoryImpl$SunX509.engineInit(KeyManagerFactoryImpl.java:70)
at javax.net.ssl.KeyManagerFactory.init(KeyManagerFactory.java:256)
at org.mortbay.jetty.security.SslSelectChannelConnector.createSSLContext(SslSelectChannelConnector.java:651)
at org.mortbay.jetty.security.SslSelectChannelConnector.doStart(SslSelectChannelConnector.java:613)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.jetty.Server.doStart(Server.java:235)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at com.cloudera.server.common.HttpConnectorServer.start(HttpConnectorServer.java:87)
... 4 more
2016-09-07 09:12:53,869 WARN ParcelUpdateService:com.cloudera.parcel.components.ParcelDownloaderImpl: Invalid parcel in manifest : KAFKA-2.0.2-1.2.0.2.p0.5-jessie.parcel
2016-09-07 09:12:53,924 WARN ParcelUpdateService:com.cloudera.parcel.components.ParcelDownloaderImpl: Invalid parcel in manifest : KEYTRUSTEE-5.8.0-5.KEYTRUSTEE5.8.0.p0.21-jessie.parcel
2016-09-07 09:12:53,924 WARN ParcelUpdateService:com.cloudera.parcel.components.ParcelDownloaderImpl: Invalid parcel in manifest : KEYTRUSTEE-5.8.0-5.KEYTRUSTEE5.8.0.p0.21-sles12.parcel
2016-09-07 09:12:55,019 ERROR ParcelUpdateService:com.cloudera.parcel.components.ParcelDownloaderImpl: Failed to download manifest. Status code: 404 URI: http://archive.cloudera.com/gplextras5/parcels/manifest.json
2016-09-07 09:12:55,309 WARN ParcelUpdateService:com.cloudera.parcel.components.ParcelDownloaderImpl: Invalid parcel in manifest : CDH-5.8.0-1.cdh5.8.0.p0.42-sles12.parcel
2016-09-07 09:12:55,309 WARN ParcelUpdateService:com.cloudera.parcel.components.ParcelDownloaderImpl: Invalid parcel in manifest : CDH-5.8.0-1.cdh5.8.0.p0.42-jessie.parcel
2016-09-07 09:13:02,948 INFO ScmActive-0:com.cloudera.server.cmf.components.ScmActive: ScmActive completed successfully.
2016-09-07 09:13:48,121 INFO CMMetricsForwarder-0:com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder: Failed to send metrics.
java.lang.reflect.UndeclaredThrowableException
at com.sun.proxy.$Proxy88.writeMetrics(Unknown Source)
at com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder.sendWithAvro(ClouderaManagerMetricsForwarder.java:325)
at com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder.sendMetrics(ClouderaManagerMetricsForwarder.java:312)
at com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder.run(ClouderaManagerMetricsForwarder.java:146)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.avro.AvroRemoteException: java.net.ConnectException: Connection refused
at org.apache.avro.ipc.specific.SpecificRequestor.invoke(SpecificRequestor.java:88)
... 11 more
Caused by: java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at sun.net.NetworkClient.doConnect(NetworkClient.java:175)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
at sun.net.www.http.HttpClient.<init>(HttpClient.java:211)
at sun.net.www.http.HttpClient.New(HttpClient.java:308)
at sun.net.www.http.HttpClient.New(HttpClient.java:326)
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1168)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1104)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:998)
at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:932)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream0(HttpURLConnection.java:1282)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1257)
at org.apache.avro.ipc.HttpTransceiver.writeBuffers(HttpTransceiver.java:71)
at org.apache.avro.ipc.Transceiver.transceive(Transceiver.java:58)
at org.apache.avro.ipc.Transceiver.transceive(Transceiver.java:72)
at org.apache.avro.ipc.Requestor.request(Requestor.java:147)
at org.apache.avro.ipc.Requestor.request(Requestor.java:101)
at org.apache.avro.ipc.specific.SpecificRequestor.invoke(SpecificRequestor.java:72)
... 11 more
2016-09-07 09:13:54,899 INFO Thread-11:org.springframework.context.support.ClassPathXmlApplicationContext: Closing ApplicationContext 'rootContext': startup date [Wed Sep 07 09:12:24 CEST 2016]; parent: org.springframework.context.support.GenericApplicationContext@682b2fa
2016-09-07 09:13:54,905 INFO Thread-11:org.springframework.beans.factory.support.DefaultListableBeanFactory: Destroying singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@2401856: defining beans [contextApplicationContextProvider,org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0,sessionRegistry,passwordEncoder,predefinedPlots,workAggregatesConfigListener,predefinedViews,monitoringTypesInitializer,metricSchemaManagerBean,viewFactory,metricSchemaGeneration,csdRegistryImpl,csdLocalRepository,mdlRegistry,csdTranslationManager,csdManager,validatorConfiguration,parameterFactory,securityUtils,sslHelper,dssdToggleListener.PostCommit,dssdToggleListener.PreCommit,oozieLoadBalancerConfigUpdateListener,HBaseIndexerAuthenticationConfigUpdateListener,scmParamTrackerStoreImpl,dynamicServiceHandlerFactory,runnerDescriptorProcessFactory,configWriterFactory,auxConfigGeneratorFactory,peerConfigGeneratorFactory,compatibilityFactory,providesFactory,configGeneratorFactory,kerberosPrincProvider,processStalenessInterceptor,processStalenessDetector,configHelper,processHelper,paramResolver,releaseDetector,zkServerInitListener,solrAuthenticationConfigUpdateListener,solrLoadBalancerConfigUpdateListener,HBaseZkConfigUpdateListener,hbaseRestServerSecurityListener,hbaseThriftServerSecurityListener,callableFactory,commandManager,stalenessChecker,commandStorage,diagnosticsDataUploadHelper,cmfSchedulerImpl,scheduleManagerImpl,dirtyParametersListener,descriptorFactory,clientProtocolImpl,idleSessionManagerImpl,sessionServiceImpl,hostTemplateManagerImpl,actionablesProviderImpl,cloudStatusDeterminer,heartbeatCheckerImpl,beanConfiguration,serviceDataProviderBean,scmDbValueStore,clouderaManagerMetricsForwarder,firehoseRequestService,operationalReportsDisabledListener,scmActive,embeddedDbManager,licenseManagerImpl,navigatorDisabledListener,cmServerState,userSettingTransactionManagerImpl,currentUserManagerImpl,trialEventAuditor,authorizer,operationsManagerImpl,cmUpgradeHelper,licensedFeatureManager,trialEventStalenessCheckTrigger,jythonObjectFactoryImpl,pythonInterpreterFactory,logSearchEventsCollectorImpl,agentLogFetcherImpl,serverLogFetcherImpl,ServerLogSearchResponse,parcelManagerImpl,parcelStatusProviderImpl,parcelDependencyManagerImpl,localParcelManagerImpl,parcelInstallerImpl,parcelDownloaderImpl,parcelUpdateService,periodicParcelTasks,parcelRepoConfigUpdateListener,agentParcelProviderImpl,prototypeFactory,org.springframework.context.annotation.internalConfigurationAnnotationProcessor,org.springframework.context.annotation.internalAutowiredAnnotationProcessor,org.springframework.context.annotation.internalRequiredAnnotationProcessor,org.springframework.context.annotation.internalCommonAnnotationProcessor,rulesEngine,builtInServiceTypes,builtInRoleTypes,builtInNamesForCrossEntityAggregateMetrics,builtInMetricEntityAttributes,builtInMetricEntityTypes,uniqueFieldValidator,validServiceDependencyValidator,uniqueServiceTypeValidator,uniqueRoleTypeValidator,existingServiceTypeValidator,existingRoleTypeValidator,expressionValidator,autoConfigSharesValidValidator,messageInterpolator,sdlParser,mdlParser,parcelParser,alternativesParser,permissionsParser,manifestParser,stringInterpolator,serviceDescriptorValidatorWithoutDependencyCheck,serviceDescriptorValidatorWithDependencyCheck,serviceMonitoringDefinitionsDescriptorValidator,descriptorVisitor,referenceValidator,parcelDescriptorValidator,alternativesDescriptorValidator,permissionsDescriptorValidator,manifestDescriptorValidator,defaultValidatorConfiguration,springConstraintValidatorFactory,validatorFactoryBean,metricNameFormatValidator,nameForCrossEntityAggregateFormatValidator,objectMapper,getObjectMapper,agentAsyncClient,newHeartbeatRequester,commandRequestsBean,getSupportedLocale,newServiceHandlerRegistry,newEventStoreClientFactory,newAutoUpgradeHandlerRegistry,newUpgradeHandlerRegistry,newAgentResultFetcher,newCmfEntityManager,newDatabaseSizeGauge,newCdhExecutorFactory,databaseExecutor]; parent: org.springframework.beans.factory.support.DefaultListableBeanFactory@3d34d211
2016-09-07 09:13:54,909 INFO Thread-11:com.cloudera.server.cmf.components.ScmActive: ScmActive shutting down.
2016-09-07 09:13:54,916 INFO metric-schema-updater:com.cloudera.cmon.components.MetricSchemaManager: Breaking from sleep in schema update thread.
... View more
Labels:
02-09-2016
02:14 AM
Hello! I would like to ask about Cloudera Search in HUE. Is there a way how to use more than one file when creating a new dashboard? In the initial form I am able to add only one file which is honestly not much data. Then I tried to pre-merge all the files I need to show into one and then I got error: "File size is too large to handle!", then I found out the maximum file size is 100MB. Am I using the Cloudera Search in a wrong way? My version of CDH is 5.4.7 Thank you for your help! Best regards, Václav Surovec
... View more
Labels:
02-01-2016
03:08 AM
Hello, So I solved by uploading the jar file on the (local) unix filesystem (with prefix file://) instead of using it from HDFS. I don't know why, but even with the prefix "hdfs://" HUE or Spark was not able to use it from that Path. Václav
... View more
01-30-2016
09:17 AM
Here is the log from the command line when building the livy server: $ ./build/env/bin/hue livy_server SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/pkg/moip/data2_mzlp/mzpl/work/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/jars/livy-assembly.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/pkg/moip/data2_mzlp/mzpl/work/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 07:02:35.621 [main] INFO com.cloudera.hue.livy.server.Main$ - Using spark-submit version 1.5.0-cdh5.5.1 07:02:35.694 [main] INFO com.cloudera.hue.jetty.util.log - Logging initialized @6518ms 07:02:35.929 [main] INFO com.cloudera.hue.jetty.server.Server - jetty-9.2.z-SNAPSHOT 07:02:36.012 [main] INFO o.scalatra.servlet.ScalatraListener - The cycle class name from the config: com.cloudera.hue.livy.server.ScalatraBootstrap 07:02:36.038 [main] INFO o.scalatra.servlet.ScalatraListener - Initializing life cycle class: ScalatraBootstrap 07:02:36.044 [main] INFO c.c.h.livy.server.ScalatraBootstrap - Using Process() sessions 07:02:36.705 [main] INFO c.c.h.j.s.handler.ContextHandler - Started c.c.h.j.s.ServletContextHandler@7766c836{/,file:/pkg/moip/data2_mzlp/mzpl/work/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/lib/hue/src/main/com/cloudera/hue/livy/server,AVAILABLE} 07:02:36,705 |-INFO in null - Will use configuration resource [/logback-access.xml] 07:02:36,707 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@ed2be35 - URL [jar:file:/pkg/moip/data2_mzlp/mzpl/work/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/jars/livy-assembly.jar!/logback-access.xml] is not of type file 07:02:36,714 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - debug attribute not set 07:02:36,714 |-INFO in ch.qos.logback.core.joran.action.StatusListenerAction - Added status listener of type [ch.qos.logback.core.status.OnConsoleStatusListener] 07:02:36,715 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 07:02:36,715 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 07:02:36,716 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.access.PatternLayoutEncoder] for [encoder] property 07:02:36,735 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to null 07:02:36,735 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - End of configuration. 07:02:36,736 |-INFO in ch.qos.logback.access.joran.JoranConfigurator@60d2b97b - Registering current configuration as safe fallback point 07:02:36,705 |-INFO in LogbackRequestLog - Will use configuration resource [/logback-access.xml] 07:02:36,707 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@ed2be35 - URL [jar:file:/pkg/moip/data2_mzlp/mzpl/work/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/jars/livy-assembly.jar!/logback-access.xml] is not of type file 07:02:36,714 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - debug attribute not set 07:02:36,714 |-INFO in ch.qos.logback.core.joran.action.StatusListenerAction - Added status listener of type [ch.qos.logback.core.status.OnConsoleStatusListener] 07:02:36,715 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender] 07:02:36,715 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT] 07:02:36,716 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.access.PatternLayoutEncoder] for [encoder] property 07:02:36,735 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to null 07:02:36,735 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - End of configuration. 07:02:36,736 |-INFO in ch.qos.logback.access.joran.JoranConfigurator@60d2b97b - Registering current configuration as safe fallback point 07:02:36.757 [main] INFO c.c.hue.jetty.server.ServerConnector - Started ServerConnector@3e3d6c70{HTTP/1.1}{localhost:8998} 07:02:40.954 [main] INFO com.cloudera.hue.jetty.server.Server - Started @11779ms 07:02:40.959 [main] INFO com.cloudera.hue.livy.WebServer - Starting server on 8998 07:07:05.436 [ForkJoinPool-1-worker-1] INFO c.c.h.l.s.SparkSubmitProcessBuilder - Running /pkg/moip/data2_mzlp/mzpl/work/cloudera/parcels/CDH/lib/spark/bin/spark-submit --name Livy --class cz.tmobile.surovecv.sparkwordcount.JavaWordCount --proxy-user hdfs file:////user/cdrstore/jars/SparkWordCount-1.0-SNAPSHOT.jar /user/cdrstore/pokus.txt 2 07:07:05.460 [ForkJoinPool-1-worker-1] INFO c.c.hue.livy.server.SessionManager - created session 0
... View more
01-30-2016
08:45 AM
Hi! I am running in local mode and I did not put anything in the jar input field... Thank you for any help!
... View more
01-25-2016
01:09 PM
Hi Romain! I am running like this: ./build/env/bin/hue livy_server as it was in the manual on gethue.com ...and what do you mean by the second question?
... View more
01-25-2016
05:53 AM
Hi to all! Do you know why I am keep getting this error below when running SparkWordCount jar app in HUE Spark Notebook? My HUE version is 3.9.0 (CDH 5.5.1). Do you think you can please help me? Path: /user/hdfs/SparkWordCount-1.0-SNAPSHOT.jar Class: cz.tmobile.surovecv.sparkwordcount.JavaWordCount SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/pkg/moip/data2_mzlp/mzpl/work/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/jars/avro-tools-1.7.6-cdh5.5.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/pkg/moip/data2_mzlp/mzpl/work/cloudera/parcels/CDH-5.5.1-1.cdh5.5.1.p0.11/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. Warning: Local jar /user/hdfs/SparkWordCount-1.0-SNAPSHOT.jar does not exist, skipping. java.lang.ClassNotFoundException: cz.tmobile.surovecv.sparkwordcount.JavaWordCount at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:270) at org.apache.spark.util.Utils$.classForName(Utils.scala:173) at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:639) at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:162) at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:160) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671) at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:160) at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:120) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
... View more
Labels:
07-23-2015
09:35 AM
Problem solved. I used DNS aliases when configuring DNS. Sorry for spam, but maybe it will help someone.
... View more
07-23-2015
08:06 AM
Hello, I am installing CM Express 5.4.3 with CDH 5.4.4 parcel and I got this error during the new installation during Host Inspector. Can anyone please help me? Thank you! Václav Surovec Error A server error has occurred. Send the following information to Cloudera. Path: http://hknode009.cz.tmo:7180/cmf/add-hosts-wizard/inspectordata Version: Cloudera Express 5.4.3 (#258 built by jenkins on 20150625-2046 git: 1139ffb081360fbbb1be8a19a87ca3c52ee4b1cf) java.lang.NullPointerException: at InspectorOutputImpl.java line 534 in com.cloudera.server.web.cmf.InspectorOutputImpl renderNoFlush() Stack Trace: InspectorOutputImpl.java line 534 in com.cloudera.server.web.cmf.InspectorOutputImpl renderNoFlush() InspectorOutput.java line 198 in com.cloudera.server.web.cmf.InspectorOutput renderNoFlush() InspectorOutput.java line 189 in com.cloudera.server.web.cmf.InspectorOutput render() InspectorOutput.java line 181 in com.cloudera.server.web.cmf.InspectorOutput$1 renderTo() JamonModelAndView.java line 50 in com.cloudera.server.web.common.JamonModelAndView$JamonView <init>() JamonModelAndView.java line 27 in com.cloudera.server.web.common.JamonModelAndView$JamonView <init>() JamonModelAndView.java line 86 in com.cloudera.server.web.common.JamonModelAndView of() AddHostsWizardControllerBase.java line 748 in com.cloudera.server.web.cmf.AddHostsWizardControllerBase wizardInspectorData() <generated> line -1 in com.cloudera.server.web.cmf.AddHostsWizardControllerBase$$FastClassByCGLIB$$46379e37 invoke() MethodProxy.java line 191 in net.sf.cglib.proxy.MethodProxy invoke() Cglib2AopProxy.java line 688 in org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation invokeJoinpoint() ReflectiveMethodInvocation.java line 150 in org.springframework.aop.framework.ReflectiveMethodInvocation proceed() MethodSecurityInterceptor.java line 61 in org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor invoke() ReflectiveMethodInvocation.java line 172 in org.springframework.aop.framework.ReflectiveMethodInvocation proceed() Cglib2AopProxy.java line 621 in org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor intercept() <generated> line -1 in com.cloudera.server.web.cmf.AddHostsWizardController$$EnhancerByCGLIB$$bc9e607a wizardInspectorData() NativeMethodAccessorImpl.java line -2 in sun.reflect.NativeMethodAccessorImpl invoke0() NativeMethodAccessorImpl.java line 62 in sun.reflect.NativeMethodAccessorImpl invoke() DelegatingMethodAccessorImpl.java line 43 in sun.reflect.DelegatingMethodAccessorImpl invoke() Method.java line 497 in java.lang.reflect.Method invoke() HandlerMethodInvoker.java line 176 in org.springframework.web.bind.annotation.support.HandlerMethodInvoker invokeHandlerMethod() AnnotationMethodHandlerAdapter.java line 436 in org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter invokeHandlerMethod() AnnotationMethodHandlerAdapter.java line 424 in org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter handle() DispatcherServlet.java line 790 in org.springframework.web.servlet.DispatcherServlet doDispatch() DispatcherServlet.java line 719 in org.springframework.web.servlet.DispatcherServlet doService() FrameworkServlet.java line 669 in org.springframework.web.servlet.FrameworkServlet processRequest() FrameworkServlet.java line 585 in org.springframework.web.servlet.FrameworkServlet doPost() HttpServlet.java line 727 in javax.servlet.http.HttpServlet service() HttpServlet.java line 820 in javax.servlet.http.HttpServlet service() ServletHolder.java line 511 in org.mortbay.jetty.servlet.ServletHolder handle() ServletHandler.java line 1221 in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter() UserAgentFilter.java line 78 in org.mortbay.servlet.UserAgentFilter doFilter() GzipFilter.java line 131 in org.mortbay.servlet.GzipFilter doFilter() ServletHandler.java line 1212 in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter() JAMonServletFilter.java line 48 in com.jamonapi.http.JAMonServletFilter doFilter() ServletHandler.java line 1212 in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter() JavaMelodyFacade.java line 109 in com.cloudera.enterprise.JavaMelodyFacade$MonitoringFilter doFilter() ServletHandler.java line 1212 in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter() FilterChainProxy.java line 311 in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter() FilterSecurityInterceptor.java line 116 in org.springframework.security.web.access.intercept.FilterSecurityInterceptor invoke() FilterSecurityInterceptor.java line 83 in org.springframework.security.web.access.intercept.FilterSecurityInterceptor doFilter() FilterChainProxy.java line 323 in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter() ExceptionTranslationFilter.java line 113 in org.springframework.security.web.access.ExceptionTranslationFilter doFilter() FilterChainProxy.java line 323 in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter() SessionManagementFilter.java line 101 in org.springframework.security.web.session.SessionManagementFilter doFilter() FilterChainProxy.java line 323 in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter() AnonymousAuthenticationFilter.java line 113 in org.springframework.security.web.authentication.AnonymousAuthenticationFilter doFilter() FilterChainProxy.java line 323 in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter() RememberMeAuthenticationFilter.java line 146 in org.springframework.security.web.authentication.rememberme.RememberMeAuthenticationFilter doFilter() FilterChainProxy.java line 323 in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter() SecurityContextHolderAwareRequestFilter.java line 54 in org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter doFilter() FilterChainProxy.java line 323 in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter() RequestCacheAwareFilter.java line 45 in org.springframework.security.web.savedrequest.RequestCacheAwareFilter doFilter() FilterChainProxy.java line 323 in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter() AbstractAuthenticationProcessingFilter.java line 182 in org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter doFilter() FilterChainProxy.java line 323 in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter() LogoutFilter.java line 105 in org.springframework.security.web.authentication.logout.LogoutFilter doFilter() FilterChainProxy.java line 323 in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter() SecurityContextPersistenceFilter.java line 87 in org.springframework.security.web.context.SecurityContextPersistenceFilter doFilter() FilterChainProxy.java line 323 in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter() ConcurrentSessionFilter.java line 125 in org.springframework.security.web.session.ConcurrentSessionFilter doFilter() FilterChainProxy.java line 323 in org.springframework.security.web.FilterChainProxy$VirtualFilterChain doFilter() FilterChainProxy.java line 173 in org.springframework.security.web.FilterChainProxy doFilter() DelegatingFilterProxy.java line 237 in org.springframework.web.filter.DelegatingFilterProxy invokeDelegate() DelegatingFilterProxy.java line 167 in org.springframework.web.filter.DelegatingFilterProxy doFilter() ServletHandler.java line 1212 in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter() CharacterEncodingFilter.java line 88 in org.springframework.web.filter.CharacterEncodingFilter doFilterInternal() OncePerRequestFilter.java line 76 in org.springframework.web.filter.OncePerRequestFilter doFilter() ServletHandler.java line 1212 in org.mortbay.jetty.servlet.ServletHandler$CachedChain doFilter() ServletHandler.java line 399 in org.mortbay.jetty.servlet.ServletHandler handle() SecurityHandler.java line 216 in org.mortbay.jetty.security.SecurityHandler handle() SessionHandler.java line 182 in org.mortbay.jetty.servlet.SessionHandler handle() SecurityHandler.java line 216 in org.mortbay.jetty.security.SecurityHandler handle() ContextHandler.java line 767 in org.mortbay.jetty.handler.ContextHandler handle() WebAppContext.java line 450 in org.mortbay.jetty.webapp.WebAppContext handle() HandlerWrapper.java line 152 in org.mortbay.jetty.handler.HandlerWrapper handle() StatisticsHandler.java line 53 in org.mortbay.jetty.handler.StatisticsHandler handle() HandlerWrapper.java line 152 in org.mortbay.jetty.handler.HandlerWrapper handle() Server.java line 326 in org.mortbay.jetty.Server handle() HttpConnection.java line 542 in org.mortbay.jetty.HttpConnection handleRequest() HttpConnection.java line 928 in org.mortbay.jetty.HttpConnection$RequestHandler headerComplete() HttpParser.java line 549 in org.mortbay.jetty.HttpParser parseNext() HttpParser.java line 212 in org.mortbay.jetty.HttpParser parseAvailable() HttpConnection.java line 404 in org.mortbay.jetty.HttpConnection handle() SelectChannelEndPoint.java line 410 in org.mortbay.io.nio.SelectChannelEndPoint run() QueuedThreadPool.java line 582 in org.mortbay.thread.QueuedThreadPool$PoolThread run()
... View more
Labels: