Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Logging of spark in CDH5.4.7 displays error. Executor's log occurs in the worker's log file??

Logging of spark in CDH5.4.7 displays error. Executor's log occurs in the worker's log file??

New Contributor
Hi, 
we add the spark(Standalone) service to our CDH cluster(CDH5.4.7), and the spark cluster works well. 
But we meet a strange situation. We can't see executor's stderr log in the web UI as well as in the file /var/run/spark/work/app-20151109162215-0000/0/stderr. Then we find that the executor's log occurs in the worker's log file /var/log/spark/spark-worker-cdhdatanode2.log:
 
2015-11-09 16:22:15,165 INFO org.apache.spark.executor.CoarseGrainedExecutorBackend: Registered signal handlers for [TERM, HUP, INT]
2015-11-09 16:22:16,873 INFO org.apache.spark.SecurityManager: Changing view acls to: spark,root
2015-11-09 16:22:16,874 INFO org.apache.spark.SecurityManager: Changing modify acls to: spark,root
2015-11-09 16:22:16,875 INFO org.apache.spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(spark, root); use
rs with modify permissions: Set(spark, root)
2015-11-09 16:22:17,308 INFO akka.event.slf4j.Slf4jLogger: Slf4jLogger started
2015-11-09 16:22:17,425 INFO Remoting: Starting remoting
2015-11-09 16:22:17,677 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://driverPropsFetcher@cdhdatanode1:44604]
2015-11-09 16:22:17,680 INFO Remoting: Remoting now listens on addresses: [akka.tcp://driverPropsFetcher@cdhdatanode1:44604]
2015-11-09 16:22:17,693 INFO org.apache.spark.util.Utils: Successfully started service 'driverPropsFetcher' on port 44604.
2015-11-09 16:22:17,951 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote daemon.
2015-11-09 16:22:17,952 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut down; proceeding with flushing remote transports.
2015-11-09 16:22:17,964 INFO org.apache.spark.SecurityManager: Changing view acls to: spark,root
2015-11-09 16:22:17,964 INFO org.apache.spark.SecurityManager: Changing modify acls to: spark,root
2015-11-09 16:22:17,964 INFO org.apache.spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(spark, root); use
rs with modify permissions: Set(spark, root)
2015-11-09 16:22:18,023 INFO Remoting: Remoting shut down
2015-11-09 16:22:18,025 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down.
2015-11-09 16:22:18,034 INFO akka.event.slf4j.Slf4jLogger: Slf4jLogger started
2015-11-09 16:22:18,045 INFO Remoting: Starting remoting
2015-11-09 16:22:18,060 INFO org.apache.spark.util.Utils: Successfully started service 'sparkExecutor' on port 40365.
2015-11-09 16:22:18,061 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkExecutor@cdhdatanode1:40365]
2015-11-09 16:22:18,061 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkExecutor@cdhdatanode1:40365]
2015-11-09 16:22:18,069 INFO org.apache.spark.util.AkkaUtils: Connecting to MapOutputTracker: akka.tcp://sparkDriver@cdhnamenode:59211/user/MapOutputTracker
2015-11-09 16:22:18,334 INFO org.apache.spark.util.AkkaUtils: Connecting to BlockManagerMaster: akka.tcp://sparkDriver@cdhnamenode:59211/user/BlockManagerMaster
2015-11-09 16:22:18,485 INFO org.apache.spark.storage.DiskBlockManager: Created local directory at /tmp/spark-18da685b-6197-444c-9478-d250f6b59f4a/spark-8bc0a086-ea65-4c4e-9
4ec-c143539591d0/spark-17299c8e-86b5-47fa-b621-f21261677efc/blockmgr-5c385183-0196-4bf6-8f69-31ea24bdfa0c
2015-11-09 16:22:18,514 INFO org.apache.spark.storage.MemoryStore: MemoryStore started with capacity 267.3 MB
2015-11-09 16:22:18,825 INFO org.apache.spark.util.AkkaUtils: Connecting to OutputCommitCoordinator: akka.tcp://sparkDriver@cdhnamenode:59211/user/OutputCommitCoordinator
2015-11-09 16:22:19,010 INFO org.apache.spark.executor.CoarseGrainedExecutorBackend: Connecting to driver: akka.tcp://sparkDriver@cdhnamenode:59211/user/CoarseGrainedScheduler
......
 
I don't know why this happens and how I can fix this. After all, it is not convenient if we can't see the executor's log in the web UI.
Any one has any suggestion? Any advice is appreciated. Thank you in advance.

 

Don't have an account?
Coming from Hortonworks? Activate your account here