Support Questions
Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Advanced Search
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

spark context is ok , but no sql context

spark context is ok , but no sql context

Labels:
priyankavijayak
New Contributor

Created ‎04-10-2016 05:31 PM 

[root@sandbox ~]# spark-shell

16/04/10 17:12:27 INFO BlockManagerMaster: Registered BlockManager                                                                                                             
16/04/10 17:12:27 INFO BlockManager: Reporting 0 blocks to the master.                                                                                                         
16/04/10 17:12:37 INFO Executor: Told to re-register on heartbeat                                                                                                              
16/04/10 17:12:37 INFO BlockManager: BlockManager re-registering with master                                                                                                   
16/04/10 17:12:37 INFO BlockManagerMaster: Trying to register BlockManager                                                                                                     
16/04/10 17:12:37 INFO BlockManagerMaster: Registered BlockManager                                                                                                             
16/04/10 17:12:37 INFO BlockManager: Reporting 0 blocks to the master.                                                                                                         
16/04/10 17:12:47 INFO Executor: Told to re-register on heartbeat                                                                                                              
16/04/10 17:12:47 INFO BlockManager: BlockManager re-registering with master                                                                                                   
16/04/10 17:12:47 INFO BlockManagerMaster: Trying to register BlockManager                                                                                                     
16/04/10 17:12:47 INFO BlockManagerMaster: Registered BlockManager                                                                                                             
16/04/10 17:12:47 INFO BlockManager: Reporting 0 blocks to the master.                                                                                                         
16/04/10 17:12:48 INFO EventLoggingListener: Logging events to hdfs:///spark-history/local-1460308035146                                                                       
16/04/10 17:12:57 INFO Executor: Told to re-register on heartbeat                                                                                                              
16/04/10 17:12:57 INFO BlockManager: BlockManager re-registering with master                                                                                                   
16/04/10 17:12:57 INFO BlockManagerMaster: Trying to register BlockManager                                                                                                     
16/04/10 17:12:57 INFO BlockManagerMaster: Registered BlockManager                                                                                                             
16/04/10 17:12:57 INFO BlockManager: Reporting 0 blocks to the master.                                                                                                         
16/04/10 17:13:02 INFO SparkILoop: Created spark context..                                                                                                                     
Spark context available as sc.                                                                                                                                                 
16/04/10 17:18:12 INFO DFSClient: Exception in createBlockOutputStream                                                                                                         
java.io.EOFException: Premature EOF: no length prefix available                                                                                                                
        at org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:2293)                                                                                         
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1380)                                                              
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1299)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:18:15 INFO DFSClient: Abandoning BP-1014530610-10.0.2.15-1456769265896:blk_1073742495_1702                                                                         
16/04/10 17:20:25 INFO DFSClient: Excluding datanode DatanodeInfoWithStorage[10.0.2.15:50010,DS-c63e2550-a18a-4035-8bb3-7f8f2b4dd607,DISK]                                     
16/04/10 17:21:35 WARN DFSClient: DataStreamer Exception                                                                                                                       
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minReplication (=
1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                             
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:21:37 WARN DFSClient: Error while syncing                                                                                                                          
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minReplication (=
1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                             
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:21:43 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onExecutorAdded(EventLoggingListener.scala:197)                                                                     
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:58)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:21:56 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:09 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:15 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:19 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:24 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:28 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:30 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:43 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:44 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:45 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:45 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:47 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:47 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:47 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:48 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:50 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:53 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:55 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:22:56 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:00 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:02 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:02 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:03 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:04 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:04 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:04 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:06 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:08 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:12 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:19 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:27 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)                                                                                   
16/04/10 17:23:34 ERROR LiveListenerBus: Listener EventLoggingListener threw an exception                                                                                      
java.lang.reflect.InvocationTargetException                                                                                                                                    
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)                                                                                                         
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at org.apache.spark.scheduler.EventLoggingListener$$anonfun$logEvent$3.apply(EventLoggingListener.scala:150)                                                           
        at scala.Option.foreach(Option.scala:236)                                                                                                                              
        at org.apache.spark.scheduler.EventLoggingListener.logEvent(EventLoggingListener.scala:150)                                                                            
        at org.apache.spark.scheduler.EventLoggingListener.onBlockManagerAdded(EventLoggingListener.scala:178)                                                                 
        at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:46)                                                                            
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)                                                                                    
        at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:55)                                                                                             
        at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)                                                                           
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(AsynchronousListenerBus.scala:80)                         
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1$$anonfun$apply$mcV$sp$1.apply(AsynchronousListenerBus.scala:65)                                
        at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)                                                                                                      
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:64)                                                 
        at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1180)                                                                                                
        at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)                                                                         
Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /spark-history/local-1460308035146.inprogress could only be replicated to 0 nodes instead of minRep
lication (=1).  There are 1 datanode(s) running and 1 node(s) are excluded in this operation.                                                                                  
        at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1588)                                                            
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3116)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3040)                                                                      
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addBlock(NameNodeRpcServer.java:789)                                                                       
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.addBlock(ClientNamenodeProtocolServerSideTranslatorPB.java:492)                      
        at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)                   
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)                                                                  
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)                                                                                                                 
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2151)                                                                                                        
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2147)                                                                                                        
        at java.security.AccessController.doPrivileged(Native Method)                                                                                                          
        at javax.security.auth.Subject.doAs(Subject.java:415)                                                                                                                  
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)                                                                                
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2145)                                                                                                          
                                                                                                                                                                               
        at org.apache.hadoop.ipc.Client.call(Client.java:1427)                                                                                                                 
        at org.apache.hadoop.ipc.Client.call(Client.java:1358)                                                                                                                 
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)                                                                                  
        at com.sun.proxy.$Proxy14.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.addBlock(ClientNamenodeProtocolTranslatorPB.java:418)                                          
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                                         
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)                                                                                       
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                                               
        at java.lang.reflect.Method.invoke(Method.java:606)                                                                                                                    
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:252)                                                                     
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104)                                                                           
        at com.sun.proxy.$Proxy15.addBlock(Unknown Source)                                                                                                                     
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.locateFollowingBlock(DFSOutputStream.java:1493)                                                                 
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1288)                                                                
        at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:464)

getting error above

how to get rid of this error

Reply
948 Views
0 Kudos
4 REPLIES 4

Re: spark context is ok , but no sql context

jyadav
Guru

Created ‎04-11-2016 09:40 AM

Looks like your cluster is not stable, Are you able to run other tools like hive or pig query? Also can you please check whether you are able to perform normal hdfs operation like put or get file under /spark-history/ location?.

Check namenode and datanodes logs for more information, if possible then restart all hadoop services and run spark shell again.

Reply
136 Views

Re: spark context is ok , but no sql context

priyankavijayak
New Contributor

Created ‎04-12-2016 02:16 PM

@Jitendra Yadav

yes your right. when i run above command , i see some error in cluster of ambari dashboard .

Also , when i try to get files using hadoop fs command , no response or still running.

any commands to restart hadoop services ? am using hdp 2.4 sandbox.

Reply
136 Views
0 Kudos

Re: spark context is ok , but no sql context

jyadav
Guru

Created ‎04-12-2016 04:54 PM

@priyanka vijayakumar

1. Try restarting All services from Amabri UI first.

OR

2. You can use stop.sh and start.sh scripts from below directory on your sandbox.

cd /usr/lib/hue/tools/start_scripts

Bash#./stop.sh

Bash#./start.sh

Reply
136 Views
0 Kudos

Re: spark context is ok , but no sql context

priyankavijayak
New Contributor

Created on ‎04-15-2016 07:08 PM - edited ‎08-18-2019 04:24 AM

cluster problem is solved.

now , spark context obtained .but, it is taking too much time to connect to hive metastore ,runs exception and then continues to connect and goes on...

below attached snapshots

3475-eof1.jpg

3476-eof2.jpg

Reply
136 Views
0 Kudos
Don't have an account?
Register
Coming from Hortonworks? Activate your account here