SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/hadoopdisk/hadoop/yarn/local/filecache/36/spark2-hdp-yarn-archive.tar.gz/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/2.5.3.0-37/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 16/12/27 06:21:34 INFO SignalUtils: Registered signal handler for TERM 16/12/27 06:21:34 INFO SignalUtils: Registered signal handler for HUP 16/12/27 06:21:34 INFO SignalUtils: Registered signal handler for INT 16/12/27 06:21:35 INFO ApplicationMaster: Preparing Local resources 16/12/27 06:21:37 INFO ApplicationMaster: Prepared Local resources Map(ojdbc6.jar -> resource { scheme: "hdfs" host: "hdpCluster1" port: -1 file: "/user/root/.sparkStaging/application_1482810683736_0015/ojdbc6.jar" } size: 2739670 timestamp: 1482819686408 type: FILE visibility: PRIVATE, __app__.jar -> resource { scheme: "hdfs" host: "hdpCluster1" port: -1 file: "/user/root/.sparkStaging/application_1482810683736_0015/dst-svc-reporting-assembly-0.0.1-SNAPSHOT.jar" } size: 2522187 timestamp: 1482819685397 type: FILE visibility: PRIVATE, dst-svc-reporting-assembly-0.0.1-SNAPSHOT-deps.jar -> resource { scheme: "hdfs" host: "hdpCluster1" port: -1 file: "/user/root/.sparkStaging/application_1482810683736_0015/dst-svc-reporting-assembly-0.0.1-SNAPSHOT-deps.jar" } size: 72511318 timestamp: 1482819686243 type: FILE visibility: PRIVATE, __spark_libs__ -> resource { scheme: "hdfs" host: "hdpCluster1" port: -1 file: "/hdp/apps/2.5.3.0-37/spark2/spark2-hdp-yarn-archive.tar.gz" } size: 175955588 timestamp: 1481554356542 type: ARCHIVE visibility: PUBLIC, sqljdbc4.jar -> resource { scheme: "hdfs" host: "hdpCluster1" port: -1 file: "/user/root/.sparkStaging/application_1482810683736_0015/sqljdbc4.jar" } size: 585020 timestamp: 1482819686512 type: FILE visibility: PRIVATE, __spark_conf__ -> resource { scheme: "hdfs" host: "hdpCluster1" port: -1 file: "/user/root/.sparkStaging/application_1482810683736_0015/__spark_conf__.zip" } size: 121668 timestamp: 1482819686669 type: ARCHIVE visibility: PRIVATE) 16/12/27 06:21:37 INFO ApplicationMaster: ApplicationAttemptId: appattempt_1482810683736_0015_000001 16/12/27 06:21:37 INFO SecurityManager: Changing view acls to: yarn,root 16/12/27 06:21:37 INFO SecurityManager: Changing modify acls to: yarn,root 16/12/27 06:21:37 INFO SecurityManager: Changing view acls groups to: 16/12/27 06:21:37 INFO SecurityManager: Changing modify acls groups to: 16/12/27 06:21:37 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, root); groups with view permissions: Set(); users with modify permissions: Set(yarn, root); groups with modify permissions: Set() 16/12/27 06:21:37 INFO ApplicationMaster: Starting the user application in a separate Thread 16/12/27 06:21:37 INFO ApplicationMaster: Waiting for spark context initialization 16/12/27 06:21:37 INFO ApplicationMaster: Waiting for spark context initialization ... 16/12/27 06:21:37 INFO SparkContext: Running Spark version 2.0.0.2.5.3.0-37 16/12/27 06:21:37 INFO SecurityManager: Changing view acls to: yarn,root 16/12/27 06:21:37 INFO SecurityManager: Changing modify acls to: yarn,root 16/12/27 06:21:37 INFO SecurityManager: Changing view acls groups to: 16/12/27 06:21:37 INFO SecurityManager: Changing modify acls groups to: 16/12/27 06:21:37 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, root); groups with view permissions: Set(); users with modify permissions: Set(yarn, root); groups with modify permissions: Set() 16/12/27 06:21:37 INFO Utils: Successfully started service 'sparkDriver' on port 1466. 16/12/27 06:21:37 INFO SparkEnv: Registering MapOutputTracker 16/12/27 06:21:37 INFO SparkEnv: Registering BlockManagerMaster 16/12/27 06:21:37 INFO DiskBlockManager: Created local directory at /hadoopdisk/hadoop/yarn/local/usercache/root/appcache/application_1482810683736_0015/blockmgr-2dbd1d73-89cd-456f-87ce-f1fc364ebf2f 16/12/27 06:21:37 INFO MemoryStore: MemoryStore started with capacity 912.3 MB 16/12/27 06:21:38 INFO SparkEnv: Registering OutputCommitCoordinator 16/12/27 06:21:38 INFO log: Logging initialized @5194ms 16/12/27 06:21:38 INFO JettyUtils: Adding filter: org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter 16/12/27 06:21:38 INFO Server: jetty-9.2.z-SNAPSHOT 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@606f3ba5{/jobs,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@7f473b11{/jobs/json,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@a34f918{/jobs/job,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@6f414f67{/jobs/job/json,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@76eaf339{/stages,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@30b3c146{/stages/json,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@1d620271{/stages/stage,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@78bd4ccd{/stages/stage/json,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@596f1bd8{/stages/pool,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@77785842{/stages/pool/json,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@7a04bd56{/storage,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@68cd5dff{/storage/json,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@495d2ae5{/storage/rdd,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@7cd2c1c4{/storage/rdd/json,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@23e33d05{/environment,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@2143be23{/environment/json,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@169a2ec{/executors,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@6bdf8fe4{/executors/json,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@51ee8c8f{/executors/threadDump,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@6de08237{/executors/threadDump/json,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@215233a5{/static,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@36e528c4{/,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@13ca4063{/api,null,AVAILABLE} 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@7a528917{/stages/stage/kill,null,AVAILABLE} 16/12/27 06:21:38 INFO ServerConnector: Started ServerConnector@3a942b95{HTTP/1.1}{0.0.0.0:7824} 16/12/27 06:21:38 INFO Server: Started @5401ms 16/12/27 06:21:38 INFO Utils: Successfully started service 'SparkUI' on port 7824. 16/12/27 06:21:38 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://10.131.137.96:7824 16/12/27 06:21:38 INFO YarnClusterScheduler: Created YarnClusterScheduler 16/12/27 06:21:38 INFO SchedulerExtensionServices: Starting Yarn extension services with app application_1482810683736_0015 and attemptId Some(appattempt_1482810683736_0015_000001) 16/12/27 06:21:38 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 43778. 16/12/27 06:21:38 INFO NettyBlockTransferService: Server created on 10.131.137.96:43778 16/12/27 06:21:38 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 10.131.137.96, 43778) 16/12/27 06:21:38 INFO BlockManagerMasterEndpoint: Registering block manager 10.131.137.96:43778 with 912.3 MB RAM, BlockManagerId(driver, 10.131.137.96, 43778) 16/12/27 06:21:38 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 10.131.137.96, 43778) 16/12/27 06:21:38 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@77a8fd6f{/metrics/json,null,AVAILABLE} 16/12/27 06:21:39 INFO EventLoggingListener: Logging events to hdfs:///spark2-history/application_1482810683736_0015_1 16/12/27 06:21:39 INFO YarnSchedulerBackend$YarnSchedulerEndpoint: ApplicationMaster registered as NettyRpcEndpointRef(spark://YarnAM@10.131.137.96:1466) 16/12/27 06:21:39 INFO RMProxy: Connecting to ResourceManager at kvs-in-merlin04.int.kronos.com/10.131.138.27:8030 16/12/27 06:21:39 INFO YarnRMClient: Registering the ApplicationMaster 16/12/27 06:21:39 INFO YarnAllocator: Will request 2 executor containers, each with 6 cores and 6758 MB memory including 614 MB overhead 16/12/27 06:21:39 INFO YarnAllocator: Canceled 0 container requests (locality no longer needed) 16/12/27 06:21:39 INFO YarnAllocator: Submitted container request (host: Any, capability: ) 16/12/27 06:21:39 INFO YarnAllocator: Submitted container request (host: Any, capability: ) 16/12/27 06:21:39 INFO ApplicationMaster: Started progress reporter thread with (heartbeat : 3000, initial allocation : 200) intervals 16/12/27 06:21:40 INFO AMRMClientImpl: Received new token for : kvs-in-merlin11.int.kronos.com:45454 16/12/27 06:21:40 INFO YarnAllocator: Launching container container_e89_1482810683736_0015_01_000004 for on host kvs-in-merlin11.int.kronos.com 16/12/27 06:21:40 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: spark://CoarseGrainedScheduler@10.131.137.96:1466, executorHostname: kvs-in-merlin11.int.kronos.com 16/12/27 06:21:40 INFO YarnAllocator: Received 1 containers from YARN, launching executors on 1 of them. 16/12/27 06:21:40 INFO ExecutorRunnable: Starting Executor Container 16/12/27 06:21:40 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 16/12/27 06:21:40 INFO ExecutorRunnable: Setting up ContainerLaunchContext 16/12/27 06:21:40 INFO ExecutorRunnable: =============================================================================== YARN executor launch context: env: CLASSPATH -> {{PWD}}{{PWD}}/__spark_conf__{{PWD}}/__spark_libs__/*$HADOOP_CONF_DIR/usr/hdp/current/hadoop-client/*/usr/hdp/current/hadoop-client/lib/*/usr/hdp/current/hadoop-hdfs-client/*/usr/hdp/current/hadoop-hdfs-client/lib/*/usr/hdp/current/hadoop-yarn-client/*/usr/hdp/current/hadoop-yarn-client/lib/*$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.5.3.0-37/hadoop/lib/hadoop-lzo-0.6.0.2.5.3.0-37.jar:/etc/hadoop/conf/secure SPARK_LOG_URL_STDERR -> http://kvs-in-merlin11.int.kronos.com:8042/node/containerlogs/container_e89_1482810683736_0015_01_000004/root/stderr?start=-4096 SPARK_YARN_STAGING_DIR -> hdfs://hdpCluster1/user/root/.sparkStaging/application_1482810683736_0015 SPARK_USER -> root SPARK_YARN_MODE -> true SPARK_LOG_URL_STDOUT -> http://kvs-in-merlin11.int.kronos.com:8042/node/containerlogs/container_e89_1482810683736_0015_01_000004/root/stdout?start=-4096 command: LD_LIBRARY_PATH="/usr/hdp/current/hadoop-client/lib/native:/usr/hdp/current/hadoop-client/lib/native/Linux-amd64-64:$LD_LIBRARY_PATH" {{JAVA_HOME}}/bin/java -server -Xmx6144m '-Duser.timezone=UTC' -Djava.io.tmpdir={{PWD}}/tmp '-Dspark.history.ui.port=18081' '-Dspark.driver.port=1466' '-Dspark.ui.port=0' -Dspark.yarn.app.container.log.dir= -XX:OnOutOfMemoryError='kill %p' org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url spark://CoarseGrainedScheduler@10.131.137.96:1466 --executor-id 1 --hostname kvs-in-merlin11.int.kronos.com --cores 6 --app-id application_1482810683736_0015 --user-class-path file:$PWD/__app__.jar --user-class-path file:$PWD/dst-svc-reporting-assembly-0.0.1-SNAPSHOT-deps.jar --user-class-path file:$PWD/ojdbc6.jar --user-class-path file:$PWD/sqljdbc4.jar 1> /stdout 2> /stderr =============================================================================== 16/12/27 06:21:40 INFO ContainerManagementProtocolProxy: Opening proxy : kvs-in-merlin11.int.kronos.com:45454 16/12/27 06:21:40 INFO AMRMClientImpl: Received new token for : kvs-in-merlin12.int.kronos.com:45454 16/12/27 06:21:41 INFO YarnAllocator: Launching container container_e89_1482810683736_0015_01_000005 for on host kvs-in-merlin12.int.kronos.com 16/12/27 06:21:41 INFO YarnAllocator: Launching ExecutorRunnable. driverUrl: spark://CoarseGrainedScheduler@10.131.137.96:1466, executorHostname: kvs-in-merlin12.int.kronos.com 16/12/27 06:21:41 INFO YarnAllocator: Received 1 containers from YARN, launching executors on 1 of them. 16/12/27 06:21:41 INFO ExecutorRunnable: Starting Executor Container 16/12/27 06:21:41 INFO ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0 16/12/27 06:21:41 INFO ExecutorRunnable: Setting up ContainerLaunchContext 16/12/27 06:21:41 INFO ExecutorRunnable: =============================================================================== YARN executor launch context: env: CLASSPATH -> {{PWD}}{{PWD}}/__spark_conf__{{PWD}}/__spark_libs__/*$HADOOP_CONF_DIR/usr/hdp/current/hadoop-client/*/usr/hdp/current/hadoop-client/lib/*/usr/hdp/current/hadoop-hdfs-client/*/usr/hdp/current/hadoop-hdfs-client/lib/*/usr/hdp/current/hadoop-yarn-client/*/usr/hdp/current/hadoop-yarn-client/lib/*$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/2.5.3.0-37/hadoop/lib/hadoop-lzo-0.6.0.2.5.3.0-37.jar:/etc/hadoop/conf/secure SPARK_LOG_URL_STDERR -> http://kvs-in-merlin12.int.kronos.com:8042/node/containerlogs/container_e89_1482810683736_0015_01_000005/root/stderr?start=-4096 SPARK_YARN_STAGING_DIR -> hdfs://hdpCluster1/user/root/.sparkStaging/application_1482810683736_0015 SPARK_USER -> root SPARK_YARN_MODE -> true SPARK_LOG_URL_STDOUT -> http://kvs-in-merlin12.int.kronos.com:8042/node/containerlogs/container_e89_1482810683736_0015_01_000005/root/stdout?start=-4096 command: LD_LIBRARY_PATH="/usr/hdp/current/hadoop-client/lib/native:/usr/hdp/current/hadoop-client/lib/native/Linux-amd64-64:$LD_LIBRARY_PATH" {{JAVA_HOME}}/bin/java -server -Xmx6144m '-Duser.timezone=UTC' -Djava.io.tmpdir={{PWD}}/tmp '-Dspark.history.ui.port=18081' '-Dspark.driver.port=1466' '-Dspark.ui.port=0' -Dspark.yarn.app.container.log.dir= -XX:OnOutOfMemoryError='kill %p' org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url spark://CoarseGrainedScheduler@10.131.137.96:1466 --executor-id 2 --hostname kvs-in-merlin12.int.kronos.com --cores 6 --app-id application_1482810683736_0015 --user-class-path file:$PWD/__app__.jar --user-class-path file:$PWD/dst-svc-reporting-assembly-0.0.1-SNAPSHOT-deps.jar --user-class-path file:$PWD/ojdbc6.jar --user-class-path file:$PWD/sqljdbc4.jar 1> /stdout 2> /stderr =============================================================================== 16/12/27 06:21:41 INFO ContainerManagementProtocolProxy: Opening proxy : kvs-in-merlin12.int.kronos.com:45454 16/12/27 06:21:47 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(null) (10.131.137.78:53067) with ID 1 16/12/27 06:21:47 INFO BlockManagerMasterEndpoint: Registering block manager kvs-in-merlin11.int.kronos.com:33426 with 3.0 GB RAM, BlockManagerId(1, kvs-in-merlin11.int.kronos.com, 33426) 16/12/27 06:21:48 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(null) (10.131.137.77:25722) with ID 2 16/12/27 06:21:48 INFO YarnClusterSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.8 16/12/27 06:21:48 INFO YarnClusterScheduler: YarnClusterScheduler.postStartHook done 16/12/27 06:21:48 WARN SparkContext: Use an existing SparkContext, some configuration may not take effect. 16/12/27 06:21:48 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@6f4cefbd{/SQL,null,AVAILABLE} 16/12/27 06:21:48 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@72c71c9{/SQL/json,null,AVAILABLE} 16/12/27 06:21:48 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@8e5a713{/SQL/execution,null,AVAILABLE} 16/12/27 06:21:48 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@de614fa{/SQL/execution/json,null,AVAILABLE} 16/12/27 06:21:48 INFO ContextHandler: Started o.s.j.s.ServletContextHandler@434629f2{/static/sql,null,AVAILABLE} 16/12/27 06:21:48 INFO HiveSharedState: Warehouse path is 'file:/hadoopdisk/hadoop/yarn/local/usercache/root/appcache/application_1482810683736_0015/container_e89_1482810683736_0015_01_000001/spark-warehouse'. [Args] log.level=INFO [Args] tenants.keyspace=dst [Args] tenants.table=tenants [Args] tenants.cassandra.host=None 16/12/27 06:21:48 INFO BlockManagerMasterEndpoint: Registering block manager kvs-in-merlin12.int.kronos.com:19820 with 3.0 GB RAM, BlockManagerId(2, kvs-in-merlin12.int.kronos.com, 19820) [Args] job.type=Some(pipeline) [Args] job.type=pipeline [Args] jdbc.throttle=Some(15) [Args] pipeline.json=None [Args] date.start=Some(2013-02-01) [Args] date.start=2013-02-01 [Args] date.end=Some(2016-05-01) [Args] date.end=2016-05-01 [Args] labor.level=Some(4) [Args] labor.level=4 [Args] jdbc.type=Some(tenant) [Args] jdbc.tenant=Some(10013) [Args] jdbc.tenant=10013 [Args] output.type=Some(console) [Args] pipeline=Some(usagemon) [Args] pipeline=usagemon [Args] jdbc.cache.dir=Some(hdfs://sandbox.hortonworks.com:8020/etl) 16/12/27 06:21:49 INFO NettyUtil: Found Netty's native epoll transport in the classpath, using it 16/12/27 06:21:51 INFO Cluster: New Cassandra host catalyst-1.int.kronos.com/10.48.176.40:9042 added 16/12/27 06:21:51 INFO Cluster: New Cassandra host catalyst-2.int.kronos.com/10.48.176.41:9042 added 16/12/27 06:21:51 INFO Cluster: New Cassandra host catalyst-3.int.kronos.com/10.48.176.42:9042 added 16/12/27 06:21:51 INFO CassandraConnector: Connected to Cassandra cluster: catalyst [Args] jdbc.throttle=Some(15) 16/12/27 06:21:57 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:21:59 INFO CassandraConnector: Disconnected from Cassandra cluster: catalyst 16/12/27 06:22:01 INFO HiveUtils: Initializing HiveMetastoreConnection version 1.2.1 using Spark classes. 16/12/27 06:22:02 INFO HiveMetaStore: 0: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 16/12/27 06:22:02 INFO ObjectStore: ObjectStore, initialize called 16/12/27 06:22:03 INFO Persistence: Property hive.metastore.integral.jdo.pushdown unknown - will be ignored 16/12/27 06:22:03 INFO Persistence: Property datanucleus.cache.level2 unknown - will be ignored 16/12/27 06:22:05 INFO ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order" 16/12/27 06:22:07 INFO Datastore: The class "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as "embedded-only" so does not have its own datastore table. 16/12/27 06:22:07 INFO Datastore: The class "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as "embedded-only" so does not have its own datastore table. 16/12/27 06:22:09 INFO Datastore: The class "org.apache.hadoop.hive.metastore.model.MFieldSchema" is tagged as "embedded-only" so does not have its own datastore table. 16/12/27 06:22:09 INFO Datastore: The class "org.apache.hadoop.hive.metastore.model.MOrder" is tagged as "embedded-only" so does not have its own datastore table. 16/12/27 06:22:10 INFO MetaStoreDirectSql: Using direct SQL, underlying DB is DERBY 16/12/27 06:22:10 INFO ObjectStore: Initialized ObjectStore 16/12/27 06:22:10 WARN ObjectStore: Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 1.2.0 16/12/27 06:22:10 WARN ObjectStore: Failed to get database default, returning NoSuchObjectException 16/12/27 06:22:10 INFO HiveMetaStore: Added admin role in metastore 16/12/27 06:22:10 INFO HiveMetaStore: Added public role in metastore 16/12/27 06:22:11 INFO HiveMetaStore: No user is added in admin role, since config is empty 16/12/27 06:22:11 INFO HiveMetaStore: 0: get_all_databases 16/12/27 06:22:11 INFO audit: ugi=root ip=unknown-ip-addr cmd=get_all_databases 16/12/27 06:22:11 INFO HiveMetaStore: 0: get_functions: db=default pat=* 16/12/27 06:22:11 INFO audit: ugi=root ip=unknown-ip-addr cmd=get_functions: db=default pat=* 16/12/27 06:22:11 INFO Datastore: The class "org.apache.hadoop.hive.metastore.model.MResourceUri" is tagged as "embedded-only" so does not have its own datastore table. 16/12/27 06:22:11 INFO SessionState: Created local directory: /hadoopdisk/hadoop/yarn/local/usercache/root/appcache/application_1482810683736_0015/container_e89_1482810683736_0015_01_000001/tmp/yarn 16/12/27 06:22:11 INFO SessionState: Created local directory: /hadoopdisk/hadoop/yarn/local/usercache/root/appcache/application_1482810683736_0015/container_e89_1482810683736_0015_01_000001/tmp/9a8ddc54-b4aa-44c7-9173-5a118f82ac5c_resources 16/12/27 06:22:11 INFO SessionState: Created HDFS directory: /tmp/hive/root/9a8ddc54-b4aa-44c7-9173-5a118f82ac5c 16/12/27 06:22:11 INFO SessionState: Created local directory: /hadoopdisk/hadoop/yarn/local/usercache/root/appcache/application_1482810683736_0015/container_e89_1482810683736_0015_01_000001/tmp/yarn/9a8ddc54-b4aa-44c7-9173-5a118f82ac5c 16/12/27 06:22:11 INFO SessionState: Created HDFS directory: /tmp/hive/root/9a8ddc54-b4aa-44c7-9173-5a118f82ac5c/_tmp_space.db 16/12/27 06:22:11 INFO HiveClientImpl: Warehouse location for Hive client (version 1.2.1) is file:/hadoopdisk/hadoop/yarn/local/usercache/root/appcache/application_1482810683736_0015/container_e89_1482810683736_0015_01_000001/spark-warehouse 16/12/27 06:22:11 INFO SessionState: Created local directory: /hadoopdisk/hadoop/yarn/local/usercache/root/appcache/application_1482810683736_0015/container_e89_1482810683736_0015_01_000001/tmp/afe03a84-2a59-4edd-bf75-690649fb3fa7_resources 16/12/27 06:22:11 INFO SessionState: Created HDFS directory: /tmp/hive/root/afe03a84-2a59-4edd-bf75-690649fb3fa7 16/12/27 06:22:11 INFO SessionState: Created local directory: /hadoopdisk/hadoop/yarn/local/usercache/root/appcache/application_1482810683736_0015/container_e89_1482810683736_0015_01_000001/tmp/yarn/afe03a84-2a59-4edd-bf75-690649fb3fa7 16/12/27 06:22:11 INFO SessionState: Created HDFS directory: /tmp/hive/root/afe03a84-2a59-4edd-bf75-690649fb3fa7/_tmp_space.db 16/12/27 06:22:11 INFO HiveClientImpl: Warehouse location for Hive client (version 1.2.1) is file:/hadoopdisk/hadoop/yarn/local/usercache/root/appcache/application_1482810683736_0015/container_e89_1482810683736_0015_01_000001/spark-warehouse 16/12/27 06:22:12 INFO HiveMetaStore: 0: create_database: Database(name:default, description:default database, locationUri:file:/hadoopdisk/hadoop/yarn/local/usercache/root/appcache/application_1482810683736_0015/container_e89_1482810683736_0015_01_000001/spark-warehouse, parameters:{}) 16/12/27 06:22:12 INFO audit: ugi=root ip=unknown-ip-addr cmd=create_database: Database(name:default, description:default database, locationUri:file:/hadoopdisk/hadoop/yarn/local/usercache/root/appcache/application_1482810683736_0015/container_e89_1482810683736_0015_01_000001/spark-warehouse, parameters:{}) 16/12/27 06:22:12 ERROR RetryingHMSHandler: AlreadyExistsException(message:Database default already exists) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_database(HiveMetaStore.java:891) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107) at com.sun.proxy.$Proxy28.create_database(Unknown Source) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createDatabase(HiveMetaStoreClient.java:644) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy29.createDatabase(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.createDatabase(Hive.java:306) at org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$createDatabase$1.apply$mcV$sp(HiveClientImpl.scala:309) at org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$createDatabase$1.apply(HiveClientImpl.scala:309) at org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$createDatabase$1.apply(HiveClientImpl.scala:309) at org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$withHiveState$1.apply(HiveClientImpl.scala:280) at org.apache.spark.sql.hive.client.HiveClientImpl.liftedTree1$1(HiveClientImpl.scala:227) at org.apache.spark.sql.hive.client.HiveClientImpl.retryLocked(HiveClientImpl.scala:226) at org.apache.spark.sql.hive.client.HiveClientImpl.withHiveState(HiveClientImpl.scala:269) at org.apache.spark.sql.hive.client.HiveClientImpl.createDatabase(HiveClientImpl.scala:308) at org.apache.spark.sql.hive.HiveExternalCatalog$$anonfun$createDatabase$1.apply$mcV$sp(HiveExternalCatalog.scala:99) at org.apache.spark.sql.hive.HiveExternalCatalog$$anonfun$createDatabase$1.apply(HiveExternalCatalog.scala:99) at org.apache.spark.sql.hive.HiveExternalCatalog$$anonfun$createDatabase$1.apply(HiveExternalCatalog.scala:99) at org.apache.spark.sql.hive.HiveExternalCatalog.withClient(HiveExternalCatalog.scala:72) at org.apache.spark.sql.hive.HiveExternalCatalog.createDatabase(HiveExternalCatalog.scala:98) at org.apache.spark.sql.catalyst.catalog.SessionCatalog.createDatabase(SessionCatalog.scala:147) at org.apache.spark.sql.catalyst.catalog.SessionCatalog.(SessionCatalog.scala:89) at org.apache.spark.sql.hive.HiveSessionCatalog.(HiveSessionCatalog.scala:51) at org.apache.spark.sql.hive.HiveSessionState.catalog$lzycompute(HiveSessionState.scala:49) at org.apache.spark.sql.hive.HiveSessionState.catalog(HiveSessionState.scala:48) at org.apache.spark.sql.hive.HiveSessionState$$anon$1.(HiveSessionState.scala:63) at org.apache.spark.sql.hive.HiveSessionState.analyzer$lzycompute(HiveSessionState.scala:63) at org.apache.spark.sql.hive.HiveSessionState.analyzer(HiveSessionState.scala:62) at org.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:49) at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:64) at org.apache.spark.sql.SparkSession.baseRelationToDataFrame(SparkSession.scala:382) at org.apache.spark.sql.DataFrameReader.jdbc(DataFrameReader.scala:238) at org.apache.spark.sql.DataFrameReader.jdbc(DataFrameReader.scala:159) at com.kronos.research.pipeline.sources.JdbcSource$UsingColumn$$anonfun$toDF$1.apply(JdbcSource.scala:86) at com.kronos.research.pipeline.sources.JdbcSource$UsingColumn$$anonfun$toDF$1.apply(JdbcSource.scala:81) at scala.Option.getOrElse(Option.scala:121) at com.kronos.research.pipeline.sources.JdbcSource$UsingColumn.toDF(JdbcSource.scala:81) at com.kronos.research.usagemonitoring.UsageAudits.wfc_audit$lzycompute(UsageAudits.scala:11) at com.kronos.research.usagemonitoring.UsageAudits.wfc_audit(UsageAudits.scala:11) at com.kronos.research.usagemonitoring.UsageMetricsPipeline.audits_byee$lzycompute(UsageMetricsPipeline.scala:775) at com.kronos.research.usagemonitoring.UsageMetricsPipeline.audits_byee(UsageMetricsPipeline.scala:775) at com.kronos.research.usagemonitoring.UsageMetricsPipeline.signOffs_byee$lzycompute(UsageMetricsPipeline.scala:779) at com.kronos.research.usagemonitoring.UsageMetricsPipeline.signOffs_byee(UsageMetricsPipeline.scala:779) at com.kronos.research.usagemonitoring.UsageMetricsPipeline.signOffs_bypp$lzycompute(UsageMetricsPipeline.scala:798) at com.kronos.research.usagemonitoring.UsageMetricsPipeline.signOffs_bypp(UsageMetricsPipeline.scala:798) at com.kronos.research.usagemonitoring.UsageMetricsPipeline.clean_mint_bypp_byee$lzycompute(UsageMetricsPipeline.scala:1134) at com.kronos.research.usagemonitoring.UsageMetricsPipeline.clean_mint_bypp_byee(UsageMetricsPipeline.scala:1134) at com.kronos.research.usagemonitoring.UsageMetricsPipeline.persistConsole(UsageMetricsPipeline.scala:1401) at com.kronos.research.usagemonitoring.UsageMetricsPipeline.persist(UsageMetricsPipeline.scala:1333) at com.kronos.research.svc.datascience.DataScienceApp$.com$kronos$research$svc$datascience$DataScienceApp$$processPipelineJob(DataScienceApp.scala:89) at com.kronos.research.svc.datascience.DataScienceApp$$anonfun$1.apply$mcV$sp(DataScienceApp.scala:40) at com.kronos.research.svc.datascience.DataScienceApp$$anonfun$1.apply(DataScienceApp.scala:39) at com.kronos.research.svc.datascience.DataScienceApp$$anonfun$1.apply(DataScienceApp.scala:39) at com.kronos.research.utils.Profiler$.profile(Profiler.scala:18) at com.kronos.research.svc.datascience.DataScienceApp$.main(DataScienceApp.scala:38) at com.kronos.research.svc.datascience.DataScienceApp.main(DataScienceApp.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:627) 16/12/27 06:22:16 INFO CodeGenerator: Code generated in 348.904752 ms 16/12/27 06:22:16 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:22:16 INFO DAGScheduler: Got job 0 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:22:16 INFO DAGScheduler: Final stage: ResultStage 0 (collect at JdbcSource.scala:92) 16/12/27 06:22:16 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:22:16 INFO DAGScheduler: Missing parents: List() 16/12/27 06:22:16 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[2] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:22:16 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 14.3 KB, free 912.3 MB) 16/12/27 06:22:16 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 5.9 KB, free 912.3 MB) 16/12/27 06:22:16 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 912.3 MB) 16/12/27 06:22:16 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:1012 16/12/27 06:22:16 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 0 (MapPartitionsRDD[2] at collect at JdbcSource.scala:92) 16/12/27 06:22:16 INFO YarnClusterScheduler: Adding task set 0.0 with 1 tasks 16/12/27 06:22:16 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5239 bytes) 16/12/27 06:22:16 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 0 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:16 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:22:22 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 6061 ms on kvs-in-merlin11.int.kronos.com (1/1) 16/12/27 06:22:22 INFO YarnClusterScheduler: Removed TaskSet 0.0, whose tasks have all completed, from pool 16/12/27 06:22:22 INFO DAGScheduler: ResultStage 0 (collect at JdbcSource.scala:92) finished in 6.081 s 16/12/27 06:22:22 INFO DAGScheduler: Job 0 finished: collect at JdbcSource.scala:92, took 6.298908 s 16/12/27 06:22:22 INFO CodeGenerator: Code generated in 31.187666 ms 16/12/27 06:22:25 INFO CodeGenerator: Code generated in 64.87462 ms 16/12/27 06:22:25 INFO InMemoryTableScanExec: Predicate ((WFCAUDITTYPEID#24 = 5) || (WFCAUDITTYPEID#24 = 6)) generates partition filter: (((WFCAUDITTYPEID.lowerBound#101 <= 5) && (5 <= WFCAUDITTYPEID.upperBound#100)) || ((WFCAUDITTYPEID.lowerBound#101 <= 6) && (6 <= WFCAUDITTYPEID.upperBound#100))) 16/12/27 06:22:26 INFO CodeGenerator: Code generated in 70.670883 ms 16/12/27 06:22:26 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:22:28 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:22:28 INFO DAGScheduler: Got job 1 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:22:28 INFO DAGScheduler: Final stage: ResultStage 1 (collect at JdbcSource.scala:92) 16/12/27 06:22:28 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:22:28 INFO DAGScheduler: Missing parents: List() 16/12/27 06:22:28 INFO DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[13] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:22:28 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 14.3 KB, free 912.3 MB) 16/12/27 06:22:28 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 5.9 KB, free 912.3 MB) 16/12/27 06:22:28 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 912.3 MB) 16/12/27 06:22:28 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1012 16/12/27 06:22:28 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 1 (MapPartitionsRDD[13] at collect at JdbcSource.scala:92) 16/12/27 06:22:28 INFO YarnClusterScheduler: Adding task set 1.0 with 1 tasks 16/12/27 06:22:28 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5240 bytes) 16/12/27 06:22:28 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 1 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:29 INFO ContextCleaner: Cleaned accumulator 0 16/12/27 06:22:29 INFO ContextCleaner: Cleaned accumulator 1 16/12/27 06:22:29 INFO BlockManagerInfo: Removed broadcast_0_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 912.3 MB) 16/12/27 06:22:29 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:22:29 INFO BlockManagerInfo: Removed broadcast_0_piece0 on kvs-in-merlin11.int.kronos.com:33426 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:22:29 INFO ContextCleaner: Cleaned accumulator 46 16/12/27 06:22:29 INFO ContextCleaner: Cleaned accumulator 47 16/12/27 06:22:34 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 5273 ms on kvs-in-merlin12.int.kronos.com (1/1) 16/12/27 06:22:34 INFO YarnClusterScheduler: Removed TaskSet 1.0, whose tasks have all completed, from pool 16/12/27 06:22:34 INFO DAGScheduler: ResultStage 1 (collect at JdbcSource.scala:92) finished in 5.275 s 16/12/27 06:22:34 INFO DAGScheduler: Job 1 finished: collect at JdbcSource.scala:92, took 5.297913 s 16/12/27 06:22:36 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:22:39 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:22:39 INFO DAGScheduler: Got job 2 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:22:39 INFO DAGScheduler: Final stage: ResultStage 2 (collect at JdbcSource.scala:92) 16/12/27 06:22:39 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:22:39 INFO DAGScheduler: Missing parents: List() 16/12/27 06:22:39 INFO DAGScheduler: Submitting ResultStage 2 (MapPartitionsRDD[16] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:22:39 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 14.3 KB, free 912.3 MB) 16/12/27 06:22:39 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 5.9 KB, free 912.3 MB) 16/12/27 06:22:39 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 912.3 MB) 16/12/27 06:22:39 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1012 16/12/27 06:22:39 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 2 (MapPartitionsRDD[16] at collect at JdbcSource.scala:92) 16/12/27 06:22:39 INFO YarnClusterScheduler: Adding task set 2.0 with 1 tasks 16/12/27 06:22:39 INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 2, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5240 bytes) 16/12/27 06:22:39 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 2 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:39 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:22:41 INFO TaskSetManager: Finished task 0.0 in stage 2.0 (TID 2) in 2530 ms on kvs-in-merlin11.int.kronos.com (1/1) 16/12/27 06:22:41 INFO YarnClusterScheduler: Removed TaskSet 2.0, whose tasks have all completed, from pool 16/12/27 06:22:41 INFO DAGScheduler: ResultStage 2 (collect at JdbcSource.scala:92) finished in 2.532 s 16/12/27 06:22:41 INFO DAGScheduler: Job 2 finished: collect at JdbcSource.scala:92, took 2.542859 s 16/12/27 06:22:44 INFO CodeGenerator: Code generated in 24.449987 ms 16/12/27 06:22:45 INFO SparkContext: Starting job: run at ThreadPoolExecutor.java:1142 16/12/27 06:22:45 INFO DAGScheduler: Registering RDD 21 (groupBy at UsageMetricsPipeline.scala:37) 16/12/27 06:22:45 INFO DAGScheduler: Got job 3 (run at ThreadPoolExecutor.java:1142) with 15 output partitions 16/12/27 06:22:45 INFO DAGScheduler: Final stage: ResultStage 4 (run at ThreadPoolExecutor.java:1142) 16/12/27 06:22:45 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 3) 16/12/27 06:22:45 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 3) 16/12/27 06:22:45 INFO DAGScheduler: Submitting ShuffleMapStage 3 (MapPartitionsRDD[21] at groupBy at UsageMetricsPipeline.scala:37), which has no missing parents 16/12/27 06:22:45 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 15.8 KB, free 912.2 MB) 16/12/27 06:22:45 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 7.5 KB, free 912.2 MB) 16/12/27 06:22:45 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on 10.131.137.96:43778 (size: 7.5 KB, free: 912.3 MB) 16/12/27 06:22:45 INFO SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:1012 16/12/27 06:22:45 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 3 (MapPartitionsRDD[21] at groupBy at UsageMetricsPipeline.scala:37) 16/12/27 06:22:45 INFO YarnClusterScheduler: Adding task set 3.0 with 15 tasks 16/12/27 06:22:45 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 3, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5254 bytes) 16/12/27 06:22:45 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 4, kvs-in-merlin12.int.kronos.com, partition 1, PROCESS_LOCAL, 5256 bytes) 16/12/27 06:22:45 INFO TaskSetManager: Starting task 2.0 in stage 3.0 (TID 5, kvs-in-merlin11.int.kronos.com, partition 2, PROCESS_LOCAL, 5257 bytes) 16/12/27 06:22:45 INFO TaskSetManager: Starting task 3.0 in stage 3.0 (TID 6, kvs-in-merlin12.int.kronos.com, partition 3, PROCESS_LOCAL, 5258 bytes) 16/12/27 06:22:45 INFO TaskSetManager: Starting task 4.0 in stage 3.0 (TID 7, kvs-in-merlin11.int.kronos.com, partition 4, PROCESS_LOCAL, 5258 bytes) 16/12/27 06:22:45 INFO TaskSetManager: Starting task 5.0 in stage 3.0 (TID 8, kvs-in-merlin12.int.kronos.com, partition 5, PROCESS_LOCAL, 5258 bytes) 16/12/27 06:22:45 INFO TaskSetManager: Starting task 6.0 in stage 3.0 (TID 9, kvs-in-merlin11.int.kronos.com, partition 6, PROCESS_LOCAL, 5258 bytes) 16/12/27 06:22:45 INFO TaskSetManager: Starting task 7.0 in stage 3.0 (TID 10, kvs-in-merlin12.int.kronos.com, partition 7, PROCESS_LOCAL, 5258 bytes) 16/12/27 06:22:45 INFO TaskSetManager: Starting task 8.0 in stage 3.0 (TID 11, kvs-in-merlin11.int.kronos.com, partition 8, PROCESS_LOCAL, 5258 bytes) 16/12/27 06:22:45 INFO TaskSetManager: Starting task 9.0 in stage 3.0 (TID 12, kvs-in-merlin12.int.kronos.com, partition 9, PROCESS_LOCAL, 5258 bytes) 16/12/27 06:22:45 INFO TaskSetManager: Starting task 10.0 in stage 3.0 (TID 13, kvs-in-merlin11.int.kronos.com, partition 10, PROCESS_LOCAL, 5258 bytes) 16/12/27 06:22:45 INFO TaskSetManager: Starting task 11.0 in stage 3.0 (TID 14, kvs-in-merlin12.int.kronos.com, partition 11, PROCESS_LOCAL, 5258 bytes) 16/12/27 06:22:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 3 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 5 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 7 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 9 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 11 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 13 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 4 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 6 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 8 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 10 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 12 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 14 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:45 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 7.5 KB, free: 3.0 GB) 16/12/27 06:22:45 INFO BlockManagerInfo: Added broadcast_3_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 7.5 KB, free: 3.0 GB) 16/12/27 06:22:48 INFO TaskSetManager: Starting task 12.0 in stage 3.0 (TID 15, kvs-in-merlin12.int.kronos.com, partition 12, PROCESS_LOCAL, 5258 bytes) 16/12/27 06:22:48 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 15 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:48 INFO TaskSetManager: Finished task 3.0 in stage 3.0 (TID 6) in 3184 ms on kvs-in-merlin12.int.kronos.com (1/15) 16/12/27 06:22:48 INFO TaskSetManager: Starting task 13.0 in stage 3.0 (TID 16, kvs-in-merlin12.int.kronos.com, partition 13, PROCESS_LOCAL, 5258 bytes) 16/12/27 06:22:48 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 16 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:48 INFO TaskSetManager: Finished task 5.0 in stage 3.0 (TID 8) in 3245 ms on kvs-in-merlin12.int.kronos.com (2/15) 16/12/27 06:22:48 INFO TaskSetManager: Starting task 14.0 in stage 3.0 (TID 17, kvs-in-merlin12.int.kronos.com, partition 14, PROCESS_LOCAL, 5233 bytes) 16/12/27 06:22:48 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 17 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:48 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 4) in 3255 ms on kvs-in-merlin12.int.kronos.com (3/15) 16/12/27 06:22:48 INFO TaskSetManager: Finished task 2.0 in stage 3.0 (TID 5) in 3420 ms on kvs-in-merlin11.int.kronos.com (4/15) 16/12/27 06:22:48 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 3) in 3594 ms on kvs-in-merlin11.int.kronos.com (5/15) 16/12/27 06:22:49 INFO TaskSetManager: Finished task 6.0 in stage 3.0 (TID 9) in 3858 ms on kvs-in-merlin11.int.kronos.com (6/15) 16/12/27 06:22:49 INFO TaskSetManager: Finished task 4.0 in stage 3.0 (TID 7) in 4114 ms on kvs-in-merlin11.int.kronos.com (7/15) 16/12/27 06:22:52 INFO TaskSetManager: Finished task 7.0 in stage 3.0 (TID 10) in 7419 ms on kvs-in-merlin12.int.kronos.com (8/15) 16/12/27 06:22:53 INFO TaskSetManager: Finished task 9.0 in stage 3.0 (TID 12) in 7845 ms on kvs-in-merlin12.int.kronos.com (9/15) 16/12/27 06:22:53 INFO TaskSetManager: Finished task 11.0 in stage 3.0 (TID 14) in 7872 ms on kvs-in-merlin12.int.kronos.com (10/15) 16/12/27 06:22:53 INFO TaskSetManager: Finished task 10.0 in stage 3.0 (TID 13) in 7973 ms on kvs-in-merlin11.int.kronos.com (11/15) 16/12/27 06:22:53 INFO TaskSetManager: Finished task 8.0 in stage 3.0 (TID 11) in 7978 ms on kvs-in-merlin11.int.kronos.com (12/15) 16/12/27 06:22:54 INFO TaskSetManager: Finished task 14.0 in stage 3.0 (TID 17) in 5892 ms on kvs-in-merlin12.int.kronos.com (13/15) 16/12/27 06:22:55 INFO TaskSetManager: Finished task 12.0 in stage 3.0 (TID 15) in 7217 ms on kvs-in-merlin12.int.kronos.com (14/15) 16/12/27 06:22:55 INFO TaskSetManager: Finished task 13.0 in stage 3.0 (TID 16) in 7233 ms on kvs-in-merlin12.int.kronos.com (15/15) 16/12/27 06:22:55 INFO YarnClusterScheduler: Removed TaskSet 3.0, whose tasks have all completed, from pool 16/12/27 06:22:55 INFO DAGScheduler: ShuffleMapStage 3 (groupBy at UsageMetricsPipeline.scala:37) finished in 10.490 s 16/12/27 06:22:55 INFO DAGScheduler: looking for newly runnable stages 16/12/27 06:22:55 INFO DAGScheduler: running: Set() 16/12/27 06:22:55 INFO DAGScheduler: waiting: Set(ResultStage 4) 16/12/27 06:22:55 INFO DAGScheduler: failed: Set() 16/12/27 06:22:55 INFO DAGScheduler: Submitting ResultStage 4 (MapPartitionsRDD[28] at run at ThreadPoolExecutor.java:1142), which has no missing parents 16/12/27 06:22:55 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 21.2 KB, free 912.2 MB) 16/12/27 06:22:55 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 9.8 KB, free 912.2 MB) 16/12/27 06:22:55 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.131.137.96:43778 (size: 9.8 KB, free: 912.3 MB) 16/12/27 06:22:55 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1012 16/12/27 06:22:55 INFO DAGScheduler: Submitting 15 missing tasks from ResultStage 4 (MapPartitionsRDD[28] at run at ThreadPoolExecutor.java:1142) 16/12/27 06:22:55 INFO YarnClusterScheduler: Adding task set 4.0 with 15 tasks 16/12/27 06:22:55 INFO TaskSetManager: Starting task 0.0 in stage 4.0 (TID 18, kvs-in-merlin11.int.kronos.com, partition 0, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:55 INFO TaskSetManager: Starting task 1.0 in stage 4.0 (TID 19, kvs-in-merlin12.int.kronos.com, partition 1, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:55 INFO TaskSetManager: Starting task 2.0 in stage 4.0 (TID 20, kvs-in-merlin11.int.kronos.com, partition 2, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:55 INFO TaskSetManager: Starting task 3.0 in stage 4.0 (TID 21, kvs-in-merlin12.int.kronos.com, partition 3, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:55 INFO TaskSetManager: Starting task 4.0 in stage 4.0 (TID 22, kvs-in-merlin11.int.kronos.com, partition 4, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:55 INFO TaskSetManager: Starting task 5.0 in stage 4.0 (TID 23, kvs-in-merlin12.int.kronos.com, partition 5, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:55 INFO TaskSetManager: Starting task 6.0 in stage 4.0 (TID 24, kvs-in-merlin11.int.kronos.com, partition 6, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:55 INFO TaskSetManager: Starting task 7.0 in stage 4.0 (TID 25, kvs-in-merlin12.int.kronos.com, partition 7, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:55 INFO TaskSetManager: Starting task 8.0 in stage 4.0 (TID 26, kvs-in-merlin11.int.kronos.com, partition 8, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:55 INFO TaskSetManager: Starting task 9.0 in stage 4.0 (TID 27, kvs-in-merlin12.int.kronos.com, partition 9, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:55 INFO TaskSetManager: Starting task 10.0 in stage 4.0 (TID 28, kvs-in-merlin11.int.kronos.com, partition 10, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:55 INFO TaskSetManager: Starting task 11.0 in stage 4.0 (TID 29, kvs-in-merlin12.int.kronos.com, partition 11, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 18 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 20 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 22 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 24 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 26 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 28 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:22:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 19 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 21 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 23 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 25 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 27 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 29 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:55 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 9.8 KB, free: 3.0 GB) 16/12/27 06:22:56 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 9.8 KB, free: 3.0 GB) 16/12/27 06:22:56 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 1 to 10.131.137.78:53067 16/12/27 06:22:56 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 1 is 342 bytes 16/12/27 06:22:56 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 1 to 10.131.137.77:25722 16/12/27 06:22:57 INFO TaskSetManager: Starting task 12.0 in stage 4.0 (TID 30, kvs-in-merlin12.int.kronos.com, partition 12, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 30 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:57 INFO TaskSetManager: Finished task 5.0 in stage 4.0 (TID 23) in 1367 ms on kvs-in-merlin12.int.kronos.com (1/15) 16/12/27 06:22:57 INFO TaskSetManager: Starting task 13.0 in stage 4.0 (TID 31, kvs-in-merlin12.int.kronos.com, partition 13, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 31 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:57 INFO TaskSetManager: Finished task 9.0 in stage 4.0 (TID 27) in 1402 ms on kvs-in-merlin12.int.kronos.com (2/15) 16/12/27 06:22:57 INFO TaskSetManager: Starting task 14.0 in stage 4.0 (TID 32, kvs-in-merlin12.int.kronos.com, partition 14, NODE_LOCAL, 5193 bytes) 16/12/27 06:22:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 32 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:22:57 INFO TaskSetManager: Finished task 3.0 in stage 4.0 (TID 21) in 1431 ms on kvs-in-merlin12.int.kronos.com (3/15) 16/12/27 06:22:57 INFO TaskSetManager: Finished task 0.0 in stage 4.0 (TID 18) in 1462 ms on kvs-in-merlin11.int.kronos.com (4/15) 16/12/27 06:22:57 INFO TaskSetManager: Finished task 10.0 in stage 4.0 (TID 28) in 1471 ms on kvs-in-merlin11.int.kronos.com (5/15) 16/12/27 06:22:57 INFO TaskSetManager: Finished task 8.0 in stage 4.0 (TID 26) in 1531 ms on kvs-in-merlin11.int.kronos.com (6/15) 16/12/27 06:22:57 INFO TaskSetManager: Finished task 4.0 in stage 4.0 (TID 22) in 1549 ms on kvs-in-merlin11.int.kronos.com (7/15) 16/12/27 06:22:57 INFO TaskSetManager: Finished task 2.0 in stage 4.0 (TID 20) in 1601 ms on kvs-in-merlin11.int.kronos.com (8/15) 16/12/27 06:22:57 INFO TaskSetManager: Finished task 6.0 in stage 4.0 (TID 24) in 1636 ms on kvs-in-merlin11.int.kronos.com (9/15) 16/12/27 06:22:57 INFO TaskSetManager: Finished task 14.0 in stage 4.0 (TID 32) in 304 ms on kvs-in-merlin12.int.kronos.com (10/15) 16/12/27 06:22:57 INFO TaskSetManager: Finished task 7.0 in stage 4.0 (TID 25) in 1784 ms on kvs-in-merlin12.int.kronos.com (11/15) 16/12/27 06:22:57 INFO TaskSetManager: Finished task 13.0 in stage 4.0 (TID 31) in 444 ms on kvs-in-merlin12.int.kronos.com (12/15) 16/12/27 06:22:57 INFO TaskSetManager: Finished task 12.0 in stage 4.0 (TID 30) in 485 ms on kvs-in-merlin12.int.kronos.com (13/15) 16/12/27 06:22:57 INFO TaskSetManager: Finished task 11.0 in stage 4.0 (TID 29) in 1988 ms on kvs-in-merlin12.int.kronos.com (14/15) 16/12/27 06:22:57 INFO TaskSetManager: Finished task 1.0 in stage 4.0 (TID 19) in 2031 ms on kvs-in-merlin12.int.kronos.com (15/15) 16/12/27 06:22:57 INFO YarnClusterScheduler: Removed TaskSet 4.0, whose tasks have all completed, from pool 16/12/27 06:22:57 INFO DAGScheduler: ResultStage 4 (run at ThreadPoolExecutor.java:1142) finished in 2.048 s 16/12/27 06:22:57 INFO DAGScheduler: Job 3 finished: run at ThreadPoolExecutor.java:1142, took 12.638563 s 16/12/27 06:22:58 INFO CodeGenerator: Code generated in 26.881586 ms 16/12/27 06:22:58 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 6.0 MB, free 906.2 MB) 16/12/27 06:22:58 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 505.3 KB, free 905.7 MB) 16/12/27 06:22:58 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.131.137.96:43778 (size: 505.3 KB, free: 911.8 MB) 16/12/27 06:22:58 INFO SparkContext: Created broadcast 5 from run at ThreadPoolExecutor.java:1142 16/12/27 06:22:58 INFO CodeGenerator: Code generated in 31.430353 ms 16/12/27 06:22:58 INFO CodeGenerator: Code generated in 19.119097 ms 16/12/27 06:22:58 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#23) generates partition filter: ((EMPLOYEEID.count#358 - EMPLOYEEID.nullCount#357) > 0) 16/12/27 06:22:58 INFO InMemoryTableScanExec: Predicate isnotnull(EVENTDTM#43) generates partition filter: ((EVENTDTM.count#363 - EVENTDTM.nullCount#362) > 0) 16/12/27 06:22:58 INFO InMemoryTableScanExec: Predicate isnotnull(PEND#281) generates partition filter: ((PEND.count#388 - PEND.nullCount#387) > 0) 16/12/27 06:22:58 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#158) generates partition filter: ((EMPLOYEEID.count#378 - EMPLOYEEID.nullCount#377) > 0) 16/12/27 06:22:58 INFO InMemoryTableScanExec: Predicate isnotnull(PSTART#280) generates partition filter: ((PSTART.count#383 - PSTART.nullCount#382) > 0) 16/12/27 06:22:59 INFO CodeGenerator: Code generated in 134.764478 ms 16/12/27 06:22:59 INFO CodeGenerator: Code generated in 26.932964 ms 16/12/27 06:22:59 INFO CodeGenerator: Code generated in 17.322202 ms 16/12/27 06:22:59 INFO CodeGenerator: Code generated in 20.95747 ms 16/12/27 06:22:59 INFO InMemoryTableScanExec: Predicate ((WFCAUDITTYPEID#24 = 1) || (WFCAUDITTYPEID#24 = 2)) generates partition filter: (((WFCAUDITTYPEID.lowerBound#443 <= 1) && (1 <= WFCAUDITTYPEID.upperBound#442)) || ((WFCAUDITTYPEID.lowerBound#443 <= 2) && (2 <= WFCAUDITTYPEID.upperBound#442))) 16/12/27 06:22:59 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#23) generates partition filter: ((EMPLOYEEID.count#529 - EMPLOYEEID.nullCount#528) > 0) 16/12/27 06:22:59 INFO InMemoryTableScanExec: Predicate isnotnull(EVENTDTM#43) generates partition filter: ((EVENTDTM.count#534 - EVENTDTM.nullCount#533) > 0) 16/12/27 06:22:59 INFO InMemoryTableScanExec: Predicate isnotnull(PEND#281) generates partition filter: ((PEND.count#559 - PEND.nullCount#558) > 0) 16/12/27 06:22:59 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#158) generates partition filter: ((EMPLOYEEID.count#549 - EMPLOYEEID.nullCount#548) > 0) 16/12/27 06:22:59 INFO InMemoryTableScanExec: Predicate isnotnull(PSTART#280) generates partition filter: ((PSTART.count#554 - PSTART.nullCount#553) > 0) 16/12/27 06:22:59 INFO InMemoryTableScanExec: Predicate ((WFCAUDITTYPEID#24 = 3) || (WFCAUDITTYPEID#24 = 4)) generates partition filter: (((WFCAUDITTYPEID.lowerBound#614 <= 3) && (3 <= WFCAUDITTYPEID.upperBound#613)) || ((WFCAUDITTYPEID.lowerBound#614 <= 4) && (4 <= WFCAUDITTYPEID.upperBound#613))) 16/12/27 06:22:59 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#23) generates partition filter: ((EMPLOYEEID.count#700 - EMPLOYEEID.nullCount#699) > 0) 16/12/27 06:22:59 INFO InMemoryTableScanExec: Predicate isnotnull(EVENTDTM#43) generates partition filter: ((EVENTDTM.count#705 - EVENTDTM.nullCount#704) > 0) 16/12/27 06:22:59 INFO InMemoryTableScanExec: Predicate isnotnull(PEND#281) generates partition filter: ((PEND.count#730 - PEND.nullCount#729) > 0) 16/12/27 06:22:59 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#158) generates partition filter: ((EMPLOYEEID.count#720 - EMPLOYEEID.nullCount#719) > 0) 16/12/27 06:22:59 INFO InMemoryTableScanExec: Predicate isnotnull(PSTART#280) generates partition filter: ((PSTART.count#725 - PSTART.nullCount#724) > 0) 16/12/27 06:23:00 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:23:02 INFO CodeGenerator: Code generated in 14.854239 ms 16/12/27 06:23:02 INFO InMemoryTableScanExec: Predicate isnotnull(PEND#281) generates partition filter: ((PEND.count#917 - PEND.nullCount#916) > 0) 16/12/27 06:23:02 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#158) generates partition filter: ((EMPLOYEEID.count#907 - EMPLOYEEID.nullCount#906) > 0) 16/12/27 06:23:02 INFO InMemoryTableScanExec: Predicate isnotnull(PSTART#280) generates partition filter: ((PSTART.count#912 - PSTART.nullCount#911) > 0) 16/12/27 06:23:02 INFO CodeGenerator: Code generated in 52.927303 ms 16/12/27 06:23:02 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:23:05 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:23:08 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:23:08 INFO DAGScheduler: Got job 4 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:23:08 INFO DAGScheduler: Final stage: ResultStage 5 (collect at JdbcSource.scala:92) 16/12/27 06:23:08 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:23:08 INFO DAGScheduler: Missing parents: List() 16/12/27 06:23:08 INFO DAGScheduler: Submitting ResultStage 5 (MapPartitionsRDD[94] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:23:08 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 14.3 KB, free 905.7 MB) 16/12/27 06:23:08 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 5.9 KB, free 905.7 MB) 16/12/27 06:23:08 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.8 MB) 16/12/27 06:23:08 INFO SparkContext: Created broadcast 6 from broadcast at DAGScheduler.scala:1012 16/12/27 06:23:08 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 5 (MapPartitionsRDD[94] at collect at JdbcSource.scala:92) 16/12/27 06:23:08 INFO YarnClusterScheduler: Adding task set 5.0 with 1 tasks 16/12/27 06:23:08 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 33, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5241 bytes) 16/12/27 06:23:08 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 33 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:23:08 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:23:12 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 33) in 3373 ms on kvs-in-merlin11.int.kronos.com (1/1) 16/12/27 06:23:12 INFO YarnClusterScheduler: Removed TaskSet 5.0, whose tasks have all completed, from pool 16/12/27 06:23:12 INFO DAGScheduler: ResultStage 5 (collect at JdbcSource.scala:92) finished in 3.375 s 16/12/27 06:23:12 INFO DAGScheduler: Job 4 finished: collect at JdbcSource.scala:92, took 3.391063 s 16/12/27 06:23:14 INFO CodeGenerator: Code generated in 15.577263 ms 16/12/27 06:23:15 INFO InMemoryTableScanExec: Predicate isnotnull(PEND#281) generates partition filter: ((PEND.count#1217 - PEND.nullCount#1216) > 0) 16/12/27 06:23:15 INFO InMemoryTableScanExec: Predicate (EMPLOYEEID#158 > 0) generates partition filter: (0 < EMPLOYEEID.upperBound#1204) 16/12/27 06:23:15 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#158) generates partition filter: ((EMPLOYEEID.count#1207 - EMPLOYEEID.nullCount#1206) > 0) 16/12/27 06:23:15 INFO InMemoryTableScanExec: Predicate isnotnull(PSTART#280) generates partition filter: ((PSTART.count#1212 - PSTART.nullCount#1211) > 0) 16/12/27 06:23:15 INFO CodeGenerator: Code generated in 83.168634 ms 16/12/27 06:23:15 INFO CodeGenerator: Code generated in 30.340143 ms 16/12/27 06:23:15 INFO CodeGenerator: Code generated in 17.998046 ms 16/12/27 06:23:15 INFO CodeGenerator: Code generated in 17.894674 ms 16/12/27 06:23:15 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:23:17 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:23:17 INFO DAGScheduler: Got job 5 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:23:17 INFO DAGScheduler: Final stage: ResultStage 6 (collect at JdbcSource.scala:92) 16/12/27 06:23:17 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:23:17 INFO DAGScheduler: Missing parents: List() 16/12/27 06:23:17 INFO DAGScheduler: Submitting ResultStage 6 (MapPartitionsRDD[124] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:23:17 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 14.3 KB, free 905.7 MB) 16/12/27 06:23:17 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 5.9 KB, free 905.7 MB) 16/12/27 06:23:17 INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.8 MB) 16/12/27 06:23:18 INFO SparkContext: Created broadcast 7 from broadcast at DAGScheduler.scala:1012 16/12/27 06:23:18 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 6 (MapPartitionsRDD[124] at collect at JdbcSource.scala:92) 16/12/27 06:23:18 INFO YarnClusterScheduler: Adding task set 6.0 with 1 tasks 16/12/27 06:23:18 INFO TaskSetManager: Starting task 0.0 in stage 6.0 (TID 34, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5241 bytes) 16/12/27 06:23:18 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 34 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:23:18 INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:23:20 INFO TaskSetManager: Finished task 0.0 in stage 6.0 (TID 34) in 2520 ms on kvs-in-merlin12.int.kronos.com (1/1) 16/12/27 06:23:20 INFO YarnClusterScheduler: Removed TaskSet 6.0, whose tasks have all completed, from pool 16/12/27 06:23:20 INFO DAGScheduler: ResultStage 6 (collect at JdbcSource.scala:92) finished in 2.522 s 16/12/27 06:23:20 INFO DAGScheduler: Job 5 finished: collect at JdbcSource.scala:92, took 2.538824 s 16/12/27 06:23:23 INFO CodeGenerator: Code generated in 20.55023 ms 16/12/27 06:23:23 INFO SparkContext: Starting job: run at ThreadPoolExecutor.java:1142 16/12/27 06:23:23 INFO DAGScheduler: Got job 6 (run at ThreadPoolExecutor.java:1142) with 15 output partitions 16/12/27 06:23:23 INFO DAGScheduler: Final stage: ResultStage 7 (run at ThreadPoolExecutor.java:1142) 16/12/27 06:23:23 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:23:23 INFO DAGScheduler: Missing parents: List() 16/12/27 06:23:23 INFO DAGScheduler: Submitting ResultStage 7 (MapPartitionsRDD[128] at run at ThreadPoolExecutor.java:1142), which has no missing parents 16/12/27 06:23:23 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 9.4 KB, free 905.7 MB) 16/12/27 06:23:23 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 4.4 KB, free 905.7 MB) 16/12/27 06:23:23 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on 10.131.137.96:43778 (size: 4.4 KB, free: 911.8 MB) 16/12/27 06:23:23 INFO SparkContext: Created broadcast 8 from broadcast at DAGScheduler.scala:1012 16/12/27 06:23:23 INFO DAGScheduler: Submitting 15 missing tasks from ResultStage 7 (MapPartitionsRDD[128] at run at ThreadPoolExecutor.java:1142) 16/12/27 06:23:23 INFO YarnClusterScheduler: Adding task set 7.0 with 15 tasks 16/12/27 06:23:23 INFO TaskSetManager: Starting task 0.0 in stage 7.0 (TID 35, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5261 bytes) 16/12/27 06:23:23 INFO TaskSetManager: Starting task 1.0 in stage 7.0 (TID 36, kvs-in-merlin11.int.kronos.com, partition 1, PROCESS_LOCAL, 5262 bytes) 16/12/27 06:23:23 INFO TaskSetManager: Starting task 2.0 in stage 7.0 (TID 37, kvs-in-merlin12.int.kronos.com, partition 2, PROCESS_LOCAL, 5262 bytes) 16/12/27 06:23:23 INFO TaskSetManager: Starting task 3.0 in stage 7.0 (TID 38, kvs-in-merlin11.int.kronos.com, partition 3, PROCESS_LOCAL, 5262 bytes) 16/12/27 06:23:23 INFO TaskSetManager: Starting task 4.0 in stage 7.0 (TID 39, kvs-in-merlin12.int.kronos.com, partition 4, PROCESS_LOCAL, 5262 bytes) 16/12/27 06:23:23 INFO TaskSetManager: Starting task 5.0 in stage 7.0 (TID 40, kvs-in-merlin11.int.kronos.com, partition 5, PROCESS_LOCAL, 5262 bytes) 16/12/27 06:23:23 INFO TaskSetManager: Starting task 6.0 in stage 7.0 (TID 41, kvs-in-merlin12.int.kronos.com, partition 6, PROCESS_LOCAL, 5262 bytes) 16/12/27 06:23:23 INFO TaskSetManager: Starting task 7.0 in stage 7.0 (TID 42, kvs-in-merlin11.int.kronos.com, partition 7, PROCESS_LOCAL, 5262 bytes) 16/12/27 06:23:23 INFO TaskSetManager: Starting task 8.0 in stage 7.0 (TID 43, kvs-in-merlin12.int.kronos.com, partition 8, PROCESS_LOCAL, 5262 bytes) 16/12/27 06:23:23 INFO TaskSetManager: Starting task 9.0 in stage 7.0 (TID 44, kvs-in-merlin11.int.kronos.com, partition 9, PROCESS_LOCAL, 5262 bytes) 16/12/27 06:23:23 INFO TaskSetManager: Starting task 10.0 in stage 7.0 (TID 45, kvs-in-merlin12.int.kronos.com, partition 10, PROCESS_LOCAL, 5263 bytes) 16/12/27 06:23:23 INFO TaskSetManager: Starting task 11.0 in stage 7.0 (TID 46, kvs-in-merlin11.int.kronos.com, partition 11, PROCESS_LOCAL, 5264 bytes) 16/12/27 06:23:23 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 35 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:23:23 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 37 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:23:23 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 39 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:23:23 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 41 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:23:23 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 43 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:23:23 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 45 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:23:23 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 36 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:23:23 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 38 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:23:23 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 40 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:23:23 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 42 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:23:23 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 44 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:23:23 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 46 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:23:23 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 4.4 KB, free: 3.0 GB) 16/12/27 06:23:23 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 4.4 KB, free: 3.0 GB) 16/12/27 06:23:25 INFO TaskSetManager: Starting task 12.0 in stage 7.0 (TID 47, kvs-in-merlin12.int.kronos.com, partition 12, PROCESS_LOCAL, 5264 bytes) 16/12/27 06:23:25 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 47 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:23:25 INFO TaskSetManager: Finished task 8.0 in stage 7.0 (TID 43) in 2558 ms on kvs-in-merlin12.int.kronos.com (1/15) 16/12/27 06:23:25 INFO TaskSetManager: Starting task 13.0 in stage 7.0 (TID 48, kvs-in-merlin12.int.kronos.com, partition 13, PROCESS_LOCAL, 5264 bytes) 16/12/27 06:23:25 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 48 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:23:25 INFO TaskSetManager: Finished task 2.0 in stage 7.0 (TID 37) in 2564 ms on kvs-in-merlin12.int.kronos.com (2/15) 16/12/27 06:23:25 INFO TaskSetManager: Starting task 14.0 in stage 7.0 (TID 49, kvs-in-merlin12.int.kronos.com, partition 14, PROCESS_LOCAL, 5242 bytes) 16/12/27 06:23:25 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 49 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:23:25 INFO TaskSetManager: Finished task 4.0 in stage 7.0 (TID 39) in 2564 ms on kvs-in-merlin12.int.kronos.com (3/15) 16/12/27 06:23:25 INFO TaskSetManager: Finished task 10.0 in stage 7.0 (TID 45) in 2562 ms on kvs-in-merlin12.int.kronos.com (4/15) 16/12/27 06:23:25 INFO TaskSetManager: Finished task 9.0 in stage 7.0 (TID 44) in 2588 ms on kvs-in-merlin11.int.kronos.com (5/15) 16/12/27 06:23:25 INFO TaskSetManager: Finished task 11.0 in stage 7.0 (TID 46) in 2593 ms on kvs-in-merlin11.int.kronos.com (6/15) 16/12/27 06:23:25 INFO TaskSetManager: Finished task 1.0 in stage 7.0 (TID 36) in 2602 ms on kvs-in-merlin11.int.kronos.com (7/15) 16/12/27 06:23:25 INFO TaskSetManager: Finished task 3.0 in stage 7.0 (TID 38) in 2601 ms on kvs-in-merlin11.int.kronos.com (8/15) 16/12/27 06:23:26 INFO TaskSetManager: Finished task 6.0 in stage 7.0 (TID 41) in 2791 ms on kvs-in-merlin12.int.kronos.com (9/15) 16/12/27 06:23:26 INFO TaskSetManager: Finished task 7.0 in stage 7.0 (TID 42) in 2822 ms on kvs-in-merlin11.int.kronos.com (10/15) 16/12/27 06:23:26 INFO TaskSetManager: Finished task 0.0 in stage 7.0 (TID 35) in 3011 ms on kvs-in-merlin12.int.kronos.com (11/15) 16/12/27 06:23:26 INFO TaskSetManager: Finished task 5.0 in stage 7.0 (TID 40) in 3037 ms on kvs-in-merlin11.int.kronos.com (12/15) 16/12/27 06:23:28 INFO TaskSetManager: Finished task 14.0 in stage 7.0 (TID 49) in 2471 ms on kvs-in-merlin12.int.kronos.com (13/15) 16/12/27 06:23:28 INFO TaskSetManager: Finished task 12.0 in stage 7.0 (TID 47) in 2479 ms on kvs-in-merlin12.int.kronos.com (14/15) 16/12/27 06:23:28 INFO TaskSetManager: Finished task 13.0 in stage 7.0 (TID 48) in 2697 ms on kvs-in-merlin12.int.kronos.com (15/15) 16/12/27 06:23:28 INFO YarnClusterScheduler: Removed TaskSet 7.0, whose tasks have all completed, from pool 16/12/27 06:23:28 INFO DAGScheduler: ResultStage 7 (run at ThreadPoolExecutor.java:1142) finished in 5.266 s 16/12/27 06:23:28 INFO DAGScheduler: Job 6 finished: run at ThreadPoolExecutor.java:1142, took 5.279765 s 16/12/27 06:23:28 INFO CodeGenerator: Code generated in 10.076312 ms 16/12/27 06:23:28 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 4.1 MB, free 901.6 MB) 16/12/27 06:23:28 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 22.7 KB, free 901.6 MB) 16/12/27 06:23:28 INFO BlockManagerInfo: Added broadcast_9_piece0 in memory on 10.131.137.96:43778 (size: 22.7 KB, free: 911.7 MB) 16/12/27 06:23:28 INFO SparkContext: Created broadcast 9 from run at ThreadPoolExecutor.java:1142 16/12/27 06:23:28 INFO CodeGenerator: Code generated in 43.637053 ms 16/12/27 06:23:28 INFO CodeGenerator: Code generated in 18.327316 ms 16/12/27 06:23:28 INFO InMemoryTableScanExec: Predicate isnotnull(EVENTDTM#954) generates partition filter: ((EVENTDTM.count#1426 - EVENTDTM.nullCount#1425) > 0) 16/12/27 06:23:28 INFO InMemoryTableScanExec: Predicate isnotnull(PEND#281) generates partition filter: ((PEND.count#1446 - PEND.nullCount#1445) > 0) 16/12/27 06:23:28 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#158) generates partition filter: ((EMPLOYEEID.count#1436 - EMPLOYEEID.nullCount#1435) > 0) 16/12/27 06:23:28 INFO InMemoryTableScanExec: Predicate isnotnull(PSTART#280) generates partition filter: ((PSTART.count#1441 - PSTART.nullCount#1440) > 0) 16/12/27 06:23:28 INFO CodeGenerator: Code generated in 76.82886 ms 16/12/27 06:23:28 INFO CodeGenerator: Code generated in 16.60513 ms 16/12/27 06:23:28 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:23:31 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:23:34 INFO CodeGenerator: Code generated in 22.82906 ms 16/12/27 06:23:34 INFO InMemoryTableScanExec: Predicate isnotnull(SHIFTASSIGNID#1541L) generates partition filter: ((SHIFTASSIGNID.count#1648 - SHIFTASSIGNID.nullCount#1647) > 0) 16/12/27 06:23:34 INFO InMemoryTableScanExec: Predicate isnotnull(PEND#281) generates partition filter: ((PEND.count#1673 - PEND.nullCount#1672) > 0) 16/12/27 06:23:34 INFO InMemoryTableScanExec: Predicate (EMPLOYEEID#158 > 0) generates partition filter: (0 < EMPLOYEEID.upperBound#1660) 16/12/27 06:23:34 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#158) generates partition filter: ((EMPLOYEEID.count#1663 - EMPLOYEEID.nullCount#1662) > 0) 16/12/27 06:23:34 INFO InMemoryTableScanExec: Predicate isnotnull(PSTART#280) generates partition filter: ((PSTART.count#1668 - PSTART.nullCount#1667) > 0) 16/12/27 06:23:34 INFO CodeGenerator: Code generated in 44.159107 ms 16/12/27 06:23:34 INFO CodeGenerator: Code generated in 24.667293 ms 16/12/27 06:23:34 INFO CodeGenerator: Code generated in 14.435154 ms 16/12/27 06:23:34 INFO CodeGenerator: Code generated in 16.27953 ms 16/12/27 06:23:34 INFO CodeGenerator: Code generated in 43.550925 ms 16/12/27 06:23:34 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:23:37 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:23:37 INFO DAGScheduler: Got job 7 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:23:37 INFO DAGScheduler: Final stage: ResultStage 8 (collect at JdbcSource.scala:92) 16/12/27 06:23:37 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:23:37 INFO DAGScheduler: Missing parents: List() 16/12/27 06:23:37 INFO DAGScheduler: Submitting ResultStage 8 (MapPartitionsRDD[179] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:23:37 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 14.3 KB, free 901.6 MB) 16/12/27 06:23:37 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.6 MB) 16/12/27 06:23:37 INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:23:37 INFO SparkContext: Created broadcast 10 from broadcast at DAGScheduler.scala:1012 16/12/27 06:23:37 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 8 (MapPartitionsRDD[179] at collect at JdbcSource.scala:92) 16/12/27 06:23:37 INFO YarnClusterScheduler: Adding task set 8.0 with 1 tasks 16/12/27 06:23:37 INFO TaskSetManager: Starting task 0.0 in stage 8.0 (TID 50, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5241 bytes) 16/12/27 06:23:37 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 50 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:23:37 INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:23:39 INFO TaskSetManager: Finished task 0.0 in stage 8.0 (TID 50) in 2543 ms on kvs-in-merlin11.int.kronos.com (1/1) 16/12/27 06:23:39 INFO YarnClusterScheduler: Removed TaskSet 8.0, whose tasks have all completed, from pool 16/12/27 06:23:39 INFO DAGScheduler: ResultStage 8 (collect at JdbcSource.scala:92) finished in 2.544 s 16/12/27 06:23:39 INFO DAGScheduler: Job 7 finished: collect at JdbcSource.scala:92, took 2.556879 s 16/12/27 06:23:42 INFO InMemoryTableScanExec: Predicate isnotnull(PEND#281) generates partition filter: ((PEND.count#1909 - PEND.nullCount#1908) > 0) 16/12/27 06:23:42 INFO InMemoryTableScanExec: Predicate (EMPLOYEEID#158 > 0) generates partition filter: (0 < EMPLOYEEID.upperBound#1896) 16/12/27 06:23:42 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#158) generates partition filter: ((EMPLOYEEID.count#1899 - EMPLOYEEID.nullCount#1898) > 0) 16/12/27 06:23:42 INFO InMemoryTableScanExec: Predicate isnotnull(PSTART#280) generates partition filter: ((PSTART.count#1904 - PSTART.nullCount#1903) > 0) 16/12/27 06:23:42 INFO CodeGenerator: Code generated in 46.333624 ms 16/12/27 06:23:42 INFO CodeGenerator: Code generated in 53.292403 ms 16/12/27 06:23:42 INFO CodeGenerator: Code generated in 14.082243 ms 16/12/27 06:23:42 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:23:45 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:23:45 INFO DAGScheduler: Got job 8 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:23:45 INFO DAGScheduler: Final stage: ResultStage 9 (collect at JdbcSource.scala:92) 16/12/27 06:23:45 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:23:45 INFO DAGScheduler: Missing parents: List() 16/12/27 06:23:45 INFO DAGScheduler: Submitting ResultStage 9 (MapPartitionsRDD[201] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:23:45 INFO MemoryStore: Block broadcast_11 stored as values in memory (estimated size 14.3 KB, free 901.5 MB) 16/12/27 06:23:45 INFO MemoryStore: Block broadcast_11_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.5 MB) 16/12/27 06:23:45 INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:23:45 INFO SparkContext: Created broadcast 11 from broadcast at DAGScheduler.scala:1012 16/12/27 06:23:45 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 9 (MapPartitionsRDD[201] at collect at JdbcSource.scala:92) 16/12/27 06:23:45 INFO YarnClusterScheduler: Adding task set 9.0 with 1 tasks 16/12/27 06:23:45 INFO TaskSetManager: Starting task 0.0 in stage 9.0 (TID 51, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5241 bytes) 16/12/27 06:23:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 51 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:23:45 INFO BlockManagerInfo: Added broadcast_11_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:23:47 INFO TaskSetManager: Finished task 0.0 in stage 9.0 (TID 51) in 2521 ms on kvs-in-merlin12.int.kronos.com (1/1) 16/12/27 06:23:47 INFO YarnClusterScheduler: Removed TaskSet 9.0, whose tasks have all completed, from pool 16/12/27 06:23:47 INFO DAGScheduler: ResultStage 9 (collect at JdbcSource.scala:92) finished in 2.522 s 16/12/27 06:23:47 INFO DAGScheduler: Job 8 finished: collect at JdbcSource.scala:92, took 2.532006 s 16/12/27 06:23:50 INFO CodeGenerator: Code generated in 21.14749 ms 16/12/27 06:23:50 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:23:53 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:23:53 INFO DAGScheduler: Got job 9 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:23:53 INFO DAGScheduler: Final stage: ResultStage 10 (collect at JdbcSource.scala:92) 16/12/27 06:23:53 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:23:53 INFO DAGScheduler: Missing parents: List() 16/12/27 06:23:53 INFO DAGScheduler: Submitting ResultStage 10 (MapPartitionsRDD[209] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:23:53 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 14.3 KB, free 901.5 MB) 16/12/27 06:23:53 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.5 MB) 16/12/27 06:23:53 INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:23:53 INFO SparkContext: Created broadcast 12 from broadcast at DAGScheduler.scala:1012 16/12/27 06:23:53 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 10 (MapPartitionsRDD[209] at collect at JdbcSource.scala:92) 16/12/27 06:23:53 INFO YarnClusterScheduler: Adding task set 10.0 with 1 tasks 16/12/27 06:23:53 INFO TaskSetManager: Starting task 0.0 in stage 10.0 (TID 52, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5241 bytes) 16/12/27 06:23:53 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 52 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:23:53 INFO BlockManagerInfo: Added broadcast_12_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:23:55 INFO DAGScheduler: ResultStage 10 (collect at JdbcSource.scala:92) finished in 2.795 s 16/12/27 06:23:55 INFO TaskSetManager: Finished task 0.0 in stage 10.0 (TID 52) in 2793 ms on kvs-in-merlin11.int.kronos.com (1/1) 16/12/27 06:23:55 INFO YarnClusterScheduler: Removed TaskSet 10.0, whose tasks have all completed, from pool 16/12/27 06:23:55 INFO DAGScheduler: Job 9 finished: collect at JdbcSource.scala:92, took 2.808653 s 16/12/27 06:23:58 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:24:01 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:24:01 INFO DAGScheduler: Got job 10 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:24:01 INFO DAGScheduler: Final stage: ResultStage 11 (collect at JdbcSource.scala:92) 16/12/27 06:24:01 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:24:01 INFO DAGScheduler: Missing parents: List() 16/12/27 06:24:01 INFO DAGScheduler: Submitting ResultStage 11 (MapPartitionsRDD[212] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:24:01 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 14.3 KB, free 901.5 MB) 16/12/27 06:24:01 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.5 MB) 16/12/27 06:24:01 INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:24:01 INFO SparkContext: Created broadcast 13 from broadcast at DAGScheduler.scala:1012 16/12/27 06:24:01 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 11 (MapPartitionsRDD[212] at collect at JdbcSource.scala:92) 16/12/27 06:24:01 INFO YarnClusterScheduler: Adding task set 11.0 with 1 tasks 16/12/27 06:24:01 INFO TaskSetManager: Starting task 0.0 in stage 11.0 (TID 53, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5241 bytes) 16/12/27 06:24:01 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 53 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:24:01 INFO BlockManagerInfo: Added broadcast_13_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:24:03 INFO TaskSetManager: Finished task 0.0 in stage 11.0 (TID 53) in 2531 ms on kvs-in-merlin12.int.kronos.com (1/1) 16/12/27 06:24:03 INFO YarnClusterScheduler: Removed TaskSet 11.0, whose tasks have all completed, from pool 16/12/27 06:24:03 INFO DAGScheduler: ResultStage 11 (collect at JdbcSource.scala:92) finished in 2.532 s 16/12/27 06:24:03 INFO DAGScheduler: Job 10 finished: collect at JdbcSource.scala:92, took 2.546161 s 16/12/27 06:24:06 INFO CodeGenerator: Code generated in 22.03669 ms 16/12/27 06:24:06 INFO CodeGenerator: Code generated in 22.155016 ms 16/12/27 06:24:06 INFO CodeGenerator: Code generated in 14.361246 ms 16/12/27 06:24:06 INFO CodeGenerator: Code generated in 14.964824 ms 16/12/27 06:24:06 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#2093) generates partition filter: ((EMPLOYEEID.count#2463 - EMPLOYEEID.nullCount#2462) > 0) 16/12/27 06:24:06 INFO InMemoryTableScanExec: Predicate (EMPLOYEEID#2093 > 0) generates partition filter: (0 < EMPLOYEEID.upperBound#2460) 16/12/27 06:24:06 INFO CodeGenerator: Code generated in 82.591383 ms 16/12/27 06:24:06 INFO CodeGenerator: Code generated in 13.698856 ms 16/12/27 06:24:06 INFO CodeGenerator: Code generated in 17.328577 ms 16/12/27 06:24:06 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:24:11 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:24:11 INFO DAGScheduler: Got job 11 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:24:11 INFO DAGScheduler: Final stage: ResultStage 12 (collect at JdbcSource.scala:92) 16/12/27 06:24:11 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:24:11 INFO DAGScheduler: Missing parents: List() 16/12/27 06:24:11 INFO DAGScheduler: Submitting ResultStage 12 (MapPartitionsRDD[251] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:24:11 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 14.3 KB, free 901.5 MB) 16/12/27 06:24:11 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.5 MB) 16/12/27 06:24:11 INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:24:11 INFO SparkContext: Created broadcast 14 from broadcast at DAGScheduler.scala:1012 16/12/27 06:24:11 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 12 (MapPartitionsRDD[251] at collect at JdbcSource.scala:92) 16/12/27 06:24:11 INFO YarnClusterScheduler: Adding task set 12.0 with 1 tasks 16/12/27 06:24:11 INFO TaskSetManager: Starting task 0.0 in stage 12.0 (TID 54, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5241 bytes) 16/12/27 06:24:11 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 54 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:24:11 INFO BlockManagerInfo: Added broadcast_14_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:24:16 INFO TaskSetManager: Finished task 0.0 in stage 12.0 (TID 54) in 4549 ms on kvs-in-merlin12.int.kronos.com (1/1) 16/12/27 06:24:16 INFO YarnClusterScheduler: Removed TaskSet 12.0, whose tasks have all completed, from pool 16/12/27 06:24:16 INFO DAGScheduler: ResultStage 12 (collect at JdbcSource.scala:92) finished in 4.549 s 16/12/27 06:24:16 INFO DAGScheduler: Job 11 finished: collect at JdbcSource.scala:92, took 4.561216 s 16/12/27 06:24:18 INFO CodeGenerator: Code generated in 14.360064 ms 16/12/27 06:24:18 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:24:21 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:24:21 INFO DAGScheduler: Got job 12 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:24:21 INFO DAGScheduler: Final stage: ResultStage 13 (collect at JdbcSource.scala:92) 16/12/27 06:24:21 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:24:21 INFO DAGScheduler: Missing parents: List() 16/12/27 06:24:21 INFO DAGScheduler: Submitting ResultStage 13 (MapPartitionsRDD[259] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:24:21 INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 14.3 KB, free 901.5 MB) 16/12/27 06:24:21 INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.5 MB) 16/12/27 06:24:21 INFO BlockManagerInfo: Added broadcast_15_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:24:21 INFO SparkContext: Created broadcast 15 from broadcast at DAGScheduler.scala:1012 16/12/27 06:24:21 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 13 (MapPartitionsRDD[259] at collect at JdbcSource.scala:92) 16/12/27 06:24:21 INFO YarnClusterScheduler: Adding task set 13.0 with 1 tasks 16/12/27 06:24:21 INFO TaskSetManager: Starting task 0.0 in stage 13.0 (TID 55, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5242 bytes) 16/12/27 06:24:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 55 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:24:21 INFO BlockManagerInfo: Added broadcast_15_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:24:24 INFO TaskSetManager: Finished task 0.0 in stage 13.0 (TID 55) in 2612 ms on kvs-in-merlin11.int.kronos.com (1/1) 16/12/27 06:24:24 INFO YarnClusterScheduler: Removed TaskSet 13.0, whose tasks have all completed, from pool 16/12/27 06:24:24 INFO DAGScheduler: ResultStage 13 (collect at JdbcSource.scala:92) finished in 2.614 s 16/12/27 06:24:24 INFO DAGScheduler: Job 12 finished: collect at JdbcSource.scala:92, took 2.629025 s 16/12/27 06:24:26 INFO CodeGenerator: Code generated in 14.245147 ms 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1824 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1092 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1093 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_7_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_7_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1138 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1139 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_8_piece0 on 10.131.137.96:43778 in memory (size: 4.4 KB, free: 911.7 MB) 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_8_piece0 on kvs-in-merlin11.int.kronos.com:33426 in memory (size: 4.4 KB, free: 3.0 GB) 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_8_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 4.4 KB, free: 3.0 GB) 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1504 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1505 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1533 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1534 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1540 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1541 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1542 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1543 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1544 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1545 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1579 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1580 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1593 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1594 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_10_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_10_piece0 on kvs-in-merlin11.int.kronos.com:33426 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1639 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1640 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1641 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1642 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1643 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1644 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1645 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1646 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1677 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1678 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_11_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_11_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1723 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1724 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1729 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1730 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_12_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_12_piece0 on kvs-in-merlin11.int.kronos.com:33426 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1775 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1776 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_13_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_13_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1821 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1822 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1825 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1826 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1827 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1858 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1859 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1860 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1861 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1862 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1863 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1864 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1892 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1893 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_14_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_14_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1938 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1939 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1944 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1945 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_15_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.8 MB) 16/12/27 06:24:26 INFO BlockManagerInfo: Removed broadcast_15_piece0 on kvs-in-merlin11.int.kronos.com:33426 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1990 16/12/27 06:24:26 INFO ContextCleaner: Cleaned accumulator 1991 16/12/27 06:24:29 INFO InMemoryTableScanExec: Predicate isnotnull(SHIFTENDDATE#1484) generates partition filter: ((SHIFTENDDATE.count#3782 - SHIFTENDDATE.nullCount#3781) > 0) 16/12/27 06:24:29 INFO InMemoryTableScanExec: Predicate isnotnull(PEND#281) generates partition filter: ((PEND.count#3802 - PEND.nullCount#3801) > 0) 16/12/27 06:24:29 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#158) generates partition filter: ((EMPLOYEEID.count#3792 - EMPLOYEEID.nullCount#3791) > 0) 16/12/27 06:24:29 INFO InMemoryTableScanExec: Predicate isnotnull(PSTART#280) generates partition filter: ((PSTART.count#3797 - PSTART.nullCount#3796) > 0) 16/12/27 06:24:29 INFO InMemoryTableScanExec: Predicate isnotnull(ACTIONTYPEID#1540L) generates partition filter: ((ACTIONTYPEID.count#3917 - ACTIONTYPEID.nullCount#3916) > 0) 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 55.551849 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 12.937311 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 12.274506 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 13.131022 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 11.784285 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 11.338482 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 11.709652 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 11.145072 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 10.55968 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 12.655361 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 9.90156 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 10.707806 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 9.661796 ms 16/12/27 06:24:29 INFO CodeGenerator: Code generated in 10.004252 ms 16/12/27 06:24:30 INFO CodeGenerator: Code generated in 36.314619 ms 16/12/27 06:24:30 INFO CodeGenerator: Code generated in 23.918032 ms 16/12/27 06:24:30 INFO CodeGenerator: Code generated in 22.821144 ms 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2018 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 1996 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 1997 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 1998 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 1999 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2000 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2001 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2002 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2003 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2004 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2005 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2006 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2007 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2008 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2009 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2012 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2014 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2016 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2020 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2022 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2023 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2025 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2026 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2027 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2028 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2029 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2030 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2031 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2032 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2033 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2034 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2035 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2036 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2039 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2041 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2042 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2043 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2044 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2045 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2046 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2047 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2048 16/12/27 06:24:30 INFO ContextCleaner: Cleaned accumulator 2049 16/12/27 06:24:31 INFO CodeGenerator: Code generated in 32.452159 ms 16/12/27 06:24:31 INFO CodeGenerator: Code generated in 7.067805 ms 16/12/27 06:24:31 INFO CodeGenerator: Code generated in 21.933049 ms 16/12/27 06:24:31 INFO CodeGenerator: Code generated in 30.307021 ms 16/12/27 06:24:31 INFO CodeGenerator: Code generated in 10.424905 ms 16/12/27 06:24:31 INFO CodeGenerator: Code generated in 22.171049 ms 16/12/27 06:24:31 INFO CodeGenerator: Code generated in 23.722728 ms 16/12/27 06:24:31 INFO CodeGenerator: Code generated in 8.046482 ms 16/12/27 06:24:31 INFO CodeGenerator: Code generated in 7.171614 ms 16/12/27 06:24:31 WARN Utils: Truncated the string representation of a plan since it was too large. This behavior can be adjusted by setting 'spark.debug.maxToStringFields' in SparkEnv.conf. [Args] usage.monthly_alignment_strategy=MAJORITY_DAYS 16/12/27 06:24:31 INFO CodeGenerator: Code generated in 35.65992 ms 16/12/27 06:24:32 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:24:35 INFO CodeGenerator: Code generated in 12.35285 ms 16/12/27 06:24:35 INFO CodeGenerator: Code generated in 10.377433 ms 16/12/27 06:24:35 INFO CodeGenerator: Code generated in 33.656993 ms 16/12/27 06:24:35 INFO CodeGenerator: Code generated in 34.525243 ms 16/12/27 06:24:35 INFO CodeGenerator: Code generated in 32.71565 ms 16/12/27 06:24:35 INFO CodeGenerator: Code generated in 31.278976 ms 16/12/27 06:24:35 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:24:38 INFO CodeGenerator: Code generated in 12.287083 ms 16/12/27 06:24:38 INFO CodeGenerator: Code generated in 11.358017 ms 16/12/27 06:24:38 INFO CodeGenerator: Code generated in 37.74284 ms 16/12/27 06:24:38 INFO CodeGenerator: Code generated in 33.433473 ms 16/12/27 06:24:38 INFO CodeGenerator: Code generated in 31.860144 ms 16/12/27 06:24:38 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:24:41 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:24:43 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:24:43 INFO DAGScheduler: Got job 13 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:24:43 INFO DAGScheduler: Final stage: ResultStage 14 (collect at JdbcSource.scala:92) 16/12/27 06:24:43 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:24:43 INFO DAGScheduler: Missing parents: List() 16/12/27 06:24:43 INFO DAGScheduler: Submitting ResultStage 14 (MapPartitionsRDD[542] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:24:43 INFO MemoryStore: Block broadcast_16 stored as values in memory (estimated size 14.3 KB, free 901.6 MB) 16/12/27 06:24:43 INFO MemoryStore: Block broadcast_16_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.6 MB) 16/12/27 06:24:43 INFO BlockManagerInfo: Added broadcast_16_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:24:43 INFO SparkContext: Created broadcast 16 from broadcast at DAGScheduler.scala:1012 16/12/27 06:24:43 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 14 (MapPartitionsRDD[542] at collect at JdbcSource.scala:92) 16/12/27 06:24:43 INFO YarnClusterScheduler: Adding task set 14.0 with 1 tasks 16/12/27 06:24:43 INFO TaskSetManager: Starting task 0.0 in stage 14.0 (TID 56, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5242 bytes) 16/12/27 06:24:43 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 56 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:24:43 INFO BlockManagerInfo: Added broadcast_16_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:24:46 INFO TaskSetManager: Finished task 0.0 in stage 14.0 (TID 56) in 2678 ms on kvs-in-merlin12.int.kronos.com (1/1) 16/12/27 06:24:46 INFO YarnClusterScheduler: Removed TaskSet 14.0, whose tasks have all completed, from pool 16/12/27 06:24:46 INFO DAGScheduler: ResultStage 14 (collect at JdbcSource.scala:92) finished in 2.682 s 16/12/27 06:24:46 INFO DAGScheduler: Job 13 finished: collect at JdbcSource.scala:92, took 2.695370 s 16/12/27 06:24:49 INFO CodeGenerator: Code generated in 22.58357 ms 16/12/27 06:24:49 INFO CodeGenerator: Code generated in 14.654687 ms 16/12/27 06:24:49 INFO CodeGenerator: Code generated in 13.020143 ms 16/12/27 06:24:49 INFO CodeGenerator: Code generated in 34.72399 ms 16/12/27 06:24:49 INFO CodeGenerator: Code generated in 36.57446 ms 16/12/27 06:24:49 INFO CodeGenerator: Code generated in 34.54719 ms 16/12/27 06:24:49 INFO CodeGenerator: Code generated in 35.756913 ms 16/12/27 06:24:49 INFO InMemoryTableScanExec: Predicate ((WFCAUDITTYPEID#24 = 5) || (WFCAUDITTYPEID#24 = 6)) generates partition filter: (((WFCAUDITTYPEID.lowerBound#5864 <= 5) && (5 <= WFCAUDITTYPEID.upperBound#5863)) || ((WFCAUDITTYPEID.lowerBound#5864 <= 6) && (6 <= WFCAUDITTYPEID.upperBound#5863))) 16/12/27 06:24:49 INFO InMemoryTableScanExec: Predicate isnotnull(DATASOURCEID#22) generates partition filter: ((DATASOURCEID.count#5871 - DATASOURCEID.nullCount#5870) > 0) 16/12/27 06:24:49 INFO CodeGenerator: Code generated in 28.895185 ms 16/12/27 06:24:49 INFO CodeGenerator: Code generated in 11.536293 ms 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2653 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2671 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2685 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2381 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2382 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2386 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2387 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2393 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2407 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2421 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2422 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2426 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2427 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2433 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2447 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2461 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2475 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2489 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2490 16/12/27 06:24:50 INFO BlockManagerInfo: Removed broadcast_16_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.8 MB) 16/12/27 06:24:50 INFO BlockManagerInfo: Removed broadcast_16_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2535 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2536 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2541 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2542 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2543 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2545 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2563 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2564 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2569 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2583 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2597 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2611 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2625 16/12/27 06:24:50 INFO ContextCleaner: Cleaned accumulator 2639 16/12/27 06:24:50 INFO InMemoryTableScanExec: Predicate ((WFCAUDITTYPEID#24 = 1) || (WFCAUDITTYPEID#24 = 2)) generates partition filter: (((WFCAUDITTYPEID.lowerBound#6156 <= 1) && (1 <= WFCAUDITTYPEID.upperBound#6155)) || ((WFCAUDITTYPEID.lowerBound#6156 <= 2) && (2 <= WFCAUDITTYPEID.upperBound#6155))) 16/12/27 06:24:50 INFO InMemoryTableScanExec: Predicate isnotnull(DATASOURCEID#22) generates partition filter: ((DATASOURCEID.count#6163 - DATASOURCEID.nullCount#6162) > 0) 16/12/27 06:24:50 INFO CodeGenerator: Code generated in 27.668297 ms 16/12/27 06:24:50 INFO CodeGenerator: Code generated in 11.44368 ms 16/12/27 06:24:51 INFO CodeGenerator: Code generated in 35.43992 ms 16/12/27 06:24:51 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:24:53 INFO CodeGenerator: Code generated in 27.72437 ms 16/12/27 06:24:54 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:24:56 INFO CodeGenerator: Code generated in 28.97757 ms 16/12/27 06:24:56 INFO CodeGenerator: Code generated in 38.783497 ms 16/12/27 06:24:57 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:24:59 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:24:59 INFO DAGScheduler: Got job 14 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:24:59 INFO DAGScheduler: Final stage: ResultStage 15 (collect at JdbcSource.scala:92) 16/12/27 06:24:59 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:24:59 INFO DAGScheduler: Missing parents: List() 16/12/27 06:24:59 INFO DAGScheduler: Submitting ResultStage 15 (MapPartitionsRDD[807] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:24:59 INFO MemoryStore: Block broadcast_17 stored as values in memory (estimated size 14.3 KB, free 901.6 MB) 16/12/27 06:24:59 INFO MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.6 MB) 16/12/27 06:24:59 INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:24:59 INFO SparkContext: Created broadcast 17 from broadcast at DAGScheduler.scala:1012 16/12/27 06:24:59 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 15 (MapPartitionsRDD[807] at collect at JdbcSource.scala:92) 16/12/27 06:24:59 INFO YarnClusterScheduler: Adding task set 15.0 with 1 tasks 16/12/27 06:24:59 INFO TaskSetManager: Starting task 0.0 in stage 15.0 (TID 57, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5243 bytes) 16/12/27 06:24:59 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 57 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:24:59 INFO BlockManagerInfo: Added broadcast_17_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:25:02 INFO TaskSetManager: Finished task 0.0 in stage 15.0 (TID 57) in 2529 ms on kvs-in-merlin11.int.kronos.com (1/1) 16/12/27 06:25:02 INFO YarnClusterScheduler: Removed TaskSet 15.0, whose tasks have all completed, from pool 16/12/27 06:25:02 INFO DAGScheduler: ResultStage 15 (collect at JdbcSource.scala:92) finished in 2.531 s 16/12/27 06:25:02 INFO DAGScheduler: Job 14 finished: collect at JdbcSource.scala:92, took 2.542748 s 16/12/27 06:25:04 INFO CodeGenerator: Code generated in 17.60699 ms 16/12/27 06:25:04 INFO InMemoryTableScanExec: Predicate isnotnull(MGRSIGNOFFTHRUDTM#7424) generates partition filter: ((MGRSIGNOFFTHRUDTM.count#7922 - MGRSIGNOFFTHRUDTM.nullCount#7921) > 0) 16/12/27 06:25:04 INFO InMemoryTableScanExec: Predicate isnotnull(DELETEDSW#5366) generates partition filter: ((DELETEDSW.count#7977 - DELETEDSW.nullCount#7976) > 0) 16/12/27 06:25:04 INFO InMemoryTableScanExec: Predicate (DELETEDSW#5366 = 0) generates partition filter: ((DELETEDSW.lowerBound#7975 <= 0) && (0 <= DELETEDSW.upperBound#7974)) 16/12/27 06:25:04 INFO InMemoryTableScanExec: Predicate isnotnull(EMPLOYEEID#5364L) generates partition filter: ((EMPLOYEEID.count#7967 - EMPLOYEEID.nullCount#7966) > 0) 16/12/27 06:25:04 INFO CodeGenerator: Code generated in 18.0509 ms 16/12/27 06:25:04 INFO CodeGenerator: Code generated in 8.975857 ms 16/12/27 06:25:04 INFO CodeGenerator: Code generated in 10.73186 ms 16/12/27 06:25:04 INFO CodeGenerator: Code generated in 10.38644 ms 16/12/27 06:25:05 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#5363L) generates partition filter: ((PUNCHEVENTID.count#8224 - PUNCHEVENTID.nullCount#8223) > 0) 16/12/27 06:25:05 INFO CodeGenerator: Code generated in 17.26013 ms 16/12/27 06:25:05 INFO CodeGenerator: Code generated in 8.97133 ms 16/12/27 06:25:05 INFO CodeGenerator: Code generated in 11.249043 ms 16/12/27 06:25:05 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#5363L) generates partition filter: ((PUNCHEVENTID.count#8441 - PUNCHEVENTID.nullCount#8440) > 0) 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3147 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3205 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3219 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3233 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3234 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3235 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3236 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3237 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2699 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2713 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2727 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2745 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2759 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2773 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2787 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2801 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2802 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2803 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2804 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2811 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2825 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2839 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2840 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2841 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2842 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2849 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2863 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2877 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2878 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2879 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2880 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2881 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2899 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2913 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2914 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2915 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2916 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2917 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2935 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2949 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2950 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2951 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2967 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2981 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2982 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2983 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 2999 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3013 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3014 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3015 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3016 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3018 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3019 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3020 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3021 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3059 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3073 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3074 16/12/27 06:25:05 INFO BlockManagerInfo: Removed broadcast_17_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.8 MB) 16/12/27 06:25:05 INFO BlockManagerInfo: Removed broadcast_17_piece0 on kvs-in-merlin11.int.kronos.com:33426 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3122 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3123 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3124 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3125 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3126 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3148 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3153 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3167 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3181 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3182 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3183 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3184 16/12/27 06:25:05 INFO ContextCleaner: Cleaned accumulator 3185 16/12/27 06:25:05 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:25:07 INFO CodeGenerator: Code generated in 12.072177 ms 16/12/27 06:25:07 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:25:10 INFO CodeGenerator: Code generated in 13.658444 ms 16/12/27 06:25:10 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#8623L) generates partition filter: ((PUNCHEVENTID.count#8774 - PUNCHEVENTID.nullCount#8773) > 0) 16/12/27 06:25:10 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#8708L) generates partition filter: ((PUNCHEVENTID.count#8799 - PUNCHEVENTID.nullCount#8798) > 0) 16/12/27 06:25:10 INFO CodeGenerator: Code generated in 16.718317 ms 16/12/27 06:25:10 INFO CodeGenerator: Code generated in 9.33252 ms 16/12/27 06:25:10 INFO CodeGenerator: Code generated in 10.94103 ms 16/12/27 06:25:10 INFO CodeGenerator: Code generated in 15.456634 ms 16/12/27 06:25:10 INFO InMemoryTableScanExec: Predicate ((ACTIONTYPEID#8625L = 5) || (ACTIONTYPEID#8625L = 6)) generates partition filter: (((ACTIONTYPEID.lowerBound#9013L <= 5) && (5 <= ACTIONTYPEID.upperBound#9012L)) || ((ACTIONTYPEID.lowerBound#9013L <= 6) && (6 <= ACTIONTYPEID.upperBound#9012L))) 16/12/27 06:25:10 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#8623L) generates partition filter: ((PUNCHEVENTID.count#9005 - PUNCHEVENTID.nullCount#9004) > 0) 16/12/27 06:25:10 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#8957L) generates partition filter: ((PUNCHEVENTID.count#9070 - PUNCHEVENTID.nullCount#9069) > 0) 16/12/27 06:25:10 INFO CodeGenerator: Code generated in 13.892126 ms 16/12/27 06:25:10 INFO CodeGenerator: Code generated in 9.430954 ms 16/12/27 06:25:10 INFO CodeGenerator: Code generated in 8.8298 ms 16/12/27 06:25:10 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#5363L) generates partition filter: ((PUNCHEVENTID.count#9226 - PUNCHEVENTID.nullCount#9225) > 0) 16/12/27 06:25:10 INFO InMemoryTableScanExec: Predicate ((ACTIONTYPEID#8625L = 5) || (ACTIONTYPEID#8625L = 6)) generates partition filter: (((ACTIONTYPEID.lowerBound#9274L <= 5) && (5 <= ACTIONTYPEID.upperBound#9273L)) || ((ACTIONTYPEID.lowerBound#9274L <= 6) && (6 <= ACTIONTYPEID.upperBound#9273L))) 16/12/27 06:25:10 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#8623L) generates partition filter: ((PUNCHEVENTID.count#9266 - PUNCHEVENTID.nullCount#9265) > 0) 16/12/27 06:25:11 INFO CodeGenerator: Code generated in 14.789028 ms 16/12/27 06:25:11 INFO CodeGenerator: Code generated in 9.15769 ms 16/12/27 06:25:11 INFO CodeGenerator: Code generated in 11.319806 ms 16/12/27 06:25:11 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:25:13 INFO InMemoryTableScanExec: Predicate ((ACTIONTYPEID#8625L = 5) || (ACTIONTYPEID#8625L = 6)) generates partition filter: (((ACTIONTYPEID.lowerBound#9485L <= 5) && (5 <= ACTIONTYPEID.upperBound#9484L)) || ((ACTIONTYPEID.lowerBound#9485L <= 6) && (6 <= ACTIONTYPEID.upperBound#9484L))) 16/12/27 06:25:13 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#8623L) generates partition filter: ((PUNCHEVENTID.count#9477 - PUNCHEVENTID.nullCount#9476) > 0) 16/12/27 06:25:13 INFO CodeGenerator: Code generated in 16.87664 ms 16/12/27 06:25:13 INFO CodeGenerator: Code generated in 8.860044 ms 16/12/27 06:25:13 INFO InMemoryTableScanExec: Predicate isnotnull(DATASOURCEID#1543L) generates partition filter: ((DATASOURCEID.count#9654 - DATASOURCEID.nullCount#9653) > 0) 16/12/27 06:25:13 INFO CodeGenerator: Code generated in 16.891224 ms 16/12/27 06:25:13 INFO CodeGenerator: Code generated in 9.9538 ms 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate isnotnull(SHIFTASSIGNID#1541L) generates partition filter: ((SHIFTASSIGNID.count#9726 - SHIFTASSIGNID.nullCount#9725) > 0) 16/12/27 06:25:14 INFO CodeGenerator: Code generated in 18.448256 ms 16/12/27 06:25:14 INFO CodeGenerator: Code generated in 10.487806 ms 16/12/27 06:25:14 INFO CodeGenerator: Code generated in 12.067276 ms 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate isnotnull(ACTIONTYPEID#8625L) generates partition filter: ((ACTIONTYPEID.count#10184 - ACTIONTYPEID.nullCount#10183) > 0) 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate (ACTIONTYPEID#8625L = 6) generates partition filter: ((ACTIONTYPEID.lowerBound#10182L <= 6) && (6 <= ACTIONTYPEID.upperBound#10181L)) 16/12/27 06:25:14 INFO CodeGenerator: Code generated in 7.157032 ms 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate isnotnull(ASSOCPUNCHDTM#9874) generates partition filter: ((ASSOCPUNCHDTM.count#10432 - ASSOCPUNCHDTM.nullCount#10431) > 0) 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate isnotnull(ACTIONTYPEID#8625L) generates partition filter: ((ACTIONTYPEID.count#10382 - ACTIONTYPEID.nullCount#10381) > 0) 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate (ACTIONTYPEID#8625L = 6) generates partition filter: ((ACTIONTYPEID.lowerBound#10380L <= 6) && (6 <= ACTIONTYPEID.upperBound#10379L)) 16/12/27 06:25:14 INFO CodeGenerator: Code generated in 6.87512 ms 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate isnotnull(ACTIONTYPEID#8625L) generates partition filter: ((ACTIONTYPEID.count#10580 - ACTIONTYPEID.nullCount#10579) > 0) 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate (ACTIONTYPEID#8625L = 5) generates partition filter: ((ACTIONTYPEID.lowerBound#10578L <= 5) && (5 <= ACTIONTYPEID.upperBound#10577L)) 16/12/27 06:25:14 INFO CodeGenerator: Code generated in 7.221947 ms 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#8623L) generates partition filter: ((PUNCHEVENTID.count#10828 - PUNCHEVENTID.nullCount#10827) > 0) 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#5363L) generates partition filter: ((PUNCHEVENTID.count#10853 - PUNCHEVENTID.nullCount#10852) > 0) 16/12/27 06:25:14 INFO CodeGenerator: Code generated in 8.84125 ms 16/12/27 06:25:14 INFO CodeGenerator: Code generated in 8.721712 ms 16/12/27 06:25:14 INFO CodeGenerator: Code generated in 6.645661 ms 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate isnotnull(ACTIONTYPEID#8625L) generates partition filter: ((ACTIONTYPEID.count#11004 - ACTIONTYPEID.nullCount#11003) > 0) 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate (ACTIONTYPEID#8625L = 6) generates partition filter: ((ACTIONTYPEID.lowerBound#11002L <= 6) && (6 <= ACTIONTYPEID.upperBound#11001L)) 16/12/27 06:25:14 INFO CodeGenerator: Code generated in 7.974867 ms 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate isnotnull(ASSOCPUNCHDTM#9874) generates partition filter: ((ASSOCPUNCHDTM.count#11252 - ASSOCPUNCHDTM.nullCount#11251) > 0) 16/12/27 06:25:14 INFO InMemoryTableScanExec: Predicate isnotnull(ACTIONTYPEID#8625L) generates partition filter: ((ACTIONTYPEID.count#11202 - ACTIONTYPEID.nullCount#11201) > 0) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate (ACTIONTYPEID#8625L = 6) generates partition filter: ((ACTIONTYPEID.lowerBound#11200L <= 6) && (6 <= ACTIONTYPEID.upperBound#11199L)) 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3686 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3615 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3616 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3622 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3636 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3650 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3651 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3657 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3671 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3685 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3687 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3720 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3721 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3727 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3741 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3755 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3756 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3257 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3271 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3285 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3286 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3291 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3292 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3298 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3299 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3334 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3335 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3336 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3337 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3353 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3367 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3381 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3382 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3383 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3384 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3385 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3406 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3420 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3434 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3435 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3436 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3437 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3438 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3458 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3472 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3486 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3487 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3488 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3490 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3508 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3509 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3510 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3511 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3512 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3513 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3514 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3534 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3548 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3580 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3581 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3587 16/12/27 06:25:15 INFO ContextCleaner: Cleaned accumulator 3601 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#8623L) generates partition filter: ((PUNCHEVENTID.count#11410 - PUNCHEVENTID.nullCount#11409) > 0) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate isnotnull(PUNCHEVENTID#5363L) generates partition filter: ((PUNCHEVENTID.count#11435 - PUNCHEVENTID.nullCount#11434) > 0) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate isnotnull(ACTIONTYPEID#8625L) generates partition filter: ((ACTIONTYPEID.count#11551 - ACTIONTYPEID.nullCount#11550) > 0) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate (ACTIONTYPEID#8625L = 5) generates partition filter: ((ACTIONTYPEID.lowerBound#11549L <= 5) && (5 <= ACTIONTYPEID.upperBound#11548L)) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate isnotnull(DELETEDSW#8711) generates partition filter: ((DELETEDSW.count#11759 - DELETEDSW.nullCount#11758) > 0) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate isnotnull(ACTIONTYPEID#8625L) generates partition filter: ((ACTIONTYPEID.count#11734 - ACTIONTYPEID.nullCount#11733) > 0) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate isnotnull(ASSOCEXCEPTIONRESOLVESW#9876) generates partition filter: ((ASSOCEXCEPTIONRESOLVESW.count#11794 - ASSOCEXCEPTIONRESOLVESW.nullCount#11793) > 0) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate (ACTIONTYPEID#8625L = 6) generates partition filter: ((ACTIONTYPEID.lowerBound#11732L <= 6) && (6 <= ACTIONTYPEID.upperBound#11731L)) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate (ASSOCEXCEPTIONRESOLVESW#9876 = 1) generates partition filter: ((ASSOCEXCEPTIONRESOLVESW.lowerBound#11792 <= 1) && (1 <= ASSOCEXCEPTIONRESOLVESW.upperBound#11791)) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate (DELETEDSW#8711 = 1) generates partition filter: ((DELETEDSW.lowerBound#11757 <= 1) && (1 <= DELETEDSW.upperBound#11756)) 16/12/27 06:25:15 INFO CodeGenerator: Code generated in 13.17184 ms 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate isnotnull(DELETEDSW#5366) generates partition filter: ((DELETEDSW.count#11957 - DELETEDSW.nullCount#11956) > 0) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate isnotnull(ACTIONTYPEID#8625L) generates partition filter: ((ACTIONTYPEID.count#11932 - ACTIONTYPEID.nullCount#11931) > 0) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate isnotnull(ASSOCEXCEPTIONRESOLVESW#9876) generates partition filter: ((ASSOCEXCEPTIONRESOLVESW.count#11992 - ASSOCEXCEPTIONRESOLVESW.nullCount#11991) > 0) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate (ACTIONTYPEID#8625L = 6) generates partition filter: ((ACTIONTYPEID.lowerBound#11930L <= 6) && (6 <= ACTIONTYPEID.upperBound#11929L)) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate (ASSOCEXCEPTIONRESOLVESW#9876 = 1) generates partition filter: ((ASSOCEXCEPTIONRESOLVESW.lowerBound#11990 <= 1) && (1 <= ASSOCEXCEPTIONRESOLVESW.upperBound#11989)) 16/12/27 06:25:15 INFO InMemoryTableScanExec: Predicate (DELETEDSW#5366 = 1) generates partition filter: ((DELETEDSW.lowerBound#11955 <= 1) && (1 <= DELETEDSW.upperBound#11954)) 16/12/27 06:25:15 INFO CodeGenerator: Code generated in 12.510477 ms 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3811 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3762 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3776 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3790 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3791 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3812 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3818 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3832 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3846 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3847 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3853 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3867 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3881 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3882 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3888 16/12/27 06:25:17 INFO ContextCleaner: Cleaned accumulator 3902 16/12/27 06:25:18 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:25:21 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:25:21 INFO DAGScheduler: Got job 15 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:25:21 INFO DAGScheduler: Final stage: ResultStage 16 (collect at JdbcSource.scala:92) 16/12/27 06:25:21 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:25:21 INFO DAGScheduler: Missing parents: List() 16/12/27 06:25:21 INFO DAGScheduler: Submitting ResultStage 16 (MapPartitionsRDD[1225] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:25:21 INFO MemoryStore: Block broadcast_18 stored as values in memory (estimated size 14.3 KB, free 901.6 MB) 16/12/27 06:25:21 INFO MemoryStore: Block broadcast_18_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.6 MB) 16/12/27 06:25:21 INFO BlockManagerInfo: Added broadcast_18_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:25:21 INFO SparkContext: Created broadcast 18 from broadcast at DAGScheduler.scala:1012 16/12/27 06:25:21 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 16 (MapPartitionsRDD[1225] at collect at JdbcSource.scala:92) 16/12/27 06:25:21 INFO YarnClusterScheduler: Adding task set 16.0 with 1 tasks 16/12/27 06:25:21 INFO TaskSetManager: Starting task 0.0 in stage 16.0 (TID 58, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5243 bytes) 16/12/27 06:25:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 58 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:25:21 INFO BlockManagerInfo: Added broadcast_18_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:25:23 INFO TaskSetManager: Finished task 0.0 in stage 16.0 (TID 58) in 2511 ms on kvs-in-merlin12.int.kronos.com (1/1) 16/12/27 06:25:23 INFO YarnClusterScheduler: Removed TaskSet 16.0, whose tasks have all completed, from pool 16/12/27 06:25:23 INFO DAGScheduler: ResultStage 16 (collect at JdbcSource.scala:92) finished in 2.512 s 16/12/27 06:25:23 INFO DAGScheduler: Job 15 finished: collect at JdbcSource.scala:92, took 2.524366 s 16/12/27 06:25:26 INFO CodeGenerator: Code generated in 17.11977 ms 16/12/27 06:25:26 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:25:28 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:25:28 INFO DAGScheduler: Got job 16 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:25:28 INFO DAGScheduler: Final stage: ResultStage 17 (collect at JdbcSource.scala:92) 16/12/27 06:25:28 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:25:28 INFO DAGScheduler: Missing parents: List() 16/12/27 06:25:28 INFO DAGScheduler: Submitting ResultStage 17 (MapPartitionsRDD[1231] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:25:28 INFO MemoryStore: Block broadcast_19 stored as values in memory (estimated size 14.3 KB, free 901.6 MB) 16/12/27 06:25:28 INFO MemoryStore: Block broadcast_19_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.6 MB) 16/12/27 06:25:28 INFO BlockManagerInfo: Added broadcast_19_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:25:28 INFO SparkContext: Created broadcast 19 from broadcast at DAGScheduler.scala:1012 16/12/27 06:25:28 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 17 (MapPartitionsRDD[1231] at collect at JdbcSource.scala:92) 16/12/27 06:25:28 INFO YarnClusterScheduler: Adding task set 17.0 with 1 tasks 16/12/27 06:25:28 INFO TaskSetManager: Starting task 0.0 in stage 17.0 (TID 59, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5243 bytes) 16/12/27 06:25:28 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 59 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:25:28 INFO BlockManagerInfo: Added broadcast_19_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:25:31 INFO TaskSetManager: Finished task 0.0 in stage 17.0 (TID 59) in 2504 ms on kvs-in-merlin11.int.kronos.com (1/1) 16/12/27 06:25:31 INFO YarnClusterScheduler: Removed TaskSet 17.0, whose tasks have all completed, from pool 16/12/27 06:25:31 INFO DAGScheduler: ResultStage 17 (collect at JdbcSource.scala:92) finished in 2.505 s 16/12/27 06:25:31 INFO DAGScheduler: Job 16 finished: collect at JdbcSource.scala:92, took 2.516328 s 16/12/27 06:25:33 INFO CodeGenerator: Code generated in 12.07058 ms 16/12/27 06:25:33 INFO InMemoryTableScanExec: Predicate isnotnull(ACCESSPROFID#13507) generates partition filter: ((ACCESSPROFID.count#13831 - ACCESSPROFID.nullCount#13830) > 0) 16/12/27 06:25:33 INFO CodeGenerator: Code generated in 14.84374 ms 16/12/27 06:25:33 INFO CodeGenerator: Code generated in 9.244916 ms 16/12/27 06:25:33 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:25:36 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:25:36 INFO DAGScheduler: Got job 17 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:25:36 INFO DAGScheduler: Final stage: ResultStage 18 (collect at JdbcSource.scala:92) 16/12/27 06:25:36 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:25:36 INFO DAGScheduler: Missing parents: List() 16/12/27 06:25:36 INFO DAGScheduler: Submitting ResultStage 18 (MapPartitionsRDD[1250] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:25:36 INFO MemoryStore: Block broadcast_20 stored as values in memory (estimated size 14.3 KB, free 901.6 MB) 16/12/27 06:25:36 INFO MemoryStore: Block broadcast_20_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.6 MB) 16/12/27 06:25:36 INFO BlockManagerInfo: Added broadcast_20_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:25:36 INFO SparkContext: Created broadcast 20 from broadcast at DAGScheduler.scala:1012 16/12/27 06:25:36 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 18 (MapPartitionsRDD[1250] at collect at JdbcSource.scala:92) 16/12/27 06:25:36 INFO YarnClusterScheduler: Adding task set 18.0 with 1 tasks 16/12/27 06:25:36 INFO TaskSetManager: Starting task 0.0 in stage 18.0 (TID 60, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5243 bytes) 16/12/27 06:25:36 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 60 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:25:36 INFO BlockManagerInfo: Added broadcast_20_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:25:38 INFO TaskSetManager: Finished task 0.0 in stage 18.0 (TID 60) in 2500 ms on kvs-in-merlin12.int.kronos.com (1/1) 16/12/27 06:25:38 INFO YarnClusterScheduler: Removed TaskSet 18.0, whose tasks have all completed, from pool 16/12/27 06:25:38 INFO DAGScheduler: ResultStage 18 (collect at JdbcSource.scala:92) finished in 2.502 s 16/12/27 06:25:38 INFO DAGScheduler: Job 17 finished: collect at JdbcSource.scala:92, took 2.512441 s 16/12/27 06:25:41 INFO InMemoryTableScanExec: Predicate isnotnull(ACCESSPROFID#13507) generates partition filter: ((ACCESSPROFID.count#14038 - ACCESSPROFID.nullCount#14037) > 0) 16/12/27 06:25:41 INFO CodeGenerator: Code generated in 14.87801 ms 16/12/27 06:25:41 INFO CodeGenerator: Code generated in 9.647617 ms 16/12/27 06:25:41 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:25:42 INFO ContextCleaner: Cleaned accumulator 3916 16/12/27 06:25:42 INFO ContextCleaner: Cleaned accumulator 3917 16/12/27 06:25:42 INFO BlockManagerInfo: Removed broadcast_18_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:25:42 INFO BlockManagerInfo: Removed broadcast_18_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:25:42 INFO ContextCleaner: Cleaned accumulator 3965 16/12/27 06:25:42 INFO ContextCleaner: Cleaned accumulator 3966 16/12/27 06:25:42 INFO BlockManagerInfo: Removed broadcast_19_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:25:42 INFO BlockManagerInfo: Removed broadcast_19_piece0 on kvs-in-merlin11.int.kronos.com:33426 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:25:42 INFO ContextCleaner: Cleaned accumulator 4014 16/12/27 06:25:42 INFO ContextCleaner: Cleaned accumulator 4015 16/12/27 06:25:42 INFO ContextCleaner: Cleaned accumulator 4016 16/12/27 06:25:42 INFO ContextCleaner: Cleaned accumulator 4018 16/12/27 06:25:42 INFO ContextCleaner: Cleaned accumulator 4036 16/12/27 06:25:42 INFO ContextCleaner: Cleaned accumulator 4037 16/12/27 06:25:42 INFO BlockManagerInfo: Removed broadcast_20_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.8 MB) 16/12/27 06:25:42 INFO BlockManagerInfo: Removed broadcast_20_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:25:42 INFO ContextCleaner: Cleaned accumulator 4085 16/12/27 06:25:43 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:25:43 INFO DAGScheduler: Got job 18 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:25:43 INFO DAGScheduler: Final stage: ResultStage 19 (collect at JdbcSource.scala:92) 16/12/27 06:25:43 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:25:43 INFO DAGScheduler: Missing parents: List() 16/12/27 06:25:43 INFO DAGScheduler: Submitting ResultStage 19 (MapPartitionsRDD[1267] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:25:43 INFO MemoryStore: Block broadcast_21 stored as values in memory (estimated size 14.3 KB, free 901.6 MB) 16/12/27 06:25:43 INFO MemoryStore: Block broadcast_21_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.6 MB) 16/12/27 06:25:43 INFO BlockManagerInfo: Added broadcast_21_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:25:43 INFO SparkContext: Created broadcast 21 from broadcast at DAGScheduler.scala:1012 16/12/27 06:25:43 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 19 (MapPartitionsRDD[1267] at collect at JdbcSource.scala:92) 16/12/27 06:25:43 INFO YarnClusterScheduler: Adding task set 19.0 with 1 tasks 16/12/27 06:25:43 INFO TaskSetManager: Starting task 0.0 in stage 19.0 (TID 61, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5243 bytes) 16/12/27 06:25:43 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 61 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:25:43 INFO BlockManagerInfo: Added broadcast_21_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:25:46 INFO TaskSetManager: Finished task 0.0 in stage 19.0 (TID 61) in 2604 ms on kvs-in-merlin12.int.kronos.com (1/1) 16/12/27 06:25:46 INFO YarnClusterScheduler: Removed TaskSet 19.0, whose tasks have all completed, from pool 16/12/27 06:25:46 INFO DAGScheduler: ResultStage 19 (collect at JdbcSource.scala:92) finished in 2.606 s 16/12/27 06:25:46 INFO DAGScheduler: Job 18 finished: collect at JdbcSource.scala:92, took 2.616892 s 16/12/27 06:25:49 INFO CodeGenerator: Code generated in 10.66659 ms 16/12/27 06:25:49 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:25:51 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:25:51 INFO DAGScheduler: Got job 19 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:25:51 INFO DAGScheduler: Final stage: ResultStage 20 (collect at JdbcSource.scala:92) 16/12/27 06:25:51 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:25:51 INFO DAGScheduler: Missing parents: List() 16/12/27 06:25:51 INFO DAGScheduler: Submitting ResultStage 20 (MapPartitionsRDD[1275] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:25:51 INFO MemoryStore: Block broadcast_22 stored as values in memory (estimated size 14.3 KB, free 901.6 MB) 16/12/27 06:25:51 INFO MemoryStore: Block broadcast_22_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.6 MB) 16/12/27 06:25:51 INFO BlockManagerInfo: Added broadcast_22_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:25:51 INFO SparkContext: Created broadcast 22 from broadcast at DAGScheduler.scala:1012 16/12/27 06:25:51 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 20 (MapPartitionsRDD[1275] at collect at JdbcSource.scala:92) 16/12/27 06:25:51 INFO YarnClusterScheduler: Adding task set 20.0 with 1 tasks 16/12/27 06:25:51 INFO TaskSetManager: Starting task 0.0 in stage 20.0 (TID 62, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5243 bytes) 16/12/27 06:25:51 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 62 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:25:51 INFO BlockManagerInfo: Added broadcast_22_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:25:54 INFO TaskSetManager: Finished task 0.0 in stage 20.0 (TID 62) in 2502 ms on kvs-in-merlin12.int.kronos.com (1/1) 16/12/27 06:25:54 INFO YarnClusterScheduler: Removed TaskSet 20.0, whose tasks have all completed, from pool 16/12/27 06:25:54 INFO DAGScheduler: ResultStage 20 (collect at JdbcSource.scala:92) finished in 2.503 s 16/12/27 06:25:54 INFO DAGScheduler: Job 19 finished: collect at JdbcSource.scala:92, took 2.514823 s 16/12/27 06:25:56 INFO CodeGenerator: Code generated in 10.79534 ms 16/12/27 06:25:56 INFO CodeGenerator: Code generated in 14.414757 ms 16/12/27 06:25:56 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:25:59 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:25:59 INFO DAGScheduler: Got job 20 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:25:59 INFO DAGScheduler: Final stage: ResultStage 21 (collect at JdbcSource.scala:92) 16/12/27 06:25:59 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:25:59 INFO DAGScheduler: Missing parents: List() 16/12/27 06:25:59 INFO DAGScheduler: Submitting ResultStage 21 (MapPartitionsRDD[1295] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:25:59 INFO MemoryStore: Block broadcast_23 stored as values in memory (estimated size 14.3 KB, free 901.6 MB) 16/12/27 06:25:59 INFO MemoryStore: Block broadcast_23_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.6 MB) 16/12/27 06:25:59 INFO BlockManagerInfo: Added broadcast_23_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:25:59 INFO SparkContext: Created broadcast 23 from broadcast at DAGScheduler.scala:1012 16/12/27 06:25:59 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 21 (MapPartitionsRDD[1295] at collect at JdbcSource.scala:92) 16/12/27 06:25:59 INFO YarnClusterScheduler: Adding task set 21.0 with 1 tasks 16/12/27 06:25:59 INFO TaskSetManager: Starting task 0.0 in stage 21.0 (TID 63, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5243 bytes) 16/12/27 06:25:59 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 63 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:25:59 INFO BlockManagerInfo: Added broadcast_23_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:26:01 INFO TaskSetManager: Finished task 0.0 in stage 21.0 (TID 63) in 2499 ms on kvs-in-merlin12.int.kronos.com (1/1) 16/12/27 06:26:01 INFO YarnClusterScheduler: Removed TaskSet 21.0, whose tasks have all completed, from pool 16/12/27 06:26:01 INFO DAGScheduler: ResultStage 21 (collect at JdbcSource.scala:92) finished in 2.501 s 16/12/27 06:26:01 INFO DAGScheduler: Job 20 finished: collect at JdbcSource.scala:92, took 2.512001 s 16/12/27 06:26:04 INFO CodeGenerator: Code generated in 10.203727 ms 16/12/27 06:26:04 INFO CodeGenerator: Code generated in 16.147623 ms 16/12/27 06:26:04 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:26:06 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:26:06 INFO DAGScheduler: Got job 21 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:26:06 INFO DAGScheduler: Final stage: ResultStage 22 (collect at JdbcSource.scala:92) 16/12/27 06:26:06 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:26:06 INFO DAGScheduler: Missing parents: List() 16/12/27 06:26:06 INFO DAGScheduler: Submitting ResultStage 22 (MapPartitionsRDD[1313] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:26:06 INFO MemoryStore: Block broadcast_24 stored as values in memory (estimated size 14.3 KB, free 901.5 MB) 16/12/27 06:26:06 INFO MemoryStore: Block broadcast_24_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.5 MB) 16/12/27 06:26:06 INFO BlockManagerInfo: Added broadcast_24_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:26:06 INFO SparkContext: Created broadcast 24 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:06 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 22 (MapPartitionsRDD[1313] at collect at JdbcSource.scala:92) 16/12/27 06:26:06 INFO YarnClusterScheduler: Adding task set 22.0 with 1 tasks 16/12/27 06:26:06 INFO TaskSetManager: Starting task 0.0 in stage 22.0 (TID 64, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5243 bytes) 16/12/27 06:26:06 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 64 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:06 INFO BlockManagerInfo: Added broadcast_24_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:26:09 INFO TaskSetManager: Finished task 0.0 in stage 22.0 (TID 64) in 2521 ms on kvs-in-merlin12.int.kronos.com (1/1) 16/12/27 06:26:09 INFO YarnClusterScheduler: Removed TaskSet 22.0, whose tasks have all completed, from pool 16/12/27 06:26:09 INFO DAGScheduler: ResultStage 22 (collect at JdbcSource.scala:92) finished in 2.522 s 16/12/27 06:26:09 INFO DAGScheduler: Job 21 finished: collect at JdbcSource.scala:92, took 2.533604 s 16/12/27 06:26:09 WARN JDBCRelation: The number of partitions is reduced because the specified number of partitions is less than the difference between upper bound and lower bound. Updated number of partitions: 4; Input number of partitions: 15; Lower bound: 1; Upper bound: 5. 16/12/27 06:26:11 INFO CodeGenerator: Code generated in 10.604174 ms 16/12/27 06:26:11 INFO CodeGenerator: Code generated in 14.156517 ms 16/12/27 06:26:12 WARN DataSource: Error while looking for metadata directory. 16/12/27 06:26:14 INFO SparkContext: Starting job: collect at JdbcSource.scala:92 16/12/27 06:26:14 INFO DAGScheduler: Got job 22 (collect at JdbcSource.scala:92) with 1 output partitions 16/12/27 06:26:14 INFO DAGScheduler: Final stage: ResultStage 23 (collect at JdbcSource.scala:92) 16/12/27 06:26:14 INFO DAGScheduler: Parents of final stage: List() 16/12/27 06:26:14 INFO DAGScheduler: Missing parents: List() 16/12/27 06:26:14 INFO DAGScheduler: Submitting ResultStage 23 (MapPartitionsRDD[1331] at collect at JdbcSource.scala:92), which has no missing parents 16/12/27 06:26:14 INFO MemoryStore: Block broadcast_25 stored as values in memory (estimated size 14.3 KB, free 901.5 MB) 16/12/27 06:26:14 INFO MemoryStore: Block broadcast_25_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.5 MB) 16/12/27 06:26:14 INFO BlockManagerInfo: Added broadcast_25_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:26:14 INFO SparkContext: Created broadcast 25 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:14 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 23 (MapPartitionsRDD[1331] at collect at JdbcSource.scala:92) 16/12/27 06:26:14 INFO YarnClusterScheduler: Adding task set 23.0 with 1 tasks 16/12/27 06:26:14 INFO TaskSetManager: Starting task 0.0 in stage 23.0 (TID 65, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5243 bytes) 16/12/27 06:26:14 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 65 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:14 INFO BlockManagerInfo: Added broadcast_25_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:26:17 INFO TaskSetManager: Finished task 0.0 in stage 23.0 (TID 65) in 2495 ms on kvs-in-merlin11.int.kronos.com (1/1) 16/12/27 06:26:17 INFO YarnClusterScheduler: Removed TaskSet 23.0, whose tasks have all completed, from pool 16/12/27 06:26:17 INFO DAGScheduler: ResultStage 23 (collect at JdbcSource.scala:92) finished in 2.495 s 16/12/27 06:26:17 INFO DAGScheduler: Job 22 finished: collect at JdbcSource.scala:92, took 2.506121 s 16/12/27 06:26:17 WARN JDBCRelation: The number of partitions is reduced because the specified number of partitions is less than the difference between upper bound and lower bound. Updated number of partitions: 3; Input number of partitions: 15; Lower bound: 1; Upper bound: 4. 16/12/27 06:26:19 INFO InMemoryTableScanExec: Predicate (PERM_ACTION_NAME#14522 = ALLOWED) generates partition filter: ((PERM_ACTION_NAME.lowerBound#14697 <= ALLOWED) && (ALLOWED <= PERM_ACTION_NAME.upperBound#14696)) 16/12/27 06:26:19 INFO InMemoryTableScanExec: Predicate (SHORTNM#14651 = ALL) generates partition filter: ((SHORTNM.lowerBound#14712 <= ALL) && (ALL <= SHORTNM.upperBound#14711)) 16/12/27 06:26:19 INFO CodeGenerator: Code generated in 14.4852 ms 16/12/27 06:26:19 INFO CodeGenerator: Code generated in 10.835194 ms 16/12/27 06:26:19 INFO CodeGenerator: Code generated in 11.0202 ms 16/12/27 06:26:19 INFO CodeGenerator: Code generated in 13.648713 ms 16/12/27 06:26:20 INFO CodeGenerator: Code generated in 15.449803 ms 16/12/27 06:26:20 INFO CodeGenerator: Code generated in 10.81821 ms 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4275 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4103 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4104 16/12/27 06:26:20 INFO BlockManagerInfo: Removed broadcast_21_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:26:20 INFO BlockManagerInfo: Removed broadcast_21_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4149 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4150 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4155 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4156 16/12/27 06:26:20 INFO BlockManagerInfo: Removed broadcast_22_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:26:20 INFO BlockManagerInfo: Removed broadcast_22_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4201 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4202 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4207 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4208 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4211 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4226 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4227 16/12/27 06:26:20 INFO BlockManagerInfo: Removed broadcast_23_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:26:20 INFO BlockManagerInfo: Removed broadcast_23_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4276 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4279 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4294 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4295 16/12/27 06:26:20 INFO BlockManagerInfo: Removed broadcast_24_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:26:20 INFO BlockManagerInfo: Removed broadcast_24_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4343 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4344 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4347 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4362 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4363 16/12/27 06:26:20 INFO BlockManagerInfo: Removed broadcast_25_piece0 on 10.131.137.96:43778 in memory (size: 5.9 KB, free: 911.8 MB) 16/12/27 06:26:20 INFO BlockManagerInfo: Removed broadcast_25_piece0 on kvs-in-merlin11.int.kronos.com:33426 in memory (size: 5.9 KB, free: 3.0 GB) 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4411 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4412 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4413 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4414 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4415 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4436 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4437 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4440 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4456 16/12/27 06:26:20 INFO ContextCleaner: Cleaned accumulator 4473 16/12/27 06:26:21 INFO SparkContext: Starting job: show at ConsoleSink.scala:12 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 30 (cache at UsageMetricsPipeline.scala:413) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 183 (cache at UsageMetricsPipeline.scala:482) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 187 (cache at UsageMetricsPipeline.scala:482) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 189 (cache at UsageMetricsPipeline.scala:482) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 193 (cache at UsageMetricsPipeline.scala:482) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 196 (cache at UsageMetricsPipeline.scala:482) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 449 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 5 (cache at UsageAudits.scala:15) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 36 (cache at UsageMetricsPipeline.scala:810) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 41 (cache at UsageMetricsPipeline.scala:810) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 268 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 51 (cache at UsageMetricsPipeline.scala:855) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 56 (cache at UsageMetricsPipeline.scala:855) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 272 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 277 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 66 (cache at UsageMetricsPipeline.scala:892) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 71 (cache at UsageMetricsPipeline.scala:892) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 281 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 286 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 78 (cache at UsageMetricsPipeline.scala:699) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 82 (cache at UsageMetricsPipeline.scala:714) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 87 (cache at UsageMetricsPipeline.scala:714) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 290 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 295 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 102 (cache at UsageMetricsPipeline.scala:748) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 104 (cache at UsageMetricsPipeline.scala:748) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 97 (cache at UsageMetricsPipeline.scala:733) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 108 (cache at UsageMetricsPipeline.scala:748) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 112 (cache at UsageMetricsPipeline.scala:748) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 117 (cache at UsageMetricsPipeline.scala:748) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 299 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 304 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 130 (cache at UsageMetricsPipeline.scala:760) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 136 (cache at UsageMetricsPipeline.scala:771) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 141 (cache at UsageMetricsPipeline.scala:771) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 308 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 313 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 167 (cache at UsageMetricsPipeline.scala:587) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 153 (cache at UsageMetricsPipeline.scala:587) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 148 (cache at UsageMetricsPipeline.scala:549) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 158 (cache at UsageMetricsPipeline.scala:587) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 162 (cache at UsageMetricsPipeline.scala:587) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 174 (cache at UsageMetricsPipeline.scala:624) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 317 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 322 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 327 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 329 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 334 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 338 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 342 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 347 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 352 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 357 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 359 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 364 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 369 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 371 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 376 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 237 (cache at UsageMetricsPipeline.scala:529) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 204 (cache at UsageMetricsPipeline.scala:457) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 216 (cache at UsageMetricsPipeline.scala:516) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 220 (cache at UsageMetricsPipeline.scala:516) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 224 (cache at UsageMetricsPipeline.scala:516) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 228 (cache at UsageMetricsPipeline.scala:516) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 232 (cache at UsageMetricsPipeline.scala:516) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 242 (cache at UsageMetricsPipeline.scala:529) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 246 (cache at UsageMetricsPipeline.scala:529) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 381 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 386 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 390 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 392 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 397 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 401 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 254 (cache at UsageMetricsPipeline.scala:602) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 405 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 409 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 262 (cache at UsageMetricsPipeline.scala:601) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 413 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 417 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 420 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 422 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 427 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 432 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 436 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 440 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Registering RDD 445 (cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO DAGScheduler: Got job 23 (show at ConsoleSink.scala:12) with 1 output partitions 16/12/27 06:26:21 INFO DAGScheduler: Final stage: ResultStage 110 (show at ConsoleSink.scala:12) 16/12/27 06:26:21 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 30, ShuffleMapStage 109) 16/12/27 06:26:21 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 30, ShuffleMapStage 109) 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 24 (MapPartitionsRDD[30] at cache at UsageMetricsPipeline.scala:413), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_26 stored as values in memory (estimated size 11.1 KB, free 901.6 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_26_piece0 stored as bytes in memory (estimated size 5.4 KB, free 901.6 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_26_piece0 in memory on 10.131.137.96:43778 (size: 5.4 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 26 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 24 (MapPartitionsRDD[30] at cache at UsageMetricsPipeline.scala:413) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 24.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 26 (MapPartitionsRDD[187] at cache at UsageMetricsPipeline.scala:482), which has no missing parents 16/12/27 06:26:21 INFO TaskSetManager: Starting task 0.0 in stage 24.0 (TID 66, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5193 bytes) 16/12/27 06:26:21 INFO TaskSetManager: Starting task 1.0 in stage 24.0 (TID 67, kvs-in-merlin12.int.kronos.com, partition 1, PROCESS_LOCAL, 5195 bytes) 16/12/27 06:26:21 INFO TaskSetManager: Starting task 2.0 in stage 24.0 (TID 68, kvs-in-merlin11.int.kronos.com, partition 2, PROCESS_LOCAL, 5195 bytes) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_27 stored as values in memory (estimated size 11.6 KB, free 901.6 MB) 16/12/27 06:26:21 INFO TaskSetManager: Starting task 3.0 in stage 24.0 (TID 69, kvs-in-merlin12.int.kronos.com, partition 3, PROCESS_LOCAL, 5195 bytes) 16/12/27 06:26:21 INFO TaskSetManager: Starting task 4.0 in stage 24.0 (TID 70, kvs-in-merlin11.int.kronos.com, partition 4, PROCESS_LOCAL, 5195 bytes) 16/12/27 06:26:21 INFO TaskSetManager: Starting task 5.0 in stage 24.0 (TID 71, kvs-in-merlin12.int.kronos.com, partition 5, PROCESS_LOCAL, 5195 bytes) 16/12/27 06:26:21 INFO TaskSetManager: Starting task 6.0 in stage 24.0 (TID 72, kvs-in-merlin11.int.kronos.com, partition 6, PROCESS_LOCAL, 5195 bytes) 16/12/27 06:26:21 INFO TaskSetManager: Starting task 7.0 in stage 24.0 (TID 73, kvs-in-merlin12.int.kronos.com, partition 7, PROCESS_LOCAL, 5196 bytes) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_27_piece0 stored as bytes in memory (estimated size 5.6 KB, free 901.6 MB) 16/12/27 06:26:21 INFO TaskSetManager: Starting task 8.0 in stage 24.0 (TID 74, kvs-in-merlin11.int.kronos.com, partition 8, PROCESS_LOCAL, 5197 bytes) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_27_piece0 in memory on 10.131.137.96:43778 (size: 5.6 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO TaskSetManager: Starting task 9.0 in stage 24.0 (TID 75, kvs-in-merlin12.int.kronos.com, partition 9, PROCESS_LOCAL, 5197 bytes) 16/12/27 06:26:21 INFO TaskSetManager: Starting task 10.0 in stage 24.0 (TID 76, kvs-in-merlin11.int.kronos.com, partition 10, PROCESS_LOCAL, 5197 bytes) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 27 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO TaskSetManager: Starting task 11.0 in stage 24.0 (TID 77, kvs-in-merlin12.int.kronos.com, partition 11, PROCESS_LOCAL, 5197 bytes) 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 26 (MapPartitionsRDD[187] at cache at UsageMetricsPipeline.scala:482) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 26.0 with 15 tasks 16/12/27 06:26:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 66 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 68 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 70 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 72 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 74 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 76 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 67 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 69 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 71 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 73 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 75 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:21 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 77 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 31 (MapPartitionsRDD[5] at cache at UsageAudits.scala:15), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_28 stored as values in memory (estimated size 15.4 KB, free 901.6 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_28_piece0 stored as bytes in memory (estimated size 7.0 KB, free 901.6 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_28_piece0 in memory on 10.131.137.96:43778 (size: 7.0 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 28 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 31 (MapPartitionsRDD[5] at cache at UsageAudits.scala:15) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 31.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 43 (MapPartitionsRDD[78] at cache at UsageMetricsPipeline.scala:699), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_29 stored as values in memory (estimated size 14.5 KB, free 901.5 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_26_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.4 KB, free: 3.0 GB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_29_piece0 stored as bytes in memory (estimated size 6.6 KB, free 901.5 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_29_piece0 in memory on 10.131.137.96:43778 (size: 6.6 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 29 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 43 (MapPartitionsRDD[78] at cache at UsageMetricsPipeline.scala:699) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 43.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 48 (MapPartitionsRDD[102] at cache at UsageMetricsPipeline.scala:748), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_30 stored as values in memory (estimated size 12.5 KB, free 901.5 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_30_piece0 stored as bytes in memory (estimated size 5.7 KB, free 901.5 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_30_piece0 in memory on 10.131.137.96:43778 (size: 5.7 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 30 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 48 (MapPartitionsRDD[102] at cache at UsageMetricsPipeline.scala:748) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 48.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 50 (MapPartitionsRDD[97] at cache at UsageMetricsPipeline.scala:733), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_31 stored as values in memory (estimated size 10.8 KB, free 901.5 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_31_piece0 stored as bytes in memory (estimated size 5.3 KB, free 901.5 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_26_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 5.4 KB, free: 3.0 GB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_31_piece0 in memory on 10.131.137.96:43778 (size: 5.3 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 31 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 50 (MapPartitionsRDD[97] at cache at UsageMetricsPipeline.scala:733) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 50.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 56 (MapPartitionsRDD[130] at cache at UsageMetricsPipeline.scala:760), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_32 stored as values in memory (estimated size 13.1 KB, free 901.5 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_32_piece0 stored as bytes in memory (estimated size 5.9 KB, free 901.5 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_32_piece0 in memory on 10.131.137.96:43778 (size: 5.9 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 32 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 56 (MapPartitionsRDD[130] at cache at UsageMetricsPipeline.scala:760) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 56.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 62 (MapPartitionsRDD[153] at cache at UsageMetricsPipeline.scala:587), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_33 stored as values in memory (estimated size 12.6 KB, free 901.5 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_33_piece0 stored as bytes in memory (estimated size 5.8 KB, free 901.5 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_33_piece0 in memory on 10.131.137.96:43778 (size: 5.8 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 33 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 62 (MapPartitionsRDD[153] at cache at UsageMetricsPipeline.scala:587) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 62.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 63 (MapPartitionsRDD[148] at cache at UsageMetricsPipeline.scala:549), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_34 stored as values in memory (estimated size 15.0 KB, free 901.4 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_34_piece0 stored as bytes in memory (estimated size 6.5 KB, free 901.4 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_34_piece0 in memory on 10.131.137.96:43778 (size: 6.5 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 34 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 63 (MapPartitionsRDD[148] at cache at UsageMetricsPipeline.scala:549) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 63.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 73 (MapPartitionsRDD[342] at cache at UsageMetricsPipeline.scala:1150), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_35 stored as values in memory (estimated size 12.4 KB, free 901.4 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_35_piece0 stored as bytes in memory (estimated size 5.7 KB, free 901.4 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_35_piece0 in memory on 10.131.137.96:43778 (size: 5.7 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 35 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 73 (MapPartitionsRDD[342] at cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 73.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 82 (MapPartitionsRDD[237] at cache at UsageMetricsPipeline.scala:529), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_36 stored as values in memory (estimated size 12.1 KB, free 901.4 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_36_piece0 stored as bytes in memory (estimated size 5.6 KB, free 901.4 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_36_piece0 in memory on 10.131.137.96:43778 (size: 5.6 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 36 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 82 (MapPartitionsRDD[237] at cache at UsageMetricsPipeline.scala:529) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 82.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 83 (MapPartitionsRDD[204] at cache at UsageMetricsPipeline.scala:457), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_37 stored as values in memory (estimated size 13.3 KB, free 901.4 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_37_piece0 stored as bytes in memory (estimated size 6.2 KB, free 901.4 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_37_piece0 in memory on 10.131.137.96:43778 (size: 6.2 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 37 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 83 (MapPartitionsRDD[204] at cache at UsageMetricsPipeline.scala:457) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 83.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 85 (MapPartitionsRDD[220] at cache at UsageMetricsPipeline.scala:516), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_38 stored as values in memory (estimated size 11.4 KB, free 901.4 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_38_piece0 stored as bytes in memory (estimated size 5.5 KB, free 901.4 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_38_piece0 in memory on 10.131.137.96:43778 (size: 5.5 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 38 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 85 (MapPartitionsRDD[220] at cache at UsageMetricsPipeline.scala:516) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 85.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 87 (MapPartitionsRDD[228] at cache at UsageMetricsPipeline.scala:516), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_39 stored as values in memory (estimated size 11.1 KB, free 901.4 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_39_piece0 stored as bytes in memory (estimated size 5.4 KB, free 901.4 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_39_piece0 in memory on 10.131.137.96:43778 (size: 5.4 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 39 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 87 (MapPartitionsRDD[228] at cache at UsageMetricsPipeline.scala:516) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 87.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 97 (MapPartitionsRDD[254] at cache at UsageMetricsPipeline.scala:602), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_40 stored as values in memory (estimated size 10.9 KB, free 901.3 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_40_piece0 stored as bytes in memory (estimated size 5.4 KB, free 901.3 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_40_piece0 in memory on 10.131.137.96:43778 (size: 5.4 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 40 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 97 (MapPartitionsRDD[254] at cache at UsageMetricsPipeline.scala:602) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 97.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 100 (MapPartitionsRDD[262] at cache at UsageMetricsPipeline.scala:601), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_41 stored as values in memory (estimated size 12.1 KB, free 901.3 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_41_piece0 stored as bytes in memory (estimated size 5.8 KB, free 901.3 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_41_piece0 in memory on 10.131.137.96:43778 (size: 5.8 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 41 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 100 (MapPartitionsRDD[262] at cache at UsageMetricsPipeline.scala:601) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 100.0 with 15 tasks 16/12/27 06:26:21 INFO DAGScheduler: Submitting ShuffleMapStage 107 (MapPartitionsRDD[436] at cache at UsageMetricsPipeline.scala:1150), which has no missing parents 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_42 stored as values in memory (estimated size 12.3 KB, free 901.3 MB) 16/12/27 06:26:21 INFO MemoryStore: Block broadcast_42_piece0 stored as bytes in memory (estimated size 5.5 KB, free 901.3 MB) 16/12/27 06:26:21 INFO BlockManagerInfo: Added broadcast_42_piece0 in memory on 10.131.137.96:43778 (size: 5.5 KB, free: 911.7 MB) 16/12/27 06:26:21 INFO SparkContext: Created broadcast 42 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:21 INFO DAGScheduler: Submitting 15 missing tasks from ShuffleMapStage 107 (MapPartitionsRDD[436] at cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:21 INFO YarnClusterScheduler: Adding task set 107.0 with 15 tasks 16/12/27 06:26:26 INFO TaskSetManager: Starting task 12.0 in stage 24.0 (TID 78, kvs-in-merlin12.int.kronos.com, partition 12, PROCESS_LOCAL, 5197 bytes) 16/12/27 06:26:26 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 78 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:26 INFO TaskSetManager: Finished task 1.0 in stage 24.0 (TID 67) in 5761 ms on kvs-in-merlin12.int.kronos.com (1/15) 16/12/27 06:26:30 INFO TaskSetManager: Starting task 13.0 in stage 24.0 (TID 79, kvs-in-merlin12.int.kronos.com, partition 13, PROCESS_LOCAL, 5197 bytes) 16/12/27 06:26:30 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 79 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:30 INFO TaskSetManager: Finished task 7.0 in stage 24.0 (TID 73) in 9258 ms on kvs-in-merlin12.int.kronos.com (2/15) 16/12/27 06:26:30 INFO TaskSetManager: Starting task 14.0 in stage 24.0 (TID 80, kvs-in-merlin11.int.kronos.com, partition 14, PROCESS_LOCAL, 5170 bytes) 16/12/27 06:26:30 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 80 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:30 INFO TaskSetManager: Finished task 0.0 in stage 24.0 (TID 66) in 9823 ms on kvs-in-merlin11.int.kronos.com (3/15) 16/12/27 06:26:32 INFO TaskSetManager: Starting task 0.0 in stage 26.0 (TID 81, kvs-in-merlin12.int.kronos.com, partition 0, PROCESS_LOCAL, 5183 bytes) 16/12/27 06:26:32 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 81 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:32 INFO TaskSetManager: Finished task 11.0 in stage 24.0 (TID 77) in 11243 ms on kvs-in-merlin12.int.kronos.com (4/15) 16/12/27 06:26:32 INFO BlockManagerInfo: Added broadcast_27_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 5.6 KB, free: 3.0 GB) 16/12/27 06:26:34 INFO TaskSetManager: Starting task 1.0 in stage 26.0 (TID 82, kvs-in-merlin12.int.kronos.com, partition 1, PROCESS_LOCAL, 5185 bytes) 16/12/27 06:26:34 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 82 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:34 INFO TaskSetManager: Finished task 5.0 in stage 24.0 (TID 71) in 13256 ms on kvs-in-merlin12.int.kronos.com (5/15) 16/12/27 06:26:34 INFO TaskSetManager: Starting task 2.0 in stage 26.0 (TID 83, kvs-in-merlin11.int.kronos.com, partition 2, PROCESS_LOCAL, 5185 bytes) 16/12/27 06:26:34 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 83 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:34 INFO TaskSetManager: Finished task 2.0 in stage 24.0 (TID 68) in 13397 ms on kvs-in-merlin11.int.kronos.com (6/15) 16/12/27 06:26:34 INFO BlockManagerInfo: Added broadcast_27_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 5.6 KB, free: 3.0 GB) 16/12/27 06:26:36 INFO TaskSetManager: Starting task 3.0 in stage 26.0 (TID 84, kvs-in-merlin12.int.kronos.com, partition 3, PROCESS_LOCAL, 5185 bytes) 16/12/27 06:26:36 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 84 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:36 INFO TaskSetManager: Finished task 3.0 in stage 24.0 (TID 69) in 15262 ms on kvs-in-merlin12.int.kronos.com (7/15) 16/12/27 06:26:36 INFO TaskSetManager: Starting task 4.0 in stage 26.0 (TID 85, kvs-in-merlin11.int.kronos.com, partition 4, PROCESS_LOCAL, 5185 bytes) 16/12/27 06:26:36 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 85 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:36 INFO TaskSetManager: Finished task 10.0 in stage 24.0 (TID 76) in 15363 ms on kvs-in-merlin11.int.kronos.com (8/15) 16/12/27 06:26:38 INFO TaskSetManager: Starting task 5.0 in stage 26.0 (TID 86, kvs-in-merlin12.int.kronos.com, partition 5, PROCESS_LOCAL, 5185 bytes) 16/12/27 06:26:38 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 86 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:38 INFO TaskSetManager: Finished task 9.0 in stage 24.0 (TID 75) in 17466 ms on kvs-in-merlin12.int.kronos.com (9/15) 16/12/27 06:26:38 INFO TaskSetManager: Starting task 6.0 in stage 26.0 (TID 87, kvs-in-merlin11.int.kronos.com, partition 6, PROCESS_LOCAL, 5185 bytes) 16/12/27 06:26:38 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 87 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:38 INFO TaskSetManager: Finished task 6.0 in stage 24.0 (TID 72) in 17611 ms on kvs-in-merlin11.int.kronos.com (10/15) 16/12/27 06:26:39 INFO TaskSetManager: Starting task 7.0 in stage 26.0 (TID 88, kvs-in-merlin12.int.kronos.com, partition 7, PROCESS_LOCAL, 5186 bytes) 16/12/27 06:26:39 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 88 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:39 INFO TaskSetManager: Finished task 12.0 in stage 24.0 (TID 78) in 12315 ms on kvs-in-merlin12.int.kronos.com (11/15) 16/12/27 06:26:40 INFO TaskSetManager: Starting task 8.0 in stage 26.0 (TID 89, kvs-in-merlin11.int.kronos.com, partition 8, PROCESS_LOCAL, 5187 bytes) 16/12/27 06:26:40 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 89 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:40 INFO TaskSetManager: Finished task 4.0 in stage 24.0 (TID 70) in 19152 ms on kvs-in-merlin11.int.kronos.com (12/15) 16/12/27 06:26:41 INFO TaskSetManager: Starting task 9.0 in stage 26.0 (TID 90, kvs-in-merlin12.int.kronos.com, partition 9, PROCESS_LOCAL, 5187 bytes) 16/12/27 06:26:41 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 90 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:41 INFO TaskSetManager: Finished task 1.0 in stage 26.0 (TID 82) in 6961 ms on kvs-in-merlin12.int.kronos.com (1/15) 16/12/27 06:26:41 INFO TaskSetManager: Starting task 10.0 in stage 26.0 (TID 91, kvs-in-merlin11.int.kronos.com, partition 10, PROCESS_LOCAL, 5187 bytes) 16/12/27 06:26:41 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 91 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:41 INFO TaskSetManager: Finished task 8.0 in stage 24.0 (TID 74) in 20910 ms on kvs-in-merlin11.int.kronos.com (13/15) 16/12/27 06:26:45 INFO TaskSetManager: Starting task 11.0 in stage 26.0 (TID 92, kvs-in-merlin12.int.kronos.com, partition 11, PROCESS_LOCAL, 5187 bytes) 16/12/27 06:26:45 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 92 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:45 INFO TaskSetManager: Finished task 13.0 in stage 24.0 (TID 79) in 15636 ms on kvs-in-merlin12.int.kronos.com (14/15) 16/12/27 06:26:46 INFO TaskSetManager: Starting task 12.0 in stage 26.0 (TID 93, kvs-in-merlin12.int.kronos.com, partition 12, PROCESS_LOCAL, 5187 bytes) 16/12/27 06:26:46 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 93 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:46 INFO TaskSetManager: Finished task 0.0 in stage 26.0 (TID 81) in 13890 ms on kvs-in-merlin12.int.kronos.com (2/15) 16/12/27 06:26:46 INFO TaskSetManager: Starting task 13.0 in stage 26.0 (TID 94, kvs-in-merlin11.int.kronos.com, partition 13, PROCESS_LOCAL, 5187 bytes) 16/12/27 06:26:46 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 94 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:46 INFO TaskSetManager: Finished task 14.0 in stage 24.0 (TID 80) in 15846 ms on kvs-in-merlin11.int.kronos.com (15/15) 16/12/27 06:26:46 INFO YarnClusterScheduler: Removed TaskSet 24.0, whose tasks have all completed, from pool 16/12/27 06:26:46 INFO DAGScheduler: ShuffleMapStage 24 (cache at UsageMetricsPipeline.scala:413) finished in 25.669 s 16/12/27 06:26:46 INFO DAGScheduler: looking for newly runnable stages 16/12/27 06:26:46 INFO DAGScheduler: running: Set(ShuffleMapStage 31, ShuffleMapStage 82, ShuffleMapStage 83, ShuffleMapStage 97, ShuffleMapStage 26, ShuffleMapStage 62, ShuffleMapStage 48, ShuffleMapStage 63, ShuffleMapStage 85, ShuffleMapStage 100, ShuffleMapStage 56, ShuffleMapStage 107, ShuffleMapStage 50, ShuffleMapStage 87, ShuffleMapStage 43, ShuffleMapStage 73) 16/12/27 06:26:46 INFO DAGScheduler: waiting: Set(ShuffleMapStage 102, ShuffleMapStage 81, ShuffleMapStage 60, ShuffleMapStage 52, ShuffleMapStage 104, ShuffleMapStage 75, ShuffleMapStage 54, ShuffleMapStage 25, ShuffleMapStage 106, ShuffleMapStage 98, ShuffleMapStage 77, ShuffleMapStage 27, ShuffleMapStage 71, ShuffleMapStage 42, ShuffleMapStage 94, ShuffleMapStage 65, ShuffleMapStage 44, ShuffleMapStage 96, ShuffleMapStage 88, ShuffleMapStage 67, ShuffleMapStage 46, ShuffleMapStage 38, ShuffleMapStage 90, ShuffleMapStage 69, ShuffleMapStage 61, ShuffleMapStage 40, ShuffleMapStage 92, ShuffleMapStage 84, ShuffleMapStage 34, ShuffleMapStage 86, ShuffleMapStage 57, ShuffleMapStage 36, ShuffleMapStage 28, ShuffleMapStage 109, ShuffleMapStage 80, ShuffleMapStage 59, ShuffleMapStage 51, ShuffleMapStage 30, ShuffleMapStage 103, ShuffleMapStage 74, ShuffleMapStage 53, ShuffleMapStage 32, ShuffleMapStage 105, ShuffleMapStage 76, ShuffleMapStage 55, ShuffleMapStage 47, ShuffleMapStage 99, ShuffleMapStage 78, ShuffleMapStage 70, ShuffleMapStage 49, ShuffleMapStage 101, ShuffleMapStage 93, ShuffleMapStage 72, ShuffleMapStage 95, ShuffleMapStage 66, ShuffleMapStage 45, ShuffleMapStage 37, ShuffleMapStage 89, ShuffleMapStage 68, ShuffleMapStage 39, ShuffleMapStage 91, ShuffleMapStage 41, ShuffleMapStage 33, ShuffleMapStage 64, ShuffleMapStage 35, ShuffleMapStage 108, ShuffleMapStage 79, ShuffleMapStage 58, ShuffleMapStage 29, ResultStage 110) 16/12/27 06:26:46 INFO DAGScheduler: failed: Set() 16/12/27 06:26:46 INFO DAGScheduler: Submitting ShuffleMapStage 61 (MapPartitionsRDD[167] at cache at UsageMetricsPipeline.scala:587), which has no missing parents 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_43 stored as values in memory (estimated size 20.1 KB, free 901.3 MB) 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_43_piece0 stored as bytes in memory (estimated size 9.3 KB, free 901.3 MB) 16/12/27 06:26:46 INFO BlockManagerInfo: Added broadcast_43_piece0 in memory on 10.131.137.96:43778 (size: 9.3 KB, free: 911.6 MB) 16/12/27 06:26:46 INFO SparkContext: Created broadcast 43 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:46 INFO DAGScheduler: Submitting 200 missing tasks from ShuffleMapStage 61 (MapPartitionsRDD[167] at cache at UsageMetricsPipeline.scala:587) 16/12/27 06:26:46 INFO YarnClusterScheduler: Adding task set 61.0 with 200 tasks 16/12/27 06:26:46 INFO DAGScheduler: Submitting ShuffleMapStage 33 (MapPartitionsRDD[41] at cache at UsageMetricsPipeline.scala:810), which has no missing parents 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_44 stored as values in memory (estimated size 19.3 KB, free 901.3 MB) 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_44_piece0 stored as bytes in memory (estimated size 9.0 KB, free 901.2 MB) 16/12/27 06:26:46 INFO BlockManagerInfo: Added broadcast_44_piece0 in memory on 10.131.137.96:43778 (size: 9.0 KB, free: 911.6 MB) 16/12/27 06:26:46 INFO SparkContext: Created broadcast 44 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:46 INFO DAGScheduler: Submitting 200 missing tasks from ShuffleMapStage 33 (MapPartitionsRDD[41] at cache at UsageMetricsPipeline.scala:810) 16/12/27 06:26:46 INFO YarnClusterScheduler: Adding task set 33.0 with 200 tasks 16/12/27 06:26:46 INFO DAGScheduler: Submitting ShuffleMapStage 36 (MapPartitionsRDD[56] at cache at UsageMetricsPipeline.scala:855), which has no missing parents 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_45 stored as values in memory (estimated size 19.3 KB, free 901.2 MB) 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_45_piece0 stored as bytes in memory (estimated size 9.0 KB, free 901.2 MB) 16/12/27 06:26:46 INFO BlockManagerInfo: Added broadcast_45_piece0 in memory on 10.131.137.96:43778 (size: 9.0 KB, free: 911.6 MB) 16/12/27 06:26:46 INFO SparkContext: Created broadcast 45 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:46 INFO DAGScheduler: Submitting 200 missing tasks from ShuffleMapStage 36 (MapPartitionsRDD[56] at cache at UsageMetricsPipeline.scala:855) 16/12/27 06:26:46 INFO YarnClusterScheduler: Adding task set 36.0 with 200 tasks 16/12/27 06:26:46 INFO DAGScheduler: Submitting ShuffleMapStage 40 (MapPartitionsRDD[71] at cache at UsageMetricsPipeline.scala:892), which has no missing parents 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_46 stored as values in memory (estimated size 19.3 KB, free 901.2 MB) 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_46_piece0 stored as bytes in memory (estimated size 9.0 KB, free 901.2 MB) 16/12/27 06:26:46 INFO BlockManagerInfo: Added broadcast_46_piece0 in memory on 10.131.137.96:43778 (size: 9.0 KB, free: 911.6 MB) 16/12/27 06:26:46 INFO SparkContext: Created broadcast 46 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:46 INFO DAGScheduler: Submitting 200 missing tasks from ShuffleMapStage 40 (MapPartitionsRDD[71] at cache at UsageMetricsPipeline.scala:892) 16/12/27 06:26:46 INFO YarnClusterScheduler: Adding task set 40.0 with 200 tasks 16/12/27 06:26:46 INFO DAGScheduler: Submitting ShuffleMapStage 45 (MapPartitionsRDD[87] at cache at UsageMetricsPipeline.scala:714), which has no missing parents 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_47 stored as values in memory (estimated size 19.3 KB, free 901.2 MB) 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_47_piece0 stored as bytes in memory (estimated size 9.0 KB, free 901.2 MB) 16/12/27 06:26:46 INFO BlockManagerInfo: Added broadcast_47_piece0 in memory on 10.131.137.96:43778 (size: 9.0 KB, free: 911.6 MB) 16/12/27 06:26:46 INFO SparkContext: Created broadcast 47 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:46 INFO DAGScheduler: Submitting 200 missing tasks from ShuffleMapStage 45 (MapPartitionsRDD[87] at cache at UsageMetricsPipeline.scala:714) 16/12/27 06:26:46 INFO YarnClusterScheduler: Adding task set 45.0 with 200 tasks 16/12/27 06:26:46 INFO DAGScheduler: Submitting ShuffleMapStage 53 (MapPartitionsRDD[117] at cache at UsageMetricsPipeline.scala:748), which has no missing parents 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_48 stored as values in memory (estimated size 20.1 KB, free 901.1 MB) 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_48_piece0 stored as bytes in memory (estimated size 9.3 KB, free 901.1 MB) 16/12/27 06:26:46 INFO BlockManagerInfo: Added broadcast_48_piece0 in memory on 10.131.137.96:43778 (size: 9.3 KB, free: 911.6 MB) 16/12/27 06:26:46 INFO SparkContext: Created broadcast 48 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:46 INFO DAGScheduler: Submitting 200 missing tasks from ShuffleMapStage 53 (MapPartitionsRDD[117] at cache at UsageMetricsPipeline.scala:748) 16/12/27 06:26:46 INFO YarnClusterScheduler: Adding task set 53.0 with 200 tasks 16/12/27 06:26:46 INFO DAGScheduler: Submitting ShuffleMapStage 58 (MapPartitionsRDD[141] at cache at UsageMetricsPipeline.scala:771), which has no missing parents 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_49 stored as values in memory (estimated size 19.3 KB, free 901.1 MB) 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_49_piece0 stored as bytes in memory (estimated size 9.0 KB, free 901.1 MB) 16/12/27 06:26:46 INFO BlockManagerInfo: Added broadcast_49_piece0 in memory on 10.131.137.96:43778 (size: 9.0 KB, free: 911.6 MB) 16/12/27 06:26:46 INFO SparkContext: Created broadcast 49 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:46 INFO DAGScheduler: Submitting 200 missing tasks from ShuffleMapStage 58 (MapPartitionsRDD[141] at cache at UsageMetricsPipeline.scala:771) 16/12/27 06:26:46 INFO YarnClusterScheduler: Adding task set 58.0 with 200 tasks 16/12/27 06:26:46 INFO DAGScheduler: Submitting ShuffleMapStage 25 (MapPartitionsRDD[183] at cache at UsageMetricsPipeline.scala:482), which has no missing parents 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_50 stored as values in memory (estimated size 20.1 KB, free 901.1 MB) 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_50_piece0 stored as bytes in memory (estimated size 9.3 KB, free 901.1 MB) 16/12/27 06:26:46 INFO BlockManagerInfo: Added broadcast_50_piece0 in memory on 10.131.137.96:43778 (size: 9.3 KB, free: 911.6 MB) 16/12/27 06:26:46 INFO SparkContext: Created broadcast 50 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:46 INFO DAGScheduler: Submitting 200 missing tasks from ShuffleMapStage 25 (MapPartitionsRDD[183] at cache at UsageMetricsPipeline.scala:482) 16/12/27 06:26:46 INFO YarnClusterScheduler: Adding task set 25.0 with 200 tasks 16/12/27 06:26:46 INFO DAGScheduler: Submitting ShuffleMapStage 92 (MapPartitionsRDD[386] at cache at UsageMetricsPipeline.scala:1150), which has no missing parents 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_51 stored as values in memory (estimated size 19.3 KB, free 901.1 MB) 16/12/27 06:26:46 INFO MemoryStore: Block broadcast_51_piece0 stored as bytes in memory (estimated size 9.0 KB, free 901.1 MB) 16/12/27 06:26:46 INFO BlockManagerInfo: Added broadcast_51_piece0 in memory on 10.131.137.96:43778 (size: 9.0 KB, free: 911.6 MB) 16/12/27 06:26:46 INFO SparkContext: Created broadcast 51 from broadcast at DAGScheduler.scala:1012 16/12/27 06:26:46 INFO DAGScheduler: Submitting 200 missing tasks from ShuffleMapStage 92 (MapPartitionsRDD[386] at cache at UsageMetricsPipeline.scala:1150) 16/12/27 06:26:46 INFO YarnClusterScheduler: Adding task set 92.0 with 200 tasks 16/12/27 06:26:49 INFO TaskSetManager: Starting task 42.0 in stage 25.0 (TID 95, kvs-in-merlin12.int.kronos.com, partition 42, NODE_LOCAL, 5222 bytes) 16/12/27 06:26:49 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 95 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:49 INFO TaskSetManager: Finished task 7.0 in stage 26.0 (TID 88) in 10562 ms on kvs-in-merlin12.int.kronos.com (3/15) 16/12/27 06:26:49 INFO BlockManagerInfo: Added broadcast_50_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 9.3 KB, free: 3.0 GB) 16/12/27 06:26:49 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 2 to 10.131.137.77:25722 16/12/27 06:26:49 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 2 is 296 bytes 16/12/27 06:26:49 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 505.3 KB, free: 3.0 GB) 16/12/27 06:26:53 INFO TaskSetManager: Starting task 0.0 in stage 25.0 (TID 96, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:53 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 96 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:53 INFO TaskSetManager: Finished task 2.0 in stage 26.0 (TID 83) in 19511 ms on kvs-in-merlin11.int.kronos.com (4/15) 16/12/27 06:26:53 INFO BlockManagerInfo: Added broadcast_50_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 9.3 KB, free: 3.0 GB) 16/12/27 06:26:54 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 2 to 10.131.137.78:53067 16/12/27 06:26:54 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 505.3 KB, free: 3.0 GB) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 1.0 in stage 25.0 (TID 97, kvs-in-merlin11.int.kronos.com, partition 1, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 97 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 0.0 in stage 25.0 (TID 96) in 429 ms on kvs-in-merlin11.int.kronos.com (1/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_1 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 2.0 in stage 25.0 (TID 98, kvs-in-merlin11.int.kronos.com, partition 2, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 98 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 1.0 in stage 25.0 (TID 97) in 31 ms on kvs-in-merlin11.int.kronos.com (2/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_2 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 3.0 in stage 25.0 (TID 99, kvs-in-merlin11.int.kronos.com, partition 3, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 99 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 2.0 in stage 25.0 (TID 98) in 28 ms on kvs-in-merlin11.int.kronos.com (3/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_3 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 4.0 in stage 25.0 (TID 100, kvs-in-merlin11.int.kronos.com, partition 4, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 100 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 3.0 in stage 25.0 (TID 99) in 30 ms on kvs-in-merlin11.int.kronos.com (4/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_4 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 5.0 in stage 25.0 (TID 101, kvs-in-merlin11.int.kronos.com, partition 5, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 101 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 4.0 in stage 25.0 (TID 100) in 32 ms on kvs-in-merlin11.int.kronos.com (5/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_5 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 6.0 in stage 25.0 (TID 102, kvs-in-merlin11.int.kronos.com, partition 6, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 102 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 5.0 in stage 25.0 (TID 101) in 32 ms on kvs-in-merlin11.int.kronos.com (6/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_6 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 7.0 in stage 25.0 (TID 103, kvs-in-merlin11.int.kronos.com, partition 7, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 103 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 6.0 in stage 25.0 (TID 102) in 34 ms on kvs-in-merlin11.int.kronos.com (7/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_7 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 8.0 in stage 25.0 (TID 104, kvs-in-merlin11.int.kronos.com, partition 8, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 104 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 7.0 in stage 25.0 (TID 103) in 36 ms on kvs-in-merlin11.int.kronos.com (8/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_8 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 9.0 in stage 25.0 (TID 105, kvs-in-merlin11.int.kronos.com, partition 9, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 105 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 8.0 in stage 25.0 (TID 104) in 33 ms on kvs-in-merlin11.int.kronos.com (9/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_9 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 10.0 in stage 25.0 (TID 106, kvs-in-merlin11.int.kronos.com, partition 10, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 106 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 9.0 in stage 25.0 (TID 105) in 35 ms on kvs-in-merlin11.int.kronos.com (10/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_10 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 11.0 in stage 25.0 (TID 107, kvs-in-merlin11.int.kronos.com, partition 11, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 107 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 10.0 in stage 25.0 (TID 106) in 78 ms on kvs-in-merlin11.int.kronos.com (11/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_11 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 12.0 in stage 25.0 (TID 108, kvs-in-merlin11.int.kronos.com, partition 12, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 108 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 11.0 in stage 25.0 (TID 107) in 30 ms on kvs-in-merlin11.int.kronos.com (12/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_12 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 13.0 in stage 25.0 (TID 109, kvs-in-merlin11.int.kronos.com, partition 13, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 109 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 12.0 in stage 25.0 (TID 108) in 33 ms on kvs-in-merlin11.int.kronos.com (13/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_13 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 14.0 in stage 25.0 (TID 110, kvs-in-merlin11.int.kronos.com, partition 14, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 110 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 13.0 in stage 25.0 (TID 109) in 33 ms on kvs-in-merlin11.int.kronos.com (14/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_14 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 15.0 in stage 25.0 (TID 111, kvs-in-merlin11.int.kronos.com, partition 15, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 111 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 14.0 in stage 25.0 (TID 110) in 33 ms on kvs-in-merlin11.int.kronos.com (15/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_15 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 16.0 in stage 25.0 (TID 112, kvs-in-merlin11.int.kronos.com, partition 16, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 112 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 15.0 in stage 25.0 (TID 111) in 30 ms on kvs-in-merlin11.int.kronos.com (16/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_16 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 17.0 in stage 25.0 (TID 113, kvs-in-merlin11.int.kronos.com, partition 17, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 113 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 16.0 in stage 25.0 (TID 112) in 47 ms on kvs-in-merlin11.int.kronos.com (17/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_17 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 18.0 in stage 25.0 (TID 114, kvs-in-merlin11.int.kronos.com, partition 18, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 114 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 17.0 in stage 25.0 (TID 113) in 30 ms on kvs-in-merlin11.int.kronos.com (18/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_18 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:54 INFO TaskSetManager: Starting task 19.0 in stage 25.0 (TID 115, kvs-in-merlin11.int.kronos.com, partition 19, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 115 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:54 INFO TaskSetManager: Finished task 18.0 in stage 25.0 (TID 114) in 29 ms on kvs-in-merlin11.int.kronos.com (19/200) 16/12/27 06:26:54 INFO BlockManagerInfo: Added rdd_33_19 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 20.0 in stage 25.0 (TID 116, kvs-in-merlin11.int.kronos.com, partition 20, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 116 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 19.0 in stage 25.0 (TID 115) in 25 ms on kvs-in-merlin11.int.kronos.com (20/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_20 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 21.0 in stage 25.0 (TID 117, kvs-in-merlin11.int.kronos.com, partition 21, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 117 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 20.0 in stage 25.0 (TID 116) in 29 ms on kvs-in-merlin11.int.kronos.com (21/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_21 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 22.0 in stage 25.0 (TID 118, kvs-in-merlin11.int.kronos.com, partition 22, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 118 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 21.0 in stage 25.0 (TID 117) in 27 ms on kvs-in-merlin11.int.kronos.com (22/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_22 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 23.0 in stage 25.0 (TID 119, kvs-in-merlin11.int.kronos.com, partition 23, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 119 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 22.0 in stage 25.0 (TID 118) in 30 ms on kvs-in-merlin11.int.kronos.com (23/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_23 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 24.0 in stage 25.0 (TID 120, kvs-in-merlin11.int.kronos.com, partition 24, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 120 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 23.0 in stage 25.0 (TID 119) in 31 ms on kvs-in-merlin11.int.kronos.com (24/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_24 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 25.0 in stage 25.0 (TID 121, kvs-in-merlin11.int.kronos.com, partition 25, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 121 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 24.0 in stage 25.0 (TID 120) in 28 ms on kvs-in-merlin11.int.kronos.com (25/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_25 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 26.0 in stage 25.0 (TID 122, kvs-in-merlin11.int.kronos.com, partition 26, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 122 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 25.0 in stage 25.0 (TID 121) in 31 ms on kvs-in-merlin11.int.kronos.com (26/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_26 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 27.0 in stage 25.0 (TID 123, kvs-in-merlin11.int.kronos.com, partition 27, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 123 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 26.0 in stage 25.0 (TID 122) in 32 ms on kvs-in-merlin11.int.kronos.com (27/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_27 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 28.0 in stage 25.0 (TID 124, kvs-in-merlin11.int.kronos.com, partition 28, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 124 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 27.0 in stage 25.0 (TID 123) in 31 ms on kvs-in-merlin11.int.kronos.com (28/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_28 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 29.0 in stage 25.0 (TID 125, kvs-in-merlin11.int.kronos.com, partition 29, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 125 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 28.0 in stage 25.0 (TID 124) in 28 ms on kvs-in-merlin11.int.kronos.com (29/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_29 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 30.0 in stage 25.0 (TID 126, kvs-in-merlin11.int.kronos.com, partition 30, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 126 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 29.0 in stage 25.0 (TID 125) in 30 ms on kvs-in-merlin11.int.kronos.com (30/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_30 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 31.0 in stage 25.0 (TID 127, kvs-in-merlin11.int.kronos.com, partition 31, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 127 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 30.0 in stage 25.0 (TID 126) in 30 ms on kvs-in-merlin11.int.kronos.com (31/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_31 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 32.0 in stage 25.0 (TID 128, kvs-in-merlin11.int.kronos.com, partition 32, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 128 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 31.0 in stage 25.0 (TID 127) in 28 ms on kvs-in-merlin11.int.kronos.com (32/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_32 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 33.0 in stage 25.0 (TID 129, kvs-in-merlin11.int.kronos.com, partition 33, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 129 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 32.0 in stage 25.0 (TID 128) in 37 ms on kvs-in-merlin11.int.kronos.com (33/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_33 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 34.0 in stage 25.0 (TID 130, kvs-in-merlin11.int.kronos.com, partition 34, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 130 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 33.0 in stage 25.0 (TID 129) in 33 ms on kvs-in-merlin11.int.kronos.com (34/200) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 35.0 in stage 25.0 (TID 131, kvs-in-merlin12.int.kronos.com, partition 35, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 131 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 5.0 in stage 26.0 (TID 86) in 16901 ms on kvs-in-merlin12.int.kronos.com (5/15) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_34 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_35 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 36.0 in stage 25.0 (TID 132, kvs-in-merlin11.int.kronos.com, partition 36, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 132 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 34.0 in stage 25.0 (TID 130) in 41 ms on kvs-in-merlin11.int.kronos.com (35/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_36 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 37.0 in stage 25.0 (TID 133, kvs-in-merlin11.int.kronos.com, partition 37, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 133 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 36.0 in stage 25.0 (TID 132) in 31 ms on kvs-in-merlin11.int.kronos.com (36/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_37 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 38.0 in stage 25.0 (TID 134, kvs-in-merlin11.int.kronos.com, partition 38, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 134 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 37.0 in stage 25.0 (TID 133) in 31 ms on kvs-in-merlin11.int.kronos.com (37/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_38 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 39.0 in stage 25.0 (TID 135, kvs-in-merlin11.int.kronos.com, partition 39, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 135 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 38.0 in stage 25.0 (TID 134) in 29 ms on kvs-in-merlin11.int.kronos.com (38/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_39 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 40.0 in stage 25.0 (TID 136, kvs-in-merlin11.int.kronos.com, partition 40, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 136 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 39.0 in stage 25.0 (TID 135) in 29 ms on kvs-in-merlin11.int.kronos.com (39/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_40 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 41.0 in stage 25.0 (TID 137, kvs-in-merlin11.int.kronos.com, partition 41, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 137 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 40.0 in stage 25.0 (TID 136) in 34 ms on kvs-in-merlin11.int.kronos.com (40/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_41 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 43.0 in stage 25.0 (TID 138, kvs-in-merlin11.int.kronos.com, partition 43, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 138 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 41.0 in stage 25.0 (TID 137) in 36 ms on kvs-in-merlin11.int.kronos.com (41/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_43 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 44.0 in stage 25.0 (TID 139, kvs-in-merlin11.int.kronos.com, partition 44, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 139 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 43.0 in stage 25.0 (TID 138) in 36 ms on kvs-in-merlin11.int.kronos.com (42/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_44 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 45.0 in stage 25.0 (TID 140, kvs-in-merlin12.int.kronos.com, partition 45, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 140 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 35.0 in stage 25.0 (TID 131) in 281 ms on kvs-in-merlin12.int.kronos.com (43/200) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 46.0 in stage 25.0 (TID 141, kvs-in-merlin11.int.kronos.com, partition 46, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 141 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 44.0 in stage 25.0 (TID 139) in 36 ms on kvs-in-merlin11.int.kronos.com (44/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_45 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_46 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 47.0 in stage 25.0 (TID 142, kvs-in-merlin11.int.kronos.com, partition 47, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 142 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 46.0 in stage 25.0 (TID 141) in 33 ms on kvs-in-merlin11.int.kronos.com (45/200) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 48.0 in stage 25.0 (TID 143, kvs-in-merlin12.int.kronos.com, partition 48, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 143 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 45.0 in stage 25.0 (TID 140) in 47 ms on kvs-in-merlin12.int.kronos.com (46/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_47 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_48 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 49.0 in stage 25.0 (TID 144, kvs-in-merlin11.int.kronos.com, partition 49, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 144 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 47.0 in stage 25.0 (TID 142) in 35 ms on kvs-in-merlin11.int.kronos.com (47/200) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 50.0 in stage 25.0 (TID 145, kvs-in-merlin12.int.kronos.com, partition 50, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 145 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 48.0 in stage 25.0 (TID 143) in 45 ms on kvs-in-merlin12.int.kronos.com (48/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_49 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_50 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 51.0 in stage 25.0 (TID 146, kvs-in-merlin11.int.kronos.com, partition 51, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 146 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 49.0 in stage 25.0 (TID 144) in 37 ms on kvs-in-merlin11.int.kronos.com (49/200) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 52.0 in stage 25.0 (TID 147, kvs-in-merlin12.int.kronos.com, partition 52, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 147 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 50.0 in stage 25.0 (TID 145) in 37 ms on kvs-in-merlin12.int.kronos.com (50/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_51 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 53.0 in stage 25.0 (TID 148, kvs-in-merlin11.int.kronos.com, partition 53, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 148 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 51.0 in stage 25.0 (TID 146) in 31 ms on kvs-in-merlin11.int.kronos.com (51/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_52 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_53 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 54.0 in stage 25.0 (TID 149, kvs-in-merlin12.int.kronos.com, partition 54, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 149 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 52.0 in stage 25.0 (TID 147) in 40 ms on kvs-in-merlin12.int.kronos.com (52/200) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 55.0 in stage 25.0 (TID 150, kvs-in-merlin11.int.kronos.com, partition 55, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 150 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 53.0 in stage 25.0 (TID 148) in 33 ms on kvs-in-merlin11.int.kronos.com (53/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_54 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_55 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 56.0 in stage 25.0 (TID 151, kvs-in-merlin11.int.kronos.com, partition 56, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 151 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 55.0 in stage 25.0 (TID 150) in 28 ms on kvs-in-merlin11.int.kronos.com (54/200) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 57.0 in stage 25.0 (TID 152, kvs-in-merlin12.int.kronos.com, partition 57, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 152 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 54.0 in stage 25.0 (TID 149) in 42 ms on kvs-in-merlin12.int.kronos.com (55/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_56 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_57 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 58.0 in stage 25.0 (TID 153, kvs-in-merlin11.int.kronos.com, partition 58, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 153 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 56.0 in stage 25.0 (TID 151) in 30 ms on kvs-in-merlin11.int.kronos.com (56/200) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 59.0 in stage 25.0 (TID 154, kvs-in-merlin12.int.kronos.com, partition 59, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 154 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_58 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Finished task 57.0 in stage 25.0 (TID 152) in 45 ms on kvs-in-merlin12.int.kronos.com (57/200) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 60.0 in stage 25.0 (TID 155, kvs-in-merlin11.int.kronos.com, partition 60, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 155 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 58.0 in stage 25.0 (TID 153) in 32 ms on kvs-in-merlin11.int.kronos.com (58/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_59 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_60 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 61.0 in stage 25.0 (TID 156, kvs-in-merlin12.int.kronos.com, partition 61, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 156 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 59.0 in stage 25.0 (TID 154) in 38 ms on kvs-in-merlin12.int.kronos.com (59/200) 16/12/27 06:26:55 INFO TaskSetManager: Starting task 62.0 in stage 25.0 (TID 157, kvs-in-merlin11.int.kronos.com, partition 62, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 157 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:55 INFO TaskSetManager: Finished task 60.0 in stage 25.0 (TID 155) in 29 ms on kvs-in-merlin11.int.kronos.com (60/200) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_61 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:55 INFO BlockManagerInfo: Added rdd_33_62 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 63.0 in stage 25.0 (TID 158, kvs-in-merlin11.int.kronos.com, partition 63, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 158 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 62.0 in stage 25.0 (TID 157) in 26 ms on kvs-in-merlin11.int.kronos.com (61/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 64.0 in stage 25.0 (TID 159, kvs-in-merlin12.int.kronos.com, partition 64, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 159 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 61.0 in stage 25.0 (TID 156) in 33 ms on kvs-in-merlin12.int.kronos.com (62/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_63 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_64 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 65.0 in stage 25.0 (TID 160, kvs-in-merlin11.int.kronos.com, partition 65, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 160 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 63.0 in stage 25.0 (TID 158) in 28 ms on kvs-in-merlin11.int.kronos.com (63/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 66.0 in stage 25.0 (TID 161, kvs-in-merlin12.int.kronos.com, partition 66, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 161 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 64.0 in stage 25.0 (TID 159) in 38 ms on kvs-in-merlin12.int.kronos.com (64/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_65 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 67.0 in stage 25.0 (TID 162, kvs-in-merlin11.int.kronos.com, partition 67, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 162 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 65.0 in stage 25.0 (TID 160) in 32 ms on kvs-in-merlin11.int.kronos.com (65/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_66 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_67 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 68.0 in stage 25.0 (TID 163, kvs-in-merlin11.int.kronos.com, partition 68, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 163 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 67.0 in stage 25.0 (TID 162) in 34 ms on kvs-in-merlin11.int.kronos.com (66/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 69.0 in stage 25.0 (TID 164, kvs-in-merlin12.int.kronos.com, partition 69, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 164 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 66.0 in stage 25.0 (TID 161) in 61 ms on kvs-in-merlin12.int.kronos.com (67/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_68 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 70.0 in stage 25.0 (TID 165, kvs-in-merlin11.int.kronos.com, partition 70, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 165 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 68.0 in stage 25.0 (TID 163) in 26 ms on kvs-in-merlin11.int.kronos.com (68/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_69 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 71.0 in stage 25.0 (TID 166, kvs-in-merlin12.int.kronos.com, partition 71, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 166 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 69.0 in stage 25.0 (TID 164) in 35 ms on kvs-in-merlin12.int.kronos.com (69/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_70 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 72.0 in stage 25.0 (TID 167, kvs-in-merlin11.int.kronos.com, partition 72, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 167 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 70.0 in stage 25.0 (TID 165) in 31 ms on kvs-in-merlin11.int.kronos.com (70/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_71 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_72 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 73.0 in stage 25.0 (TID 168, kvs-in-merlin12.int.kronos.com, partition 73, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 168 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 71.0 in stage 25.0 (TID 166) in 35 ms on kvs-in-merlin12.int.kronos.com (71/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 74.0 in stage 25.0 (TID 169, kvs-in-merlin11.int.kronos.com, partition 74, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 169 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 72.0 in stage 25.0 (TID 167) in 27 ms on kvs-in-merlin11.int.kronos.com (72/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_73 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_74 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 75.0 in stage 25.0 (TID 170, kvs-in-merlin12.int.kronos.com, partition 75, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 170 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 73.0 in stage 25.0 (TID 168) in 31 ms on kvs-in-merlin12.int.kronos.com (73/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 76.0 in stage 25.0 (TID 171, kvs-in-merlin11.int.kronos.com, partition 76, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 171 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 74.0 in stage 25.0 (TID 169) in 28 ms on kvs-in-merlin11.int.kronos.com (74/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_75 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_76 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 77.0 in stage 25.0 (TID 172, kvs-in-merlin11.int.kronos.com, partition 77, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 172 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Starting task 78.0 in stage 25.0 (TID 173, kvs-in-merlin12.int.kronos.com, partition 78, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 173 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 76.0 in stage 25.0 (TID 171) in 31 ms on kvs-in-merlin11.int.kronos.com (75/200) 16/12/27 06:26:56 INFO TaskSetManager: Finished task 75.0 in stage 25.0 (TID 170) in 33 ms on kvs-in-merlin12.int.kronos.com (76/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_77 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_78 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 79.0 in stage 25.0 (TID 174, kvs-in-merlin11.int.kronos.com, partition 79, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 174 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 77.0 in stage 25.0 (TID 172) in 29 ms on kvs-in-merlin11.int.kronos.com (77/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 80.0 in stage 25.0 (TID 175, kvs-in-merlin12.int.kronos.com, partition 80, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 175 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 78.0 in stage 25.0 (TID 173) in 36 ms on kvs-in-merlin12.int.kronos.com (78/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_79 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 81.0 in stage 25.0 (TID 176, kvs-in-merlin11.int.kronos.com, partition 81, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 176 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 79.0 in stage 25.0 (TID 174) in 27 ms on kvs-in-merlin11.int.kronos.com (79/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_80 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_81 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 82.0 in stage 25.0 (TID 177, kvs-in-merlin12.int.kronos.com, partition 82, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 177 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 80.0 in stage 25.0 (TID 175) in 33 ms on kvs-in-merlin12.int.kronos.com (80/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 83.0 in stage 25.0 (TID 178, kvs-in-merlin11.int.kronos.com, partition 83, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 178 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 81.0 in stage 25.0 (TID 176) in 29 ms on kvs-in-merlin11.int.kronos.com (81/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_82 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 84.0 in stage 25.0 (TID 179, kvs-in-merlin12.int.kronos.com, partition 84, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 179 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 82.0 in stage 25.0 (TID 177) in 34 ms on kvs-in-merlin12.int.kronos.com (82/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_83 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 85.0 in stage 25.0 (TID 180, kvs-in-merlin11.int.kronos.com, partition 85, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 180 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 83.0 in stage 25.0 (TID 178) in 35 ms on kvs-in-merlin11.int.kronos.com (83/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_84 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_85 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 86.0 in stage 25.0 (TID 181, kvs-in-merlin12.int.kronos.com, partition 86, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 181 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 84.0 in stage 25.0 (TID 179) in 42 ms on kvs-in-merlin12.int.kronos.com (84/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 87.0 in stage 25.0 (TID 182, kvs-in-merlin11.int.kronos.com, partition 87, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 182 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 85.0 in stage 25.0 (TID 180) in 33 ms on kvs-in-merlin11.int.kronos.com (85/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_86 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_87 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 88.0 in stage 25.0 (TID 183, kvs-in-merlin12.int.kronos.com, partition 88, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 183 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 86.0 in stage 25.0 (TID 181) in 34 ms on kvs-in-merlin12.int.kronos.com (86/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 89.0 in stage 25.0 (TID 184, kvs-in-merlin11.int.kronos.com, partition 89, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 184 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 87.0 in stage 25.0 (TID 182) in 32 ms on kvs-in-merlin11.int.kronos.com (87/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_88 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_89 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 90.0 in stage 25.0 (TID 185, kvs-in-merlin11.int.kronos.com, partition 90, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 185 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 89.0 in stage 25.0 (TID 184) in 29 ms on kvs-in-merlin11.int.kronos.com (88/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 91.0 in stage 25.0 (TID 186, kvs-in-merlin12.int.kronos.com, partition 91, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 186 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 88.0 in stage 25.0 (TID 183) in 33 ms on kvs-in-merlin12.int.kronos.com (89/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_91 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_90 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 92.0 in stage 25.0 (TID 187, kvs-in-merlin11.int.kronos.com, partition 92, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 187 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 90.0 in stage 25.0 (TID 185) in 30 ms on kvs-in-merlin11.int.kronos.com (90/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 93.0 in stage 25.0 (TID 188, kvs-in-merlin12.int.kronos.com, partition 93, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 188 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 91.0 in stage 25.0 (TID 186) in 29 ms on kvs-in-merlin12.int.kronos.com (91/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_92 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_93 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 94.0 in stage 25.0 (TID 189, kvs-in-merlin11.int.kronos.com, partition 94, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 189 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 92.0 in stage 25.0 (TID 187) in 30 ms on kvs-in-merlin11.int.kronos.com (92/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 95.0 in stage 25.0 (TID 190, kvs-in-merlin12.int.kronos.com, partition 95, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 190 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 93.0 in stage 25.0 (TID 188) in 34 ms on kvs-in-merlin12.int.kronos.com (93/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_94 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_95 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 96.0 in stage 25.0 (TID 191, kvs-in-merlin11.int.kronos.com, partition 96, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 191 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 94.0 in stage 25.0 (TID 189) in 29 ms on kvs-in-merlin11.int.kronos.com (94/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 97.0 in stage 25.0 (TID 192, kvs-in-merlin12.int.kronos.com, partition 97, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 192 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 95.0 in stage 25.0 (TID 190) in 31 ms on kvs-in-merlin12.int.kronos.com (95/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_96 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 98.0 in stage 25.0 (TID 193, kvs-in-merlin11.int.kronos.com, partition 98, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 193 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 96.0 in stage 25.0 (TID 191) in 26 ms on kvs-in-merlin11.int.kronos.com (96/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_97 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 99.0 in stage 25.0 (TID 194, kvs-in-merlin12.int.kronos.com, partition 99, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 194 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 97.0 in stage 25.0 (TID 192) in 35 ms on kvs-in-merlin12.int.kronos.com (97/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_98 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 100.0 in stage 25.0 (TID 195, kvs-in-merlin11.int.kronos.com, partition 100, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 195 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 98.0 in stage 25.0 (TID 193) in 33 ms on kvs-in-merlin11.int.kronos.com (98/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_99 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_100 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 101.0 in stage 25.0 (TID 196, kvs-in-merlin12.int.kronos.com, partition 101, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 196 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 99.0 in stage 25.0 (TID 194) in 39 ms on kvs-in-merlin12.int.kronos.com (99/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 102.0 in stage 25.0 (TID 197, kvs-in-merlin11.int.kronos.com, partition 102, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 197 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 100.0 in stage 25.0 (TID 195) in 35 ms on kvs-in-merlin11.int.kronos.com (100/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_101 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_102 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 103.0 in stage 25.0 (TID 198, kvs-in-merlin12.int.kronos.com, partition 103, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 198 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 101.0 in stage 25.0 (TID 196) in 32 ms on kvs-in-merlin12.int.kronos.com (101/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 104.0 in stage 25.0 (TID 199, kvs-in-merlin11.int.kronos.com, partition 104, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 199 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 102.0 in stage 25.0 (TID 197) in 32 ms on kvs-in-merlin11.int.kronos.com (102/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_103 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_104 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_42 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 57.9 MB, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 105.0 in stage 25.0 (TID 200, kvs-in-merlin12.int.kronos.com, partition 105, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 200 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 103.0 in stage 25.0 (TID 198) in 33 ms on kvs-in-merlin12.int.kronos.com (103/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 106.0 in stage 25.0 (TID 201, kvs-in-merlin11.int.kronos.com, partition 106, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 201 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 104.0 in stage 25.0 (TID 199) in 31 ms on kvs-in-merlin11.int.kronos.com (104/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_105 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_106 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 107.0 in stage 25.0 (TID 202, kvs-in-merlin12.int.kronos.com, partition 107, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 202 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 105.0 in stage 25.0 (TID 200) in 34 ms on kvs-in-merlin12.int.kronos.com (105/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 108.0 in stage 25.0 (TID 203, kvs-in-merlin11.int.kronos.com, partition 108, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 203 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 106.0 in stage 25.0 (TID 201) in 30 ms on kvs-in-merlin11.int.kronos.com (106/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_107 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_108 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 109.0 in stage 25.0 (TID 204, kvs-in-merlin12.int.kronos.com, partition 109, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 204 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 107.0 in stage 25.0 (TID 202) in 31 ms on kvs-in-merlin12.int.kronos.com (107/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 110.0 in stage 25.0 (TID 205, kvs-in-merlin11.int.kronos.com, partition 110, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 205 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 108.0 in stage 25.0 (TID 203) in 30 ms on kvs-in-merlin11.int.kronos.com (108/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_109 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_110 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 111.0 in stage 25.0 (TID 206, kvs-in-merlin12.int.kronos.com, partition 111, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 206 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 109.0 in stage 25.0 (TID 204) in 34 ms on kvs-in-merlin12.int.kronos.com (109/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 112.0 in stage 25.0 (TID 207, kvs-in-merlin11.int.kronos.com, partition 112, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 207 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 110.0 in stage 25.0 (TID 205) in 32 ms on kvs-in-merlin11.int.kronos.com (110/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_111 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_112 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 113.0 in stage 25.0 (TID 208, kvs-in-merlin12.int.kronos.com, partition 113, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 208 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 111.0 in stage 25.0 (TID 206) in 36 ms on kvs-in-merlin12.int.kronos.com (111/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 114.0 in stage 25.0 (TID 209, kvs-in-merlin11.int.kronos.com, partition 114, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 209 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 112.0 in stage 25.0 (TID 207) in 34 ms on kvs-in-merlin11.int.kronos.com (112/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_114 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_113 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 115.0 in stage 25.0 (TID 210, kvs-in-merlin11.int.kronos.com, partition 115, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 210 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 114.0 in stage 25.0 (TID 209) in 29 ms on kvs-in-merlin11.int.kronos.com (113/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 116.0 in stage 25.0 (TID 211, kvs-in-merlin12.int.kronos.com, partition 116, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 211 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 113.0 in stage 25.0 (TID 208) in 32 ms on kvs-in-merlin12.int.kronos.com (114/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_115 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_116 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 117.0 in stage 25.0 (TID 212, kvs-in-merlin11.int.kronos.com, partition 117, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 212 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 115.0 in stage 25.0 (TID 210) in 31 ms on kvs-in-merlin11.int.kronos.com (115/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 118.0 in stage 25.0 (TID 213, kvs-in-merlin12.int.kronos.com, partition 118, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 213 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 116.0 in stage 25.0 (TID 211) in 31 ms on kvs-in-merlin12.int.kronos.com (116/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_117 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_118 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 119.0 in stage 25.0 (TID 214, kvs-in-merlin11.int.kronos.com, partition 119, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 214 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 117.0 in stage 25.0 (TID 212) in 29 ms on kvs-in-merlin11.int.kronos.com (117/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 120.0 in stage 25.0 (TID 215, kvs-in-merlin12.int.kronos.com, partition 120, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 215 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 118.0 in stage 25.0 (TID 213) in 29 ms on kvs-in-merlin12.int.kronos.com (118/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_119 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_120 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 121.0 in stage 25.0 (TID 216, kvs-in-merlin11.int.kronos.com, partition 121, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 216 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 119.0 in stage 25.0 (TID 214) in 30 ms on kvs-in-merlin11.int.kronos.com (119/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 122.0 in stage 25.0 (TID 217, kvs-in-merlin12.int.kronos.com, partition 122, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 217 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 120.0 in stage 25.0 (TID 215) in 36 ms on kvs-in-merlin12.int.kronos.com (120/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_121 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_122 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 123.0 in stage 25.0 (TID 218, kvs-in-merlin11.int.kronos.com, partition 123, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 218 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 121.0 in stage 25.0 (TID 216) in 31 ms on kvs-in-merlin11.int.kronos.com (121/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 124.0 in stage 25.0 (TID 219, kvs-in-merlin12.int.kronos.com, partition 124, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 219 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 122.0 in stage 25.0 (TID 217) in 32 ms on kvs-in-merlin12.int.kronos.com (122/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_123 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_124 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 125.0 in stage 25.0 (TID 220, kvs-in-merlin11.int.kronos.com, partition 125, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 220 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 123.0 in stage 25.0 (TID 218) in 31 ms on kvs-in-merlin11.int.kronos.com (123/200) 16/12/27 06:26:56 INFO TaskSetManager: Starting task 126.0 in stage 25.0 (TID 221, kvs-in-merlin12.int.kronos.com, partition 126, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 221 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:56 INFO TaskSetManager: Finished task 124.0 in stage 25.0 (TID 219) in 33 ms on kvs-in-merlin12.int.kronos.com (124/200) 16/12/27 06:26:56 INFO BlockManagerInfo: Added rdd_33_125 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 127.0 in stage 25.0 (TID 222, kvs-in-merlin11.int.kronos.com, partition 127, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 222 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_126 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Finished task 125.0 in stage 25.0 (TID 220) in 34 ms on kvs-in-merlin11.int.kronos.com (125/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 128.0 in stage 25.0 (TID 223, kvs-in-merlin12.int.kronos.com, partition 128, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 223 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 126.0 in stage 25.0 (TID 221) in 40 ms on kvs-in-merlin12.int.kronos.com (126/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_127 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 129.0 in stage 25.0 (TID 224, kvs-in-merlin11.int.kronos.com, partition 129, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 224 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 127.0 in stage 25.0 (TID 222) in 36 ms on kvs-in-merlin11.int.kronos.com (127/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_128 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 130.0 in stage 25.0 (TID 225, kvs-in-merlin12.int.kronos.com, partition 130, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 225 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 128.0 in stage 25.0 (TID 223) in 35 ms on kvs-in-merlin12.int.kronos.com (128/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_129 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 131.0 in stage 25.0 (TID 226, kvs-in-merlin11.int.kronos.com, partition 131, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 226 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 129.0 in stage 25.0 (TID 224) in 29 ms on kvs-in-merlin11.int.kronos.com (129/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_130 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_131 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 132.0 in stage 25.0 (TID 227, kvs-in-merlin12.int.kronos.com, partition 132, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 227 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 130.0 in stage 25.0 (TID 225) in 34 ms on kvs-in-merlin12.int.kronos.com (130/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 133.0 in stage 25.0 (TID 228, kvs-in-merlin11.int.kronos.com, partition 133, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 228 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 131.0 in stage 25.0 (TID 226) in 30 ms on kvs-in-merlin11.int.kronos.com (131/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_132 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_133 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 134.0 in stage 25.0 (TID 229, kvs-in-merlin12.int.kronos.com, partition 134, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 229 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 132.0 in stage 25.0 (TID 227) in 33 ms on kvs-in-merlin12.int.kronos.com (132/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 135.0 in stage 25.0 (TID 230, kvs-in-merlin11.int.kronos.com, partition 135, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 230 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 133.0 in stage 25.0 (TID 228) in 33 ms on kvs-in-merlin11.int.kronos.com (133/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_134 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_135 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 136.0 in stage 25.0 (TID 231, kvs-in-merlin12.int.kronos.com, partition 136, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 231 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 134.0 in stage 25.0 (TID 229) in 30 ms on kvs-in-merlin12.int.kronos.com (134/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 137.0 in stage 25.0 (TID 232, kvs-in-merlin11.int.kronos.com, partition 137, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 232 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 135.0 in stage 25.0 (TID 230) in 29 ms on kvs-in-merlin11.int.kronos.com (135/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_136 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_137 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 138.0 in stage 25.0 (TID 233, kvs-in-merlin12.int.kronos.com, partition 138, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 233 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 136.0 in stage 25.0 (TID 231) in 30 ms on kvs-in-merlin12.int.kronos.com (136/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 139.0 in stage 25.0 (TID 234, kvs-in-merlin11.int.kronos.com, partition 139, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 234 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 137.0 in stage 25.0 (TID 232) in 30 ms on kvs-in-merlin11.int.kronos.com (137/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_138 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_139 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 140.0 in stage 25.0 (TID 235, kvs-in-merlin12.int.kronos.com, partition 140, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 235 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 138.0 in stage 25.0 (TID 233) in 28 ms on kvs-in-merlin12.int.kronos.com (138/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 141.0 in stage 25.0 (TID 236, kvs-in-merlin11.int.kronos.com, partition 141, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 236 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 139.0 in stage 25.0 (TID 234) in 33 ms on kvs-in-merlin11.int.kronos.com (139/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_140 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_141 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 142.0 in stage 25.0 (TID 237, kvs-in-merlin12.int.kronos.com, partition 142, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 237 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 140.0 in stage 25.0 (TID 235) in 28 ms on kvs-in-merlin12.int.kronos.com (140/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 143.0 in stage 25.0 (TID 238, kvs-in-merlin11.int.kronos.com, partition 143, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 238 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 141.0 in stage 25.0 (TID 236) in 29 ms on kvs-in-merlin11.int.kronos.com (141/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_142 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_143 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 144.0 in stage 25.0 (TID 239, kvs-in-merlin12.int.kronos.com, partition 144, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 239 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 142.0 in stage 25.0 (TID 237) in 32 ms on kvs-in-merlin12.int.kronos.com (142/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 145.0 in stage 25.0 (TID 240, kvs-in-merlin11.int.kronos.com, partition 145, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 240 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 143.0 in stage 25.0 (TID 238) in 28 ms on kvs-in-merlin11.int.kronos.com (143/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_144 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_145 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 146.0 in stage 25.0 (TID 241, kvs-in-merlin11.int.kronos.com, partition 146, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 241 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 145.0 in stage 25.0 (TID 240) in 27 ms on kvs-in-merlin11.int.kronos.com (144/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 147.0 in stage 25.0 (TID 242, kvs-in-merlin12.int.kronos.com, partition 147, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 242 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 144.0 in stage 25.0 (TID 239) in 33 ms on kvs-in-merlin12.int.kronos.com (145/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_146 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_147 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 148.0 in stage 25.0 (TID 243, kvs-in-merlin11.int.kronos.com, partition 148, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 243 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 146.0 in stage 25.0 (TID 241) in 26 ms on kvs-in-merlin11.int.kronos.com (146/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 149.0 in stage 25.0 (TID 244, kvs-in-merlin12.int.kronos.com, partition 149, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 244 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 147.0 in stage 25.0 (TID 242) in 32 ms on kvs-in-merlin12.int.kronos.com (147/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_148 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_149 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 150.0 in stage 25.0 (TID 245, kvs-in-merlin11.int.kronos.com, partition 150, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 245 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 148.0 in stage 25.0 (TID 243) in 29 ms on kvs-in-merlin11.int.kronos.com (148/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 151.0 in stage 25.0 (TID 246, kvs-in-merlin12.int.kronos.com, partition 151, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 246 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 149.0 in stage 25.0 (TID 244) in 32 ms on kvs-in-merlin12.int.kronos.com (149/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_150 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 152.0 in stage 25.0 (TID 247, kvs-in-merlin11.int.kronos.com, partition 152, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 247 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 150.0 in stage 25.0 (TID 245) in 28 ms on kvs-in-merlin11.int.kronos.com (150/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_151 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 153.0 in stage 25.0 (TID 248, kvs-in-merlin12.int.kronos.com, partition 153, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 248 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 151.0 in stage 25.0 (TID 246) in 32 ms on kvs-in-merlin12.int.kronos.com (151/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_152 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 154.0 in stage 25.0 (TID 249, kvs-in-merlin11.int.kronos.com, partition 154, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 249 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 152.0 in stage 25.0 (TID 247) in 30 ms on kvs-in-merlin11.int.kronos.com (152/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_153 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_154 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 155.0 in stage 25.0 (TID 250, kvs-in-merlin12.int.kronos.com, partition 155, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 250 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 153.0 in stage 25.0 (TID 248) in 39 ms on kvs-in-merlin12.int.kronos.com (153/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 156.0 in stage 25.0 (TID 251, kvs-in-merlin11.int.kronos.com, partition 156, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 251 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 154.0 in stage 25.0 (TID 249) in 28 ms on kvs-in-merlin11.int.kronos.com (154/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_156 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_155 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 157.0 in stage 25.0 (TID 252, kvs-in-merlin11.int.kronos.com, partition 157, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 252 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 156.0 in stage 25.0 (TID 251) in 25 ms on kvs-in-merlin11.int.kronos.com (155/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 158.0 in stage 25.0 (TID 253, kvs-in-merlin12.int.kronos.com, partition 158, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 253 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 155.0 in stage 25.0 (TID 250) in 35 ms on kvs-in-merlin12.int.kronos.com (156/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_157 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 159.0 in stage 25.0 (TID 254, kvs-in-merlin11.int.kronos.com, partition 159, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 254 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 157.0 in stage 25.0 (TID 252) in 25 ms on kvs-in-merlin11.int.kronos.com (157/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_158 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_159 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 160.0 in stage 25.0 (TID 255, kvs-in-merlin12.int.kronos.com, partition 160, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 255 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 158.0 in stage 25.0 (TID 253) in 34 ms on kvs-in-merlin12.int.kronos.com (158/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 161.0 in stage 25.0 (TID 256, kvs-in-merlin11.int.kronos.com, partition 161, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO TaskSetManager: Finished task 159.0 in stage 25.0 (TID 254) in 25 ms on kvs-in-merlin11.int.kronos.com (159/200) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 256 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_160 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_161 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 162.0 in stage 25.0 (TID 257, kvs-in-merlin12.int.kronos.com, partition 162, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 257 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 160.0 in stage 25.0 (TID 255) in 33 ms on kvs-in-merlin12.int.kronos.com (160/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 163.0 in stage 25.0 (TID 258, kvs-in-merlin11.int.kronos.com, partition 163, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 258 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 161.0 in stage 25.0 (TID 256) in 31 ms on kvs-in-merlin11.int.kronos.com (161/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_162 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_163 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 164.0 in stage 25.0 (TID 259, kvs-in-merlin11.int.kronos.com, partition 164, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 259 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 163.0 in stage 25.0 (TID 258) in 21 ms on kvs-in-merlin11.int.kronos.com (162/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 165.0 in stage 25.0 (TID 260, kvs-in-merlin12.int.kronos.com, partition 165, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 260 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 162.0 in stage 25.0 (TID 257) in 29 ms on kvs-in-merlin12.int.kronos.com (163/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_164 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_165 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 166.0 in stage 25.0 (TID 261, kvs-in-merlin11.int.kronos.com, partition 166, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 261 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 164.0 in stage 25.0 (TID 259) in 23 ms on kvs-in-merlin11.int.kronos.com (164/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 167.0 in stage 25.0 (TID 262, kvs-in-merlin12.int.kronos.com, partition 167, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 262 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 165.0 in stage 25.0 (TID 260) in 27 ms on kvs-in-merlin12.int.kronos.com (165/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_166 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 168.0 in stage 25.0 (TID 263, kvs-in-merlin11.int.kronos.com, partition 168, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 263 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 166.0 in stage 25.0 (TID 261) in 21 ms on kvs-in-merlin11.int.kronos.com (166/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_167 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_168 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 169.0 in stage 25.0 (TID 264, kvs-in-merlin12.int.kronos.com, partition 169, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 264 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 167.0 in stage 25.0 (TID 262) in 31 ms on kvs-in-merlin12.int.kronos.com (167/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 170.0 in stage 25.0 (TID 265, kvs-in-merlin11.int.kronos.com, partition 170, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 265 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 168.0 in stage 25.0 (TID 263) in 22 ms on kvs-in-merlin11.int.kronos.com (168/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_170 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_169 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 171.0 in stage 25.0 (TID 266, kvs-in-merlin11.int.kronos.com, partition 171, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 266 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 170.0 in stage 25.0 (TID 265) in 20 ms on kvs-in-merlin11.int.kronos.com (169/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 172.0 in stage 25.0 (TID 267, kvs-in-merlin12.int.kronos.com, partition 172, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 267 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 169.0 in stage 25.0 (TID 264) in 29 ms on kvs-in-merlin12.int.kronos.com (170/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_171 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 173.0 in stage 25.0 (TID 268, kvs-in-merlin11.int.kronos.com, partition 173, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 268 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 171.0 in stage 25.0 (TID 266) in 18 ms on kvs-in-merlin11.int.kronos.com (171/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_172 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_173 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 174.0 in stage 25.0 (TID 269, kvs-in-merlin12.int.kronos.com, partition 174, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 269 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 172.0 in stage 25.0 (TID 267) in 28 ms on kvs-in-merlin12.int.kronos.com (172/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 175.0 in stage 25.0 (TID 270, kvs-in-merlin11.int.kronos.com, partition 175, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 270 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 173.0 in stage 25.0 (TID 268) in 18 ms on kvs-in-merlin11.int.kronos.com (173/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_175 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_174 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 176.0 in stage 25.0 (TID 271, kvs-in-merlin11.int.kronos.com, partition 176, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 271 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 175.0 in stage 25.0 (TID 270) in 19 ms on kvs-in-merlin11.int.kronos.com (174/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_176 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 177.0 in stage 25.0 (TID 272, kvs-in-merlin12.int.kronos.com, partition 177, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 272 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 174.0 in stage 25.0 (TID 269) in 30 ms on kvs-in-merlin12.int.kronos.com (175/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 178.0 in stage 25.0 (TID 273, kvs-in-merlin11.int.kronos.com, partition 178, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 273 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 176.0 in stage 25.0 (TID 271) in 18 ms on kvs-in-merlin11.int.kronos.com (176/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_177 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_178 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 179.0 in stage 25.0 (TID 274, kvs-in-merlin12.int.kronos.com, partition 179, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 274 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 177.0 in stage 25.0 (TID 272) in 24 ms on kvs-in-merlin12.int.kronos.com (177/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 180.0 in stage 25.0 (TID 275, kvs-in-merlin11.int.kronos.com, partition 180, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 275 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 178.0 in stage 25.0 (TID 273) in 18 ms on kvs-in-merlin11.int.kronos.com (178/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_180 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_179 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 181.0 in stage 25.0 (TID 276, kvs-in-merlin11.int.kronos.com, partition 181, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 276 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 180.0 in stage 25.0 (TID 275) in 20 ms on kvs-in-merlin11.int.kronos.com (179/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 182.0 in stage 25.0 (TID 277, kvs-in-merlin12.int.kronos.com, partition 182, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 277 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 179.0 in stage 25.0 (TID 274) in 31 ms on kvs-in-merlin12.int.kronos.com (180/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_181 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_182 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 183.0 in stage 25.0 (TID 278, kvs-in-merlin11.int.kronos.com, partition 183, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 278 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 181.0 in stage 25.0 (TID 276) in 25 ms on kvs-in-merlin11.int.kronos.com (181/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 184.0 in stage 25.0 (TID 279, kvs-in-merlin12.int.kronos.com, partition 184, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 279 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 182.0 in stage 25.0 (TID 277) in 19 ms on kvs-in-merlin12.int.kronos.com (182/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_183 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_184 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 185.0 in stage 25.0 (TID 280, kvs-in-merlin11.int.kronos.com, partition 185, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 280 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 183.0 in stage 25.0 (TID 278) in 21 ms on kvs-in-merlin11.int.kronos.com (183/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 186.0 in stage 25.0 (TID 281, kvs-in-merlin12.int.kronos.com, partition 186, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 281 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 184.0 in stage 25.0 (TID 279) in 22 ms on kvs-in-merlin12.int.kronos.com (184/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_185 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_186 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 187.0 in stage 25.0 (TID 282, kvs-in-merlin11.int.kronos.com, partition 187, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 282 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 185.0 in stage 25.0 (TID 280) in 22 ms on kvs-in-merlin11.int.kronos.com (185/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 188.0 in stage 25.0 (TID 283, kvs-in-merlin12.int.kronos.com, partition 188, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 283 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 186.0 in stage 25.0 (TID 281) in 20 ms on kvs-in-merlin12.int.kronos.com (186/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_187 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_188 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 189.0 in stage 25.0 (TID 284, kvs-in-merlin11.int.kronos.com, partition 189, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 284 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 187.0 in stage 25.0 (TID 282) in 22 ms on kvs-in-merlin11.int.kronos.com (187/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 190.0 in stage 25.0 (TID 285, kvs-in-merlin12.int.kronos.com, partition 190, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 285 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 188.0 in stage 25.0 (TID 283) in 21 ms on kvs-in-merlin12.int.kronos.com (188/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_189 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_190 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 191.0 in stage 25.0 (TID 286, kvs-in-merlin11.int.kronos.com, partition 191, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 286 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 189.0 in stage 25.0 (TID 284) in 20 ms on kvs-in-merlin11.int.kronos.com (189/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 192.0 in stage 25.0 (TID 287, kvs-in-merlin12.int.kronos.com, partition 192, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 287 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 190.0 in stage 25.0 (TID 285) in 23 ms on kvs-in-merlin12.int.kronos.com (190/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_191 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_192 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 193.0 in stage 25.0 (TID 288, kvs-in-merlin11.int.kronos.com, partition 193, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 288 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 191.0 in stage 25.0 (TID 286) in 19 ms on kvs-in-merlin11.int.kronos.com (191/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 194.0 in stage 25.0 (TID 289, kvs-in-merlin12.int.kronos.com, partition 194, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 289 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 192.0 in stage 25.0 (TID 287) in 20 ms on kvs-in-merlin12.int.kronos.com (192/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_193 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_194 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 195.0 in stage 25.0 (TID 290, kvs-in-merlin11.int.kronos.com, partition 195, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 290 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 193.0 in stage 25.0 (TID 288) in 21 ms on kvs-in-merlin11.int.kronos.com (193/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 196.0 in stage 25.0 (TID 291, kvs-in-merlin12.int.kronos.com, partition 196, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 291 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 194.0 in stage 25.0 (TID 289) in 19 ms on kvs-in-merlin12.int.kronos.com (194/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_195 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_196 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 197.0 in stage 25.0 (TID 292, kvs-in-merlin11.int.kronos.com, partition 197, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 292 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 195.0 in stage 25.0 (TID 290) in 17 ms on kvs-in-merlin11.int.kronos.com (195/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 198.0 in stage 25.0 (TID 293, kvs-in-merlin12.int.kronos.com, partition 198, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 293 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 196.0 in stage 25.0 (TID 291) in 18 ms on kvs-in-merlin12.int.kronos.com (196/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_197 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_198 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 199.0 in stage 25.0 (TID 294, kvs-in-merlin11.int.kronos.com, partition 199, PROCESS_LOCAL, 5222 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 294 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 197.0 in stage 25.0 (TID 292) in 17 ms on kvs-in-merlin11.int.kronos.com (197/200) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 14.0 in stage 26.0 (TID 295, kvs-in-merlin12.int.kronos.com, partition 14, PROCESS_LOCAL, 5165 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 295 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 198.0 in stage 25.0 (TID 293) in 22 ms on kvs-in-merlin12.int.kronos.com (198/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added rdd_33_199 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 16.0 B, free: 3.0 GB) 16/12/27 06:26:57 INFO TaskSetManager: Starting task 0.0 in stage 31.0 (TID 296, kvs-in-merlin11.int.kronos.com, partition 0, PROCESS_LOCAL, 5187 bytes) 16/12/27 06:26:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 296 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:57 INFO TaskSetManager: Finished task 199.0 in stage 25.0 (TID 294) in 26 ms on kvs-in-merlin11.int.kronos.com (199/200) 16/12/27 06:26:57 INFO BlockManagerInfo: Added broadcast_28_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 7.0 KB, free: 3.0 GB) 16/12/27 06:26:58 INFO TaskSetManager: Starting task 1.0 in stage 31.0 (TID 297, kvs-in-merlin12.int.kronos.com, partition 1, PROCESS_LOCAL, 5189 bytes) 16/12/27 06:26:58 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 297 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:58 INFO TaskSetManager: Finished task 11.0 in stage 26.0 (TID 92) in 12137 ms on kvs-in-merlin12.int.kronos.com (6/15) 16/12/27 06:26:58 INFO BlockManagerInfo: Added broadcast_28_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 7.0 KB, free: 3.0 GB) 16/12/27 06:26:58 INFO TaskSetManager: Starting task 2.0 in stage 31.0 (TID 298, kvs-in-merlin12.int.kronos.com, partition 2, PROCESS_LOCAL, 5189 bytes) 16/12/27 06:26:58 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 298 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:58 INFO TaskSetManager: Finished task 3.0 in stage 26.0 (TID 84) in 22435 ms on kvs-in-merlin12.int.kronos.com (7/15) 16/12/27 06:26:58 INFO TaskSetManager: Starting task 3.0 in stage 31.0 (TID 299, kvs-in-merlin12.int.kronos.com, partition 3, PROCESS_LOCAL, 5189 bytes) 16/12/27 06:26:58 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 299 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:26:58 INFO TaskSetManager: Finished task 12.0 in stage 26.0 (TID 93) in 12787 ms on kvs-in-merlin12.int.kronos.com (8/15) 16/12/27 06:26:59 INFO TaskSetManager: Starting task 4.0 in stage 31.0 (TID 300, kvs-in-merlin11.int.kronos.com, partition 4, PROCESS_LOCAL, 5189 bytes) 16/12/27 06:26:59 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 300 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:26:59 INFO TaskSetManager: Finished task 10.0 in stage 26.0 (TID 91) in 17204 ms on kvs-in-merlin11.int.kronos.com (9/15) 16/12/27 06:27:01 INFO TaskSetManager: Starting task 5.0 in stage 31.0 (TID 301, kvs-in-merlin11.int.kronos.com, partition 5, PROCESS_LOCAL, 5189 bytes) 16/12/27 06:27:01 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 301 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:27:01 INFO TaskSetManager: Finished task 6.0 in stage 26.0 (TID 87) in 22734 ms on kvs-in-merlin11.int.kronos.com (10/15) 16/12/27 06:27:02 INFO TaskSetManager: Starting task 6.0 in stage 31.0 (TID 302, kvs-in-merlin12.int.kronos.com, partition 6, PROCESS_LOCAL, 5189 bytes) 16/12/27 06:27:02 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 302 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:27:02 INFO TaskSetManager: Finished task 42.0 in stage 25.0 (TID 95) in 13178 ms on kvs-in-merlin12.int.kronos.com (200/200) 16/12/27 06:27:02 INFO YarnClusterScheduler: Removed TaskSet 25.0, whose tasks have all completed, from pool 16/12/27 06:27:02 INFO DAGScheduler: ShuffleMapStage 25 (cache at UsageMetricsPipeline.scala:482) finished in 15.954 s 16/12/27 06:27:02 INFO DAGScheduler: looking for newly runnable stages 16/12/27 06:27:02 INFO DAGScheduler: running: Set(ShuffleMapStage 45, ShuffleMapStage 31, ShuffleMapStage 82, ShuffleMapStage 53, ShuffleMapStage 83, ShuffleMapStage 97, ShuffleMapStage 61, ShuffleMapStage 40, ShuffleMapStage 26, ShuffleMapStage 62, ShuffleMapStage 92, ShuffleMapStage 33, ShuffleMapStage 48, ShuffleMapStage 63, ShuffleMapStage 85, ShuffleMapStage 100, ShuffleMapStage 56, ShuffleMapStage 107, ShuffleMapStage 50, ShuffleMapStage 36, ShuffleMapStage 87, ShuffleMapStage 43, ShuffleMapStage 58, ShuffleMapStage 73) 16/12/27 06:27:02 INFO DAGScheduler: waiting: Set(ShuffleMapStage 102, ShuffleMapStage 81, ShuffleMapStage 60, ShuffleMapStage 52, ShuffleMapStage 104, ShuffleMapStage 75, ShuffleMapStage 54, ShuffleMapStage 106, ShuffleMapStage 98, ShuffleMapStage 77, ShuffleMapStage 27, ShuffleMapStage 71, ShuffleMapStage 42, ShuffleMapStage 94, ShuffleMapStage 65, ShuffleMapStage 44, ShuffleMapStage 96, ShuffleMapStage 88, ShuffleMapStage 67, ShuffleMapStage 46, ShuffleMapStage 38, ShuffleMapStage 90, ShuffleMapStage 69, ShuffleMapStage 84, ShuffleMapStage 34, ShuffleMapStage 86, ShuffleMapStage 57, ShuffleMapStage 28, ShuffleMapStage 109, ShuffleMapStage 80, ShuffleMapStage 59, ShuffleMapStage 51, ShuffleMapStage 30, ShuffleMapStage 103, ShuffleMapStage 74, ShuffleMapStage 32, ShuffleMapStage 105, ShuffleMapStage 76, ShuffleMapStage 55, ShuffleMapStage 47, ShuffleMapStage 99, ShuffleMapStage 78, ShuffleMapStage 70, ShuffleMapStage 49, ShuffleMapStage 101, ShuffleMapStage 93, ShuffleMapStage 72, ShuffleMapStage 95, ShuffleMapStage 66, ShuffleMapStage 37, ShuffleMapStage 89, ShuffleMapStage 68, ShuffleMapStage 39, ShuffleMapStage 91, ShuffleMapStage 41, ShuffleMapStage 64, ShuffleMapStage 35, ShuffleMapStage 108, ShuffleMapStage 79, ShuffleMapStage 29, ResultStage 110) 16/12/27 06:27:02 INFO DAGScheduler: failed: Set() 16/12/27 06:27:03 INFO TaskSetManager: Starting task 7.0 in stage 31.0 (TID 303, kvs-in-merlin11.int.kronos.com, partition 7, PROCESS_LOCAL, 5190 bytes) 16/12/27 06:27:03 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 303 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:27:03 INFO TaskSetManager: Finished task 13.0 in stage 26.0 (TID 94) in 16294 ms on kvs-in-merlin11.int.kronos.com (11/15) 16/12/27 06:27:03 INFO TaskSetManager: Starting task 8.0 in stage 31.0 (TID 304, kvs-in-merlin12.int.kronos.com, partition 8, PROCESS_LOCAL, 5191 bytes) 16/12/27 06:27:03 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 304 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:27:03 INFO TaskSetManager: Finished task 9.0 in stage 26.0 (TID 90) in 21747 ms on kvs-in-merlin12.int.kronos.com (12/15) 16/12/27 06:27:03 INFO TaskSetManager: Starting task 9.0 in stage 31.0 (TID 305, kvs-in-merlin11.int.kronos.com, partition 9, PROCESS_LOCAL, 5191 bytes) 16/12/27 06:27:03 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 305 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:27:03 INFO TaskSetManager: Finished task 4.0 in stage 26.0 (TID 85) in 26978 ms on kvs-in-merlin11.int.kronos.com (13/15) 16/12/27 06:27:06 INFO TaskSetManager: Starting task 10.0 in stage 31.0 (TID 306, kvs-in-merlin11.int.kronos.com, partition 10, PROCESS_LOCAL, 5191 bytes) 16/12/27 06:27:06 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 306 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:27:06 INFO TaskSetManager: Finished task 8.0 in stage 26.0 (TID 89) in 26529 ms on kvs-in-merlin11.int.kronos.com (14/15) 16/12/27 06:27:13 INFO TaskSetManager: Starting task 11.0 in stage 31.0 (TID 307, kvs-in-merlin12.int.kronos.com, partition 11, PROCESS_LOCAL, 5191 bytes) 16/12/27 06:27:13 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 307 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:27:13 INFO TaskSetManager: Finished task 14.0 in stage 26.0 (TID 295) in 16065 ms on kvs-in-merlin12.int.kronos.com (15/15) 16/12/27 06:27:13 INFO YarnClusterScheduler: Removed TaskSet 26.0, whose tasks have all completed, from pool 16/12/27 06:27:13 INFO DAGScheduler: ShuffleMapStage 26 (cache at UsageMetricsPipeline.scala:482) finished in 52.938 s 16/12/27 06:27:13 INFO DAGScheduler: looking for newly runnable stages 16/12/27 06:27:13 INFO DAGScheduler: running: Set(ShuffleMapStage 45, ShuffleMapStage 31, ShuffleMapStage 82, ShuffleMapStage 53, ShuffleMapStage 83, ShuffleMapStage 97, ShuffleMapStage 61, ShuffleMapStage 40, ShuffleMapStage 62, ShuffleMapStage 92, ShuffleMapStage 33, ShuffleMapStage 48, ShuffleMapStage 63, ShuffleMapStage 85, ShuffleMapStage 100, ShuffleMapStage 56, ShuffleMapStage 107, ShuffleMapStage 50, ShuffleMapStage 36, ShuffleMapStage 87, ShuffleMapStage 43, ShuffleMapStage 58, ShuffleMapStage 73) 16/12/27 06:27:13 INFO DAGScheduler: waiting: Set(ShuffleMapStage 102, ShuffleMapStage 81, ShuffleMapStage 60, ShuffleMapStage 52, ShuffleMapStage 104, ShuffleMapStage 75, ShuffleMapStage 54, ShuffleMapStage 106, ShuffleMapStage 98, ShuffleMapStage 77, ShuffleMapStage 27, ShuffleMapStage 71, ShuffleMapStage 42, ShuffleMapStage 94, ShuffleMapStage 65, ShuffleMapStage 44, ShuffleMapStage 96, ShuffleMapStage 88, ShuffleMapStage 67, ShuffleMapStage 46, ShuffleMapStage 38, ShuffleMapStage 90, ShuffleMapStage 69, ShuffleMapStage 84, ShuffleMapStage 34, ShuffleMapStage 86, ShuffleMapStage 57, ShuffleMapStage 28, ShuffleMapStage 109, ShuffleMapStage 80, ShuffleMapStage 59, ShuffleMapStage 51, ShuffleMapStage 30, ShuffleMapStage 103, ShuffleMapStage 74, ShuffleMapStage 32, ShuffleMapStage 105, ShuffleMapStage 76, ShuffleMapStage 55, ShuffleMapStage 47, ShuffleMapStage 99, ShuffleMapStage 78, ShuffleMapStage 70, ShuffleMapStage 49, ShuffleMapStage 101, ShuffleMapStage 93, ShuffleMapStage 72, ShuffleMapStage 95, ShuffleMapStage 66, ShuffleMapStage 37, ShuffleMapStage 89, ShuffleMapStage 68, ShuffleMapStage 39, ShuffleMapStage 91, ShuffleMapStage 41, ShuffleMapStage 64, ShuffleMapStage 35, ShuffleMapStage 108, ShuffleMapStage 79, ShuffleMapStage 29, ResultStage 110) 16/12/27 06:27:13 INFO DAGScheduler: failed: Set() 16/12/27 06:27:14 INFO DAGScheduler: Submitting ShuffleMapStage 27 (MapPartitionsRDD[189] at cache at UsageMetricsPipeline.scala:482), which has no missing parents 16/12/27 06:27:14 INFO MemoryStore: Block broadcast_52 stored as values in memory (estimated size 5.7 KB, free 901.0 MB) 16/12/27 06:27:14 INFO MemoryStore: Block broadcast_52_piece0 stored as bytes in memory (estimated size 3.4 KB, free 901.0 MB) 16/12/27 06:27:14 INFO BlockManagerInfo: Added broadcast_52_piece0 in memory on 10.131.137.96:43778 (size: 3.4 KB, free: 911.6 MB) 16/12/27 06:27:14 INFO SparkContext: Created broadcast 52 from broadcast at DAGScheduler.scala:1012 16/12/27 06:27:14 INFO DAGScheduler: Submitting 6 missing tasks from ShuffleMapStage 27 (MapPartitionsRDD[189] at cache at UsageMetricsPipeline.scala:482) 16/12/27 06:27:14 INFO YarnClusterScheduler: Adding task set 27.0 with 6 tasks 16/12/27 06:27:57 INFO BlockManagerInfo: Removed broadcast_26_piece0 on 10.131.137.96:43778 in memory (size: 5.4 KB, free: 911.6 MB) 16/12/27 06:27:57 INFO BlockManagerInfo: Removed broadcast_26_piece0 on kvs-in-merlin11.int.kronos.com:33426 in memory (size: 5.4 KB, free: 3.0 GB) 16/12/27 06:27:57 INFO BlockManagerInfo: Removed broadcast_26_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.4 KB, free: 3.0 GB) 16/12/27 06:27:57 INFO BlockManagerInfo: Removed broadcast_27_piece0 on 10.131.137.96:43778 in memory (size: 5.6 KB, free: 911.6 MB) 16/12/27 06:27:57 INFO BlockManagerInfo: Removed broadcast_27_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 5.6 KB, free: 3.0 GB) 16/12/27 06:27:57 INFO BlockManagerInfo: Removed broadcast_27_piece0 on kvs-in-merlin11.int.kronos.com:33426 in memory (size: 5.6 KB, free: 3.0 GB) 16/12/27 06:27:57 INFO BlockManagerInfo: Removed broadcast_50_piece0 on 10.131.137.96:43778 in memory (size: 9.3 KB, free: 911.6 MB) 16/12/27 06:27:57 INFO BlockManagerInfo: Removed broadcast_50_piece0 on kvs-in-merlin11.int.kronos.com:33426 in memory (size: 9.3 KB, free: 3.0 GB) 16/12/27 06:27:57 INFO BlockManagerInfo: Removed broadcast_50_piece0 on kvs-in-merlin12.int.kronos.com:19820 in memory (size: 9.3 KB, free: 3.0 GB) 16/12/27 06:35:37 INFO TaskSetManager: Starting task 0.0 in stage 27.0 (TID 308, kvs-in-merlin12.int.kronos.com, partition 0, NODE_LOCAL, 5222 bytes) 16/12/27 06:35:37 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 308 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:35:37 INFO TaskSetManager: Finished task 11.0 in stage 31.0 (TID 307) in 503608 ms on kvs-in-merlin12.int.kronos.com (1/15) 16/12/27 06:35:37 INFO BlockManagerInfo: Added broadcast_52_piece0 in memory on kvs-in-merlin12.int.kronos.com:19820 (size: 3.4 KB, free: 3.0 GB) 16/12/27 06:35:37 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 28 to 10.131.137.77:25722 16/12/27 06:35:37 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 28 is 254 bytes 16/12/27 06:35:37 INFO TaskSetManager: Starting task 1.0 in stage 27.0 (TID 309, kvs-in-merlin12.int.kronos.com, partition 1, NODE_LOCAL, 5222 bytes) 16/12/27 06:35:37 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 309 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:35:37 INFO TaskSetManager: Finished task 0.0 in stage 27.0 (TID 308) in 183 ms on kvs-in-merlin12.int.kronos.com (1/6) 16/12/27 06:35:37 INFO TaskSetManager: Starting task 2.0 in stage 27.0 (TID 310, kvs-in-merlin12.int.kronos.com, partition 2, NODE_LOCAL, 5222 bytes) 16/12/27 06:35:37 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 310 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:35:37 INFO TaskSetManager: Finished task 1.0 in stage 27.0 (TID 309) in 143 ms on kvs-in-merlin12.int.kronos.com (2/6) 16/12/27 06:35:38 INFO TaskSetManager: Starting task 3.0 in stage 27.0 (TID 311, kvs-in-merlin12.int.kronos.com, partition 3, NODE_LOCAL, 5222 bytes) 16/12/27 06:35:38 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 311 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:35:38 INFO TaskSetManager: Finished task 2.0 in stage 27.0 (TID 310) in 169 ms on kvs-in-merlin12.int.kronos.com (3/6) 16/12/27 06:35:38 INFO TaskSetManager: Starting task 4.0 in stage 27.0 (TID 312, kvs-in-merlin12.int.kronos.com, partition 4, NODE_LOCAL, 5222 bytes) 16/12/27 06:35:38 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 312 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:35:38 INFO TaskSetManager: Finished task 3.0 in stage 27.0 (TID 311) in 147 ms on kvs-in-merlin12.int.kronos.com (4/6) 16/12/27 06:35:38 INFO TaskSetManager: Starting task 5.0 in stage 27.0 (TID 313, kvs-in-merlin12.int.kronos.com, partition 5, NODE_LOCAL, 5222 bytes) 16/12/27 06:35:38 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 313 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:35:38 INFO TaskSetManager: Finished task 4.0 in stage 27.0 (TID 312) in 141 ms on kvs-in-merlin12.int.kronos.com (5/6) 16/12/27 06:35:38 INFO TaskSetManager: Starting task 12.0 in stage 31.0 (TID 314, kvs-in-merlin12.int.kronos.com, partition 12, PROCESS_LOCAL, 5191 bytes) 16/12/27 06:35:38 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 314 on executor id: 2 hostname: kvs-in-merlin12.int.kronos.com. 16/12/27 06:35:38 INFO TaskSetManager: Finished task 5.0 in stage 27.0 (TID 313) in 131 ms on kvs-in-merlin12.int.kronos.com (6/6) 16/12/27 06:35:38 INFO YarnClusterScheduler: Removed TaskSet 27.0, whose tasks have all completed, from pool 16/12/27 06:35:38 INFO DAGScheduler: ShuffleMapStage 27 (cache at UsageMetricsPipeline.scala:482) finished in 504.487 s 16/12/27 06:35:38 INFO DAGScheduler: looking for newly runnable stages 16/12/27 06:35:38 INFO DAGScheduler: running: Set(ShuffleMapStage 45, ShuffleMapStage 31, ShuffleMapStage 82, ShuffleMapStage 53, ShuffleMapStage 83, ShuffleMapStage 97, ShuffleMapStage 61, ShuffleMapStage 40, ShuffleMapStage 62, ShuffleMapStage 92, ShuffleMapStage 33, ShuffleMapStage 48, ShuffleMapStage 63, ShuffleMapStage 85, ShuffleMapStage 100, ShuffleMapStage 56, ShuffleMapStage 107, ShuffleMapStage 50, ShuffleMapStage 36, ShuffleMapStage 87, ShuffleMapStage 43, ShuffleMapStage 58, ShuffleMapStage 73) 16/12/27 06:35:38 INFO DAGScheduler: waiting: Set(ShuffleMapStage 102, ShuffleMapStage 81, ShuffleMapStage 60, ShuffleMapStage 52, ShuffleMapStage 104, ShuffleMapStage 75, ShuffleMapStage 54, ShuffleMapStage 106, ShuffleMapStage 98, ShuffleMapStage 77, ShuffleMapStage 71, ShuffleMapStage 42, ShuffleMapStage 94, ShuffleMapStage 65, ShuffleMapStage 44, ShuffleMapStage 96, ShuffleMapStage 88, ShuffleMapStage 67, ShuffleMapStage 46, ShuffleMapStage 38, ShuffleMapStage 90, ShuffleMapStage 69, ShuffleMapStage 84, ShuffleMapStage 34, ShuffleMapStage 86, ShuffleMapStage 57, ShuffleMapStage 28, ShuffleMapStage 109, ShuffleMapStage 80, ShuffleMapStage 59, ShuffleMapStage 51, ShuffleMapStage 30, ShuffleMapStage 103, ShuffleMapStage 74, ShuffleMapStage 32, ShuffleMapStage 105, ShuffleMapStage 76, ShuffleMapStage 55, ShuffleMapStage 47, ShuffleMapStage 99, ShuffleMapStage 78, ShuffleMapStage 70, ShuffleMapStage 49, ShuffleMapStage 101, ShuffleMapStage 93, ShuffleMapStage 72, ShuffleMapStage 95, ShuffleMapStage 66, ShuffleMapStage 37, ShuffleMapStage 89, ShuffleMapStage 68, ShuffleMapStage 39, ShuffleMapStage 91, ShuffleMapStage 41, ShuffleMapStage 64, ShuffleMapStage 35, ShuffleMapStage 108, ShuffleMapStage 79, ShuffleMapStage 29, ResultStage 110) 16/12/27 06:35:38 INFO DAGScheduler: failed: Set() 16/12/27 06:35:38 INFO DAGScheduler: Submitting ShuffleMapStage 28 (MapPartitionsRDD[193] at cache at UsageMetricsPipeline.scala:482), which has no missing parents 16/12/27 06:35:38 WARN DFSClient: Slow ReadProcessor read fields took 504515ms (threshold=30000ms); ack: seqno: 200 reply: SUCCESS reply: SUCCESS downstreamAckTimeNanos: 3604976 flag: 0 flag: 0, targets: [DatanodeInfoWithStorage[10.131.137.96:50010,DS-b9345f1e-e26d-403d-90d4-3b2191ada105,DISK], DatanodeInfoWithStorage[10.131.137.78:50010,DS-6b72490a-c936-42bf-8920-5d5225f75e95,DISK]] 16/12/27 06:35:38 INFO MemoryStore: Block broadcast_53 stored as values in memory (estimated size 38.0 KB, free 901.1 MB) 16/12/27 06:35:38 INFO MemoryStore: Block broadcast_53_piece0 stored as bytes in memory (estimated size 15.9 KB, free 901.1 MB) 16/12/27 06:35:38 INFO BlockManagerInfo: Added broadcast_53_piece0 in memory on 10.131.137.96:43778 (size: 15.9 KB, free: 911.6 MB) 16/12/27 06:35:38 INFO SparkContext: Created broadcast 53 from broadcast at DAGScheduler.scala:1012 16/12/27 06:35:38 INFO DAGScheduler: Submitting 200 missing tasks from ShuffleMapStage 28 (MapPartitionsRDD[193] at cache at UsageMetricsPipeline.scala:482) 16/12/27 06:35:38 INFO YarnClusterScheduler: Adding task set 28.0 with 200 tasks 16/12/27 06:35:51 INFO RetryInvocationHandler: Exception while invoking ClientNamenodeProtocolTranslatorPB.renewLease over kvs-in-merlin04.int.kronos.com/10.131.138.27:8020. Trying to failover immediately. java.io.EOFException: End of File Exception between local host is: "kvs-in-merlin08/10.131.137.96"; destination host is: "kvs-in-merlin04.int.kronos.com":8020; : java.io.EOFException; For more details see: http://wiki.apache.org/hadoop/EOFException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:422) at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:801) at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:765) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1556) at org.apache.hadoop.ipc.Client.call(Client.java:1496) at org.apache.hadoop.ipc.Client.call(Client.java:1396) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:233) at com.sun.proxy.$Proxy10.renewLease(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.renewLease(ClientNamenodeProtocolTranslatorPB.java:635) at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:278) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:194) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:176) at com.sun.proxy.$Proxy11.renewLease(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.renewLease(DFSClient.java:902) at org.apache.hadoop.hdfs.LeaseRenewer.renew(LeaseRenewer.java:423) at org.apache.hadoop.hdfs.LeaseRenewer.run(LeaseRenewer.java:448) at org.apache.hadoop.hdfs.LeaseRenewer.access$700(LeaseRenewer.java:71) at org.apache.hadoop.hdfs.LeaseRenewer$1.run(LeaseRenewer.java:304) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:392) at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1117) at org.apache.hadoop.ipc.Client$Connection.run(Client.java:1012) 16/12/27 06:37:47 INFO TaskSetManager: Starting task 0.0 in stage 28.0 (TID 315, kvs-in-merlin11.int.kronos.com, partition 0, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:47 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 315 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:47 INFO TaskSetManager: Finished task 7.0 in stage 31.0 (TID 303) in 644851 ms on kvs-in-merlin11.int.kronos.com (2/15) 16/12/27 06:37:47 INFO BlockManagerInfo: Added broadcast_53_piece0 in memory on kvs-in-merlin11.int.kronos.com:33426 (size: 15.9 KB, free: 3.0 GB) 16/12/27 06:37:48 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 27 to 10.131.137.78:53067 16/12/27 06:37:48 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 27 is 588 bytes 16/12/27 06:37:48 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 29 to 10.131.137.78:53067 16/12/27 06:37:48 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 29 is 688 bytes 16/12/27 06:37:49 INFO TaskSetManager: Starting task 1.0 in stage 28.0 (TID 316, kvs-in-merlin11.int.kronos.com, partition 1, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:49 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 316 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:49 INFO TaskSetManager: Finished task 0.0 in stage 28.0 (TID 315) in 1550 ms on kvs-in-merlin11.int.kronos.com (1/200) 16/12/27 06:37:49 INFO TaskSetManager: Starting task 2.0 in stage 28.0 (TID 317, kvs-in-merlin11.int.kronos.com, partition 2, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:49 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 317 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:49 INFO TaskSetManager: Finished task 1.0 in stage 28.0 (TID 316) in 551 ms on kvs-in-merlin11.int.kronos.com (2/200) 16/12/27 06:37:50 INFO TaskSetManager: Starting task 3.0 in stage 28.0 (TID 318, kvs-in-merlin11.int.kronos.com, partition 3, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:50 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 318 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:50 INFO TaskSetManager: Finished task 2.0 in stage 28.0 (TID 317) in 602 ms on kvs-in-merlin11.int.kronos.com (3/200) 16/12/27 06:37:51 INFO TaskSetManager: Starting task 4.0 in stage 28.0 (TID 319, kvs-in-merlin11.int.kronos.com, partition 4, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:51 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 319 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:51 INFO TaskSetManager: Finished task 3.0 in stage 28.0 (TID 318) in 509 ms on kvs-in-merlin11.int.kronos.com (4/200) 16/12/27 06:37:51 INFO TaskSetManager: Starting task 5.0 in stage 28.0 (TID 320, kvs-in-merlin11.int.kronos.com, partition 5, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:51 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 320 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:51 INFO TaskSetManager: Finished task 4.0 in stage 28.0 (TID 319) in 776 ms on kvs-in-merlin11.int.kronos.com (5/200) 16/12/27 06:37:52 INFO TaskSetManager: Starting task 6.0 in stage 28.0 (TID 321, kvs-in-merlin11.int.kronos.com, partition 6, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:52 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 321 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:52 INFO TaskSetManager: Finished task 5.0 in stage 28.0 (TID 320) in 400 ms on kvs-in-merlin11.int.kronos.com (6/200) 16/12/27 06:37:52 INFO TaskSetManager: Starting task 7.0 in stage 28.0 (TID 322, kvs-in-merlin11.int.kronos.com, partition 7, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:52 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 322 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:52 INFO TaskSetManager: Finished task 6.0 in stage 28.0 (TID 321) in 351 ms on kvs-in-merlin11.int.kronos.com (7/200) 16/12/27 06:37:52 INFO TaskSetManager: Starting task 8.0 in stage 28.0 (TID 323, kvs-in-merlin11.int.kronos.com, partition 8, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:52 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 323 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:52 INFO TaskSetManager: Finished task 7.0 in stage 28.0 (TID 322) in 348 ms on kvs-in-merlin11.int.kronos.com (8/200) 16/12/27 06:37:53 INFO TaskSetManager: Starting task 9.0 in stage 28.0 (TID 324, kvs-in-merlin11.int.kronos.com, partition 9, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:53 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 324 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:53 INFO TaskSetManager: Finished task 8.0 in stage 28.0 (TID 323) in 441 ms on kvs-in-merlin11.int.kronos.com (9/200) 16/12/27 06:37:53 INFO TaskSetManager: Starting task 10.0 in stage 28.0 (TID 325, kvs-in-merlin11.int.kronos.com, partition 10, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:53 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 325 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:53 INFO TaskSetManager: Finished task 9.0 in stage 28.0 (TID 324) in 474 ms on kvs-in-merlin11.int.kronos.com (10/200) 16/12/27 06:37:54 INFO TaskSetManager: Starting task 11.0 in stage 28.0 (TID 326, kvs-in-merlin11.int.kronos.com, partition 11, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 326 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:54 INFO TaskSetManager: Finished task 10.0 in stage 28.0 (TID 325) in 450 ms on kvs-in-merlin11.int.kronos.com (11/200) 16/12/27 06:37:54 INFO TaskSetManager: Starting task 12.0 in stage 28.0 (TID 327, kvs-in-merlin11.int.kronos.com, partition 12, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:54 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 327 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:54 INFO TaskSetManager: Finished task 11.0 in stage 28.0 (TID 326) in 654 ms on kvs-in-merlin11.int.kronos.com (12/200) 16/12/27 06:37:55 INFO TaskSetManager: Starting task 13.0 in stage 28.0 (TID 328, kvs-in-merlin11.int.kronos.com, partition 13, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 328 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:55 INFO TaskSetManager: Finished task 12.0 in stage 28.0 (TID 327) in 485 ms on kvs-in-merlin11.int.kronos.com (13/200) 16/12/27 06:37:55 INFO TaskSetManager: Starting task 14.0 in stage 28.0 (TID 329, kvs-in-merlin11.int.kronos.com, partition 14, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:55 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 329 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:55 INFO TaskSetManager: Finished task 13.0 in stage 28.0 (TID 328) in 441 ms on kvs-in-merlin11.int.kronos.com (14/200) 16/12/27 06:37:56 INFO TaskSetManager: Starting task 15.0 in stage 28.0 (TID 330, kvs-in-merlin11.int.kronos.com, partition 15, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 330 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:56 INFO TaskSetManager: Finished task 14.0 in stage 28.0 (TID 329) in 361 ms on kvs-in-merlin11.int.kronos.com (15/200) 16/12/27 06:37:56 INFO TaskSetManager: Starting task 16.0 in stage 28.0 (TID 331, kvs-in-merlin11.int.kronos.com, partition 16, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:56 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 331 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:56 INFO TaskSetManager: Finished task 15.0 in stage 28.0 (TID 330) in 324 ms on kvs-in-merlin11.int.kronos.com (16/200) 16/12/27 06:37:57 INFO TaskSetManager: Starting task 17.0 in stage 28.0 (TID 332, kvs-in-merlin11.int.kronos.com, partition 17, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 332 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:57 INFO TaskSetManager: Finished task 16.0 in stage 28.0 (TID 331) in 519 ms on kvs-in-merlin11.int.kronos.com (17/200) 16/12/27 06:37:57 INFO TaskSetManager: Starting task 18.0 in stage 28.0 (TID 333, kvs-in-merlin11.int.kronos.com, partition 18, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 333 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:57 INFO TaskSetManager: Finished task 17.0 in stage 28.0 (TID 332) in 498 ms on kvs-in-merlin11.int.kronos.com (18/200) 16/12/27 06:37:57 INFO TaskSetManager: Starting task 19.0 in stage 28.0 (TID 334, kvs-in-merlin11.int.kronos.com, partition 19, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:57 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 334 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:57 INFO TaskSetManager: Finished task 18.0 in stage 28.0 (TID 333) in 285 ms on kvs-in-merlin11.int.kronos.com (19/200) 16/12/27 06:37:58 INFO TaskSetManager: Starting task 20.0 in stage 28.0 (TID 335, kvs-in-merlin11.int.kronos.com, partition 20, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:58 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 335 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:58 INFO TaskSetManager: Finished task 19.0 in stage 28.0 (TID 334) in 421 ms on kvs-in-merlin11.int.kronos.com (20/200) 16/12/27 06:37:58 INFO TaskSetManager: Starting task 21.0 in stage 28.0 (TID 336, kvs-in-merlin11.int.kronos.com, partition 21, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:58 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 336 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:58 INFO TaskSetManager: Finished task 20.0 in stage 28.0 (TID 335) in 497 ms on kvs-in-merlin11.int.kronos.com (21/200) 16/12/27 06:37:59 INFO TaskSetManager: Starting task 22.0 in stage 28.0 (TID 337, kvs-in-merlin11.int.kronos.com, partition 22, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:59 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 337 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:59 INFO TaskSetManager: Finished task 21.0 in stage 28.0 (TID 336) in 487 ms on kvs-in-merlin11.int.kronos.com (22/200) 16/12/27 06:37:59 INFO TaskSetManager: Starting task 23.0 in stage 28.0 (TID 338, kvs-in-merlin11.int.kronos.com, partition 23, RACK_LOCAL, 5550 bytes) 16/12/27 06:37:59 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 338 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:37:59 INFO TaskSetManager: Finished task 22.0 in stage 28.0 (TID 337) in 546 ms on kvs-in-merlin11.int.kronos.com (23/200) 16/12/27 06:37:59 WARN DFSClient: Slow ReadProcessor read fields took 141251ms (threshold=30000ms); ack: seqno: 201 reply: SUCCESS reply: SUCCESS downstreamAckTimeNanos: 4535432 flag: 0 flag: 0, targets: [DatanodeInfoWithStorage[10.131.137.96:50010,DS-b9345f1e-e26d-403d-90d4-3b2191ada105,DISK], DatanodeInfoWithStorage[10.131.137.78:50010,DS-6b72490a-c936-42bf-8920-5d5225f75e95,DISK]] 16/12/27 06:38:00 INFO TaskSetManager: Starting task 24.0 in stage 28.0 (TID 339, kvs-in-merlin11.int.kronos.com, partition 24, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:00 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 339 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:00 INFO TaskSetManager: Finished task 23.0 in stage 28.0 (TID 338) in 541 ms on kvs-in-merlin11.int.kronos.com (24/200) 16/12/27 06:38:00 INFO TaskSetManager: Starting task 25.0 in stage 28.0 (TID 340, kvs-in-merlin11.int.kronos.com, partition 25, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:00 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 340 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:00 INFO TaskSetManager: Finished task 24.0 in stage 28.0 (TID 339) in 536 ms on kvs-in-merlin11.int.kronos.com (25/200) 16/12/27 06:38:01 INFO TaskSetManager: Starting task 26.0 in stage 28.0 (TID 341, kvs-in-merlin11.int.kronos.com, partition 26, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:01 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 341 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:01 INFO TaskSetManager: Finished task 25.0 in stage 28.0 (TID 340) in 526 ms on kvs-in-merlin11.int.kronos.com (26/200) 16/12/27 06:38:01 INFO TaskSetManager: Starting task 27.0 in stage 28.0 (TID 342, kvs-in-merlin11.int.kronos.com, partition 27, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:01 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 342 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:01 INFO TaskSetManager: Finished task 26.0 in stage 28.0 (TID 341) in 565 ms on kvs-in-merlin11.int.kronos.com (27/200) 16/12/27 06:38:02 INFO TaskSetManager: Starting task 28.0 in stage 28.0 (TID 343, kvs-in-merlin11.int.kronos.com, partition 28, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:02 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 343 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:02 INFO TaskSetManager: Finished task 27.0 in stage 28.0 (TID 342) in 505 ms on kvs-in-merlin11.int.kronos.com (28/200) 16/12/27 06:38:02 INFO TaskSetManager: Starting task 29.0 in stage 28.0 (TID 344, kvs-in-merlin11.int.kronos.com, partition 29, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:02 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 344 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:02 INFO TaskSetManager: Finished task 28.0 in stage 28.0 (TID 343) in 407 ms on kvs-in-merlin11.int.kronos.com (29/200) 16/12/27 06:38:03 INFO TaskSetManager: Starting task 30.0 in stage 28.0 (TID 345, kvs-in-merlin11.int.kronos.com, partition 30, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:03 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 345 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:03 INFO TaskSetManager: Finished task 29.0 in stage 28.0 (TID 344) in 436 ms on kvs-in-merlin11.int.kronos.com (30/200) 16/12/27 06:38:03 INFO TaskSetManager: Starting task 31.0 in stage 28.0 (TID 346, kvs-in-merlin11.int.kronos.com, partition 31, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:03 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 346 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:03 INFO TaskSetManager: Finished task 30.0 in stage 28.0 (TID 345) in 406 ms on kvs-in-merlin11.int.kronos.com (31/200) 16/12/27 06:38:03 INFO TaskSetManager: Starting task 32.0 in stage 28.0 (TID 347, kvs-in-merlin11.int.kronos.com, partition 32, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:03 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 347 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:03 INFO TaskSetManager: Finished task 31.0 in stage 28.0 (TID 346) in 282 ms on kvs-in-merlin11.int.kronos.com (32/200) 16/12/27 06:38:04 INFO TaskSetManager: Starting task 33.0 in stage 28.0 (TID 348, kvs-in-merlin11.int.kronos.com, partition 33, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:04 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 348 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:04 INFO TaskSetManager: Finished task 32.0 in stage 28.0 (TID 347) in 274 ms on kvs-in-merlin11.int.kronos.com (33/200) 16/12/27 06:38:04 INFO TaskSetManager: Starting task 34.0 in stage 28.0 (TID 349, kvs-in-merlin11.int.kronos.com, partition 34, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:04 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 349 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:04 INFO TaskSetManager: Finished task 33.0 in stage 28.0 (TID 348) in 304 ms on kvs-in-merlin11.int.kronos.com (34/200) 16/12/27 06:38:04 INFO TaskSetManager: Starting task 35.0 in stage 28.0 (TID 350, kvs-in-merlin11.int.kronos.com, partition 35, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:04 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 350 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:04 INFO TaskSetManager: Finished task 34.0 in stage 28.0 (TID 349) in 266 ms on kvs-in-merlin11.int.kronos.com (35/200) 16/12/27 06:38:05 INFO TaskSetManager: Starting task 36.0 in stage 28.0 (TID 351, kvs-in-merlin11.int.kronos.com, partition 36, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:05 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 351 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:05 INFO TaskSetManager: Finished task 35.0 in stage 28.0 (TID 350) in 343 ms on kvs-in-merlin11.int.kronos.com (36/200) 16/12/27 06:38:05 INFO TaskSetManager: Starting task 37.0 in stage 28.0 (TID 352, kvs-in-merlin11.int.kronos.com, partition 37, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:05 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 352 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:05 INFO TaskSetManager: Finished task 36.0 in stage 28.0 (TID 351) in 535 ms on kvs-in-merlin11.int.kronos.com (37/200) 16/12/27 06:38:06 INFO TaskSetManager: Starting task 38.0 in stage 28.0 (TID 353, kvs-in-merlin11.int.kronos.com, partition 38, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:06 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 353 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:06 INFO TaskSetManager: Finished task 37.0 in stage 28.0 (TID 352) in 568 ms on kvs-in-merlin11.int.kronos.com (38/200) 16/12/27 06:38:06 INFO TaskSetManager: Starting task 39.0 in stage 28.0 (TID 354, kvs-in-merlin11.int.kronos.com, partition 39, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:06 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 354 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:06 INFO TaskSetManager: Finished task 38.0 in stage 28.0 (TID 353) in 611 ms on kvs-in-merlin11.int.kronos.com (39/200) 16/12/27 06:38:07 INFO TaskSetManager: Starting task 40.0 in stage 28.0 (TID 355, kvs-in-merlin11.int.kronos.com, partition 40, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:07 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 355 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:07 INFO TaskSetManager: Finished task 39.0 in stage 28.0 (TID 354) in 681 ms on kvs-in-merlin11.int.kronos.com (40/200) 16/12/27 06:38:08 INFO TaskSetManager: Starting task 41.0 in stage 28.0 (TID 356, kvs-in-merlin11.int.kronos.com, partition 41, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:08 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 356 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:08 INFO TaskSetManager: Finished task 40.0 in stage 28.0 (TID 355) in 620 ms on kvs-in-merlin11.int.kronos.com (41/200) 16/12/27 06:38:08 INFO TaskSetManager: Starting task 42.0 in stage 28.0 (TID 357, kvs-in-merlin11.int.kronos.com, partition 42, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:08 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 357 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:08 INFO TaskSetManager: Finished task 41.0 in stage 28.0 (TID 356) in 549 ms on kvs-in-merlin11.int.kronos.com (42/200) 16/12/27 06:38:09 INFO TaskSetManager: Starting task 43.0 in stage 28.0 (TID 358, kvs-in-merlin11.int.kronos.com, partition 43, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:09 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 358 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:09 INFO TaskSetManager: Finished task 42.0 in stage 28.0 (TID 357) in 537 ms on kvs-in-merlin11.int.kronos.com (43/200) 16/12/27 06:38:09 INFO TaskSetManager: Starting task 44.0 in stage 28.0 (TID 359, kvs-in-merlin11.int.kronos.com, partition 44, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:09 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 359 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:09 INFO TaskSetManager: Finished task 43.0 in stage 28.0 (TID 358) in 529 ms on kvs-in-merlin11.int.kronos.com (44/200) 16/12/27 06:38:10 INFO TaskSetManager: Starting task 45.0 in stage 28.0 (TID 360, kvs-in-merlin11.int.kronos.com, partition 45, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:10 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 360 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:10 INFO TaskSetManager: Finished task 44.0 in stage 28.0 (TID 359) in 519 ms on kvs-in-merlin11.int.kronos.com (45/200) 16/12/27 06:38:10 INFO TaskSetManager: Starting task 46.0 in stage 28.0 (TID 361, kvs-in-merlin11.int.kronos.com, partition 46, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:10 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 361 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:10 INFO TaskSetManager: Finished task 45.0 in stage 28.0 (TID 360) in 560 ms on kvs-in-merlin11.int.kronos.com (46/200) 16/12/27 06:38:11 INFO TaskSetManager: Starting task 47.0 in stage 28.0 (TID 362, kvs-in-merlin11.int.kronos.com, partition 47, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:11 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 362 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:11 INFO TaskSetManager: Finished task 46.0 in stage 28.0 (TID 361) in 599 ms on kvs-in-merlin11.int.kronos.com (47/200) 16/12/27 06:38:12 INFO TaskSetManager: Starting task 48.0 in stage 28.0 (TID 363, kvs-in-merlin11.int.kronos.com, partition 48, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:12 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 363 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:12 INFO TaskSetManager: Finished task 47.0 in stage 28.0 (TID 362) in 562 ms on kvs-in-merlin11.int.kronos.com (48/200) 16/12/27 06:38:12 INFO TaskSetManager: Starting task 49.0 in stage 28.0 (TID 364, kvs-in-merlin11.int.kronos.com, partition 49, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:12 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 364 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:12 INFO TaskSetManager: Finished task 48.0 in stage 28.0 (TID 363) in 777 ms on kvs-in-merlin11.int.kronos.com (49/200) 16/12/27 06:38:13 INFO TaskSetManager: Starting task 50.0 in stage 28.0 (TID 365, kvs-in-merlin11.int.kronos.com, partition 50, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:13 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 365 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:13 INFO TaskSetManager: Finished task 49.0 in stage 28.0 (TID 364) in 543 ms on kvs-in-merlin11.int.kronos.com (50/200) 16/12/27 06:38:13 INFO TaskSetManager: Starting task 51.0 in stage 28.0 (TID 366, kvs-in-merlin11.int.kronos.com, partition 51, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:13 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 366 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:13 INFO TaskSetManager: Finished task 50.0 in stage 28.0 (TID 365) in 451 ms on kvs-in-merlin11.int.kronos.com (51/200) 16/12/27 06:38:14 INFO TaskSetManager: Starting task 52.0 in stage 28.0 (TID 367, kvs-in-merlin11.int.kronos.com, partition 52, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:14 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 367 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:14 INFO TaskSetManager: Finished task 51.0 in stage 28.0 (TID 366) in 361 ms on kvs-in-merlin11.int.kronos.com (52/200) 16/12/27 06:38:14 INFO TaskSetManager: Starting task 53.0 in stage 28.0 (TID 368, kvs-in-merlin11.int.kronos.com, partition 53, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:14 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 368 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:14 INFO TaskSetManager: Finished task 52.0 in stage 28.0 (TID 367) in 268 ms on kvs-in-merlin11.int.kronos.com (53/200) 16/12/27 06:38:14 INFO TaskSetManager: Starting task 54.0 in stage 28.0 (TID 369, kvs-in-merlin11.int.kronos.com, partition 54, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:14 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 369 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com. 16/12/27 06:38:14 INFO TaskSetManager: Finished task 53.0 in stage 28.0 (TID 368) in 341 ms on kvs-in-merlin11.int.kronos.com (54/200) 16/12/27 06:38:15 INFO TaskSetManager: Starting task 55.0 in stage 28.0 (TID 370, kvs-in-merlin11.int.kronos.com, partition 55, RACK_LOCAL, 5550 bytes) 16/12/27 06:38:15 INFO YarnSchedulerBackend$YarnDriverEndpoint: Launching task 370 on executor id: 1 hostname: kvs-in-merlin11.int.kronos.com.