Container: container_e47_1506602683416_0064_01_000003 on hadooptest7.mydomain.com:45454 LogAggregationType: LOCAL ======================================================================================== LogType:hive_20171002172650_1672cd6f-dec7-46ca-bb45-f52491e7ba33-dag_1506602683416_0067_180.log.done LogLastModifiedTime:Mon Oct 02 17:26:58 +0300 2017 LogLength:3289234 LogContents: 2017-10-02T17:26:51,546 INFO [IPC Server handler 3 on 43326 (1506602683416_0067_180_00_000001_0)] shufflehandler.ShuffleHandler: Added token for job_1506602683416_0067 2017-10-02T17:26:51,547 INFO [IPC Server handler 3 on 43326 (1506602683416_0067_180_00_000001_0)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_00_000001_0 : ACCEPTED 2017-10-02T17:26:51,548 INFO [Task-Executor-2 (1506602683416_0067_180_00_000001_0)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Map 1, VertexParallelism: 3, TaskAttemptID:attempt_1506602683416_0067_180_00_000001_0, processorName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=my_source_table, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy }}, ], outputSpecList=[{{ destinationVertexName=Reducer 2, physicalEdgeCount=46, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ] 2017-10-02T17:26:51,548 INFO [Task-Executor-2 (1506602683416_0067_180_00_000001_0)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:51,548 INFO [Task-Executor-2 (1506602683416_0067_180_00_000001_0)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_00_000001_0 vertexName: Map 1 2017-10-02T17:26:51,549 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_00_000001_0 2017-10-02T17:26:51,549 DEBUG [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] log.PerfLogger: 2017-10-02T17:26:51,550 INFO [IPC Server handler 2 on 43326 (1506602683416_0067_180_00_000002_0)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_00_000002_0 : ACCEPTED 2017-10-02T17:26:51,551 INFO [Task-Executor-1 (1506602683416_0067_180_00_000002_0)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Map 1, VertexParallelism: 3, TaskAttemptID:attempt_1506602683416_0067_180_00_000002_0, processorName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=my_source_table, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy }}, ], outputSpecList=[{{ destinationVertexName=Reducer 2, physicalEdgeCount=46, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ] 2017-10-02T17:26:51,551 INFO [Task-Executor-1 (1506602683416_0067_180_00_000002_0)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:51,551 INFO [Task-Executor-1 (1506602683416_0067_180_00_000002_0)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_00_000002_0 vertexName: Map 1 2017-10-02T17:26:51,553 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_00_000002_0 2017-10-02T17:26:51,555 DEBUG [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] log.PerfLogger: 2017-10-02T17:26:51,556 DEBUG [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] log.PerfLogger: 2017-10-02T17:26:51,556 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:51,556 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:51,556 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:51,556 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:51,556 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] resources.MemoryDistributor: InitialRequests=[my_source_table:INPUT:0:org.apache.tez.mapreduce.input.MRInputLegacy], [Reducer 2:OUTPUT:858783744:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput] 2017-10-02T17:26:51,556 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:51,556 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:51,556 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 858783744, TotalRequestedScaled: 7.92723456E8, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.11 2017-10-02T17:26:51,556 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] resources.MemoryDistributor: Allocations=[my_source_table:org.apache.tez.mapreduce.input.MRInputLegacy:INPUT:0:0], [Reducer 2:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:858783744:858783744] 2017-10-02T17:26:51,557 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:51,557 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] runtime.LogicalIOProcessorRuntimeTask: Input: my_source_table being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:51,557 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:51,557 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:51,557 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:51,557 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_00_000001_0 2017-10-02T17:26:51,557 DEBUG [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] log.PerfLogger: 2017-10-02T17:26:51,557 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] exec.ObjectCacheFactory: Created object cache for hive_20171002172650_1672cd6f-dec7-46ca-bb45-f52491e7ba33 2017-10-02T17:26:51,558 DEBUG [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] log.PerfLogger: 2017-10-02T17:26:51,558 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/b23050d0-3c76-4f6e-bac4-b06a8d5d3436/map.xml 2017-10-02T17:26:51,558 DEBUG [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] log.PerfLogger: 2017-10-02T17:26:51,558 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] exec.SerializationUtilities: Deserializing MapWork using kryo 2017-10-02T17:26:51,560 DEBUG [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] log.PerfLogger: 2017-10-02T17:26:51,560 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] exec.Utilities: Deserialized plan (via RPC) - name: Map 1 size: 5.15KB 2017-10-02T17:26:51,561 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] tez.MapRecordProcessor: The input names are: [my_source_table] 2017-10-02T17:26:51,561 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] input.MRInput: Initialized MRInput: my_source_table 2017-10-02T17:26:51,561 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/b23050d0-3c76-4f6e-bac4-b06a8d5d3436/map.xml 2017-10-02T17:26:51,562 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/b23050d0-3c76-4f6e-bac4-b06a8d5d3436/map.xml 2017-10-02T17:26:51,562 DEBUG [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] log.PerfLogger: 2017-10-02T17:26:51,562 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:51,562 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:51,562 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:51,562 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/b23050d0-3c76-4f6e-bac4-b06a8d5d3436/map.xml 2017-10-02T17:26:51,562 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] impl.LlapRecordReader: Received fragment id: 1506602683416_0067_180_00_000001_0 2017-10-02T17:26:51,562 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] orc.OrcInputFormat: Using schema evolution configuration variables schema.evolution.columns [mydate, orgoid, my_dim1, my_dim2, my_dim3, my_dim4, my_dim5, my_measure1, my_measure2, my_dim6, my_dim7, my_dim8] / schema.evolution.columns.types [string, string, string, int, int, int, int, double, bigint, string, string, string] (isAcidRead false) 2017-10-02T17:26:51,564 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:51,564 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] resources.MemoryDistributor: InitialRequests=[my_source_table:INPUT:0:org.apache.tez.mapreduce.input.MRInputLegacy], [Reducer 2:OUTPUT:858783744:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput] 2017-10-02T17:26:51,564 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:51,564 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:51,564 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] impl.LlapRecordReader: DBG: schema: struct len: 12 readerSchema: struct len: 12 2017-10-02T17:26:51,564 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 858783744, TotalRequestedScaled: 7.92723456E8, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.11 2017-10-02T17:26:51,564 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] resources.MemoryDistributor: Allocations=[my_source_table:org.apache.tez.mapreduce.input.MRInputLegacy:INPUT:0:0], [Reducer 2:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:858783744:858783744] 2017-10-02T17:26:51,564 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/b23050d0-3c76-4f6e-bac4-b06a8d5d3436/map.xml 2017-10-02T17:26:51,564 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:51,564 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] runtime.LogicalIOProcessorRuntimeTask: Input: my_source_table being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:51,564 INFO [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Processing data for hdfs://myhdp/apps/hive/warehouse/gs_summary.db/my_source_table/000001_0 2017-10-02T17:26:51,564 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] lib.MRReaderMapred: Processing split: TezGroupedSplit{wrappedSplits=[org.apache.hadoop.hive.ql.io.orc.OrcInputFormat:OrcSplit [hdfs://myhdp/apps/hive/warehouse/gs_summary.db/my_source_table/000001_0, start=3, length=6113770, isOriginal=true, fileLength=6114774, hasFooter=false, hasBase=true, deltas=0]], wrappedInputFormatName='org.apache.hadoop.hive.ql.io.HiveInputFormat', locations=[hadooptest7.mydomain.com], rack='null', length=6113770} 2017-10-02T17:26:51,564 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:51,565 INFO [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] impl.OrcCodecPool: Got brand-new codec SNAPPY 2017-10-02T17:26:51,565 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:51,565 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] input.MRInput: my_source_table initialized RecordReader from event 2017-10-02T17:26:51,565 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:51,565 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] impl.ExternalSorter: Reducer 2 using: memoryMb=819, keySerializerClass=class org.apache.hadoop.hive.ql.io.HiveKey, valueSerializerClass=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@1ada7eb2, comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator@64872f26, partitioner=org.apache.tez.mapreduce.partition.MRPartitioner, serialization=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.hadoop.io.serializer.WritableSerialization 2017-10-02T17:26:51,565 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_00_000002_0 2017-10-02T17:26:51,565 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] partition.MRPartitioner: Using oldApi, MRpartitionerClass=org.apache.hadoop.hive.ql.io.DefaultHivePartitioner 2017-10-02T17:26:51,565 DEBUG [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] log.PerfLogger: 2017-10-02T17:26:51,565 DEBUG [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] log.PerfLogger: 2017-10-02T17:26:51,565 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] impl.PipelinedSorter: Setting up PipelinedSorter for Reducer 2: , UsingHashComparator=true 2017-10-02T17:26:51,566 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/b23050d0-3c76-4f6e-bac4-b06a8d5d3436/map.xml 2017-10-02T17:26:51,566 DEBUG [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] log.PerfLogger: 2017-10-02T17:26:51,566 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] exec.SerializationUtilities: Deserializing MapWork using kryo 2017-10-02T17:26:51,568 DEBUG [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] log.PerfLogger: 2017-10-02T17:26:51,568 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] exec.Utilities: Deserialized plan (via RPC) - name: Map 1 size: 5.15KB 2017-10-02T17:26:51,569 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] tez.MapRecordProcessor: The input names are: [my_source_table] 2017-10-02T17:26:51,569 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] input.MRInput: Initialized MRInput: my_source_table 2017-10-02T17:26:51,569 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/b23050d0-3c76-4f6e-bac4-b06a8d5d3436/map.xml 2017-10-02T17:26:51,570 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/b23050d0-3c76-4f6e-bac4-b06a8d5d3436/map.xml 2017-10-02T17:26:51,570 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/b23050d0-3c76-4f6e-bac4-b06a8d5d3436/map.xml 2017-10-02T17:26:51,570 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.LlapRecordReader: Received fragment id: 1506602683416_0067_180_00_000002_0 2017-10-02T17:26:51,570 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] orc.OrcInputFormat: Using schema evolution configuration variables schema.evolution.columns [mydate, orgoid, my_dim1, my_dim2, my_dim3, my_dim4, my_dim5, my_measure1, my_measure2, my_dim6, my_dim7, my_dim8] / schema.evolution.columns.types [string, string, string, int, int, int, int, double, bigint, string, string, string] (isAcidRead false) 2017-10-02T17:26:51,572 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.OrcCodecPool: Got brand-new codec SNAPPY 2017-10-02T17:26:51,572 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.LlapRecordReader: DBG: schema: struct len: 12 readerSchema: struct len: 12 2017-10-02T17:26:51,572 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/b23050d0-3c76-4f6e-bac4-b06a8d5d3436/map.xml 2017-10-02T17:26:51,572 INFO [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Processing data for hdfs://myhdp/apps/hive/warehouse/gs_summary.db/my_source_table/000002_0 2017-10-02T17:26:51,572 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] lib.MRReaderMapred: Processing split: TezGroupedSplit{wrappedSplits=[org.apache.hadoop.hive.ql.io.orc.OrcInputFormat:OrcSplit [hdfs://myhdp/apps/hive/warehouse/gs_summary.db/my_source_table/000002_0, start=3, length=5802002, isOriginal=true, fileLength=5803008, hasFooter=false, hasBase=true, deltas=0]], wrappedInputFormatName='org.apache.hadoop.hive.ql.io.HiveInputFormat', locations=[hadooptest7.mydomain.com], rack='null', length=5802002} 2017-10-02T17:26:51,573 INFO [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] impl.OrcCodecPool: Got brand-new codec SNAPPY 2017-10-02T17:26:51,573 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] input.MRInput: my_source_table initialized RecordReader from event 2017-10-02T17:26:51,573 INFO [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] impl.OrcCodecPool: Got brand-new codec SNAPPY 2017-10-02T17:26:51,573 INFO [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] impl.OrcCodecPool: Got brand-new codec SNAPPY 2017-10-02T17:26:51,573 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.ExternalSorter: Reducer 2 using: memoryMb=819, keySerializerClass=class org.apache.hadoop.hive.ql.io.HiveKey, valueSerializerClass=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@527f53ff, comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator@229657ed, partitioner=org.apache.tez.mapreduce.partition.MRPartitioner, serialization=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.hadoop.io.serializer.WritableSerialization 2017-10-02T17:26:51,578 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] impl.PipelinedSorter: Newly allocated block size=33554368, index=0, Number of buffers=1, currentAllocatableMemory=825229376, currentBufferSize=33554368, total=858783744 2017-10-02T17:26:51,578 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] impl.PipelinedSorter: Setting up PipelinedSorter for Reducer 2: , UsingHashComparator=true#blocks=26, maxMemUsage=858783744, lazyAllocateMem=true, minBlockSize=268435392, initial BLOCK_SIZE=33554368, finalMergeEnabled=false, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=819 2017-10-02T17:26:51,578 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] impl.PipelinedSorter: Reducer 2: reserved.remaining()=33554368, reserved.metasize=16777184 2017-10-02T17:26:51,578 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] partition.MRPartitioner: Using oldApi, MRpartitionerClass=org.apache.hadoop.hive.ql.io.DefaultHivePartitioner 2017-10-02T17:26:51,578 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] tez.MapRecordProcessor: Main input name is Map 1 2017-10-02T17:26:51,578 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] vector.VectorMapOperator: Initializing operator MAP[0] 2017-10-02T17:26:51,578 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.PipelinedSorter: Setting up PipelinedSorter for Reducer 2: , UsingHashComparator=true 2017-10-02T17:26:51,579 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] tez.MapRecordProcessor: Id =0 null <\Children> <\Parent> <\MAP> 2017-10-02T17:26:51,579 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] tez.MapRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:51,579 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] exec.TableScanOperator: Initializing operator TS[0] 2017-10-02T17:26:51,579 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] vector.VectorSelectOperator: Initializing operator SEL[11] 2017-10-02T17:26:51,579 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] vector.VectorGroupByOperator: Initializing operator GBY[12] 2017-10-02T17:26:51,580 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] vector.VectorGroupByOperator: VectorGroupByOperator is vector output true 2017-10-02T17:26:51,581 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] reducesink.VectorReduceSinkMultiKeyOperator: Initializing operator RS[13] 2017-10-02T17:26:51,581 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] reducesink.VectorReduceSinkCommonOperator: Using tag = -1 2017-10-02T17:26:51,581 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] exec.OperatorUtils: Setting output collector: RS[13] --> Reducer 2 2017-10-02T17:26:51,581 DEBUG [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] log.PerfLogger: 2017-10-02T17:26:51,589 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.PipelinedSorter: Newly allocated block size=33554368, index=0, Number of buffers=1, currentAllocatableMemory=825229376, currentBufferSize=33554368, total=858783744 2017-10-02T17:26:51,589 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.PipelinedSorter: Setting up PipelinedSorter for Reducer 2: , UsingHashComparator=true#blocks=26, maxMemUsage=858783744, lazyAllocateMem=true, minBlockSize=268435392, initial BLOCK_SIZE=33554368, finalMergeEnabled=false, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=819 2017-10-02T17:26:51,589 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.PipelinedSorter: Reducer 2: reserved.remaining()=33554368, reserved.metasize=16777184 2017-10-02T17:26:51,589 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] tez.MapRecordProcessor: Main input name is Map 1 2017-10-02T17:26:51,589 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] vector.VectorMapOperator: Initializing operator MAP[0] 2017-10-02T17:26:51,590 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] tez.MapRecordProcessor: Id =0 null <\Children> <\Parent> <\MAP> 2017-10-02T17:26:51,590 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] tez.MapRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:51,590 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] exec.TableScanOperator: Initializing operator TS[0] 2017-10-02T17:26:51,590 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] vector.VectorSelectOperator: Initializing operator SEL[11] 2017-10-02T17:26:51,591 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] vector.VectorGroupByOperator: Initializing operator GBY[12] 2017-10-02T17:26:51,591 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] vector.VectorGroupByOperator: VectorGroupByOperator is vector output true 2017-10-02T17:26:51,592 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] reducesink.VectorReduceSinkMultiKeyOperator: Initializing operator RS[13] 2017-10-02T17:26:51,593 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] reducesink.VectorReduceSinkCommonOperator: Using tag = -1 2017-10-02T17:26:51,593 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] exec.OperatorUtils: Setting output collector: RS[13] --> Reducer 2 2017-10-02T17:26:51,593 DEBUG [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] log.PerfLogger: 2017-10-02T17:26:51,631 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,635 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,635 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,635 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,637 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,637 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,637 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,641 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,641 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,641 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,643 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,644 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,646 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,647 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,650 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,661 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,671 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,671 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,672 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,672 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,672 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,673 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,673 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,673 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,674 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,674 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,674 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,675 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,676 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,677 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,677 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,682 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,683 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,696 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,696 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,699 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,706 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,708 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,714 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,730 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,737 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,741 WARN [IO-Elevator-Thread-2 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,750 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,774 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,784 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,798 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:51,808 WARN [IO-Elevator-Thread-0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Failed to allocate despite reserved memory; will retry 2017-10-02T17:26:52,038 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] reducesink.VectorReduceSinkCommonOperator: RS[13]: records written - 1 2017-10-02T17:26:52,038 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] reducesink.VectorReduceSinkCommonOperator: RS[13]: records written - 10 2017-10-02T17:26:52,038 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] reducesink.VectorReduceSinkCommonOperator: RS[13]: records written - 100 2017-10-02T17:26:52,039 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] reducesink.VectorReduceSinkCommonOperator: RS[13]: records written - 1000 2017-10-02T17:26:52,054 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] reducesink.VectorReduceSinkCommonOperator: RS[13]: records written - 10000 2017-10-02T17:26:52,057 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] reducesink.VectorReduceSinkCommonOperator: RS[13]: records written - 1 2017-10-02T17:26:52,057 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] reducesink.VectorReduceSinkCommonOperator: RS[13]: records written - 10 2017-10-02T17:26:52,057 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] reducesink.VectorReduceSinkCommonOperator: RS[13]: records written - 100 2017-10-02T17:26:52,058 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] reducesink.VectorReduceSinkCommonOperator: RS[13]: records written - 1000 2017-10-02T17:26:52,072 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] reducesink.VectorReduceSinkCommonOperator: RS[13]: records written - 10000 2017-10-02T17:26:52,206 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] reducesink.VectorReduceSinkCommonOperator: RS[13]: records written - 100000 2017-10-02T17:26:52,207 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] vector.VectorGroupByOperator: using unsorted streaming aggregation processing mode 2017-10-02T17:26:52,224 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] reducesink.VectorReduceSinkCommonOperator: RS[13]: records written - 100000 2017-10-02T17:26:52,226 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] vector.VectorGroupByOperator: using unsorted streaming aggregation processing mode 2017-10-02T17:26:52,952 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] impl.PipelinedSorter: Reducer 2: Span0.length = 292110, perItem = 57 2017-10-02T17:26:53,005 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] impl.PipelinedSorter: Newly allocated block size=268435392, index=1, Number of buffers=2, currentAllocatableMemory=556793984, currentBufferSize=268435392, total=858783744 2017-10-02T17:26:53,005 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] impl.PipelinedSorter: Reducer 2: Getting memory from next block in the list, recordsWritten=292110 2017-10-02T17:26:53,005 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] impl.PipelinedSorter: Reducer 2: reserved.remaining()=268435392, reserved.metasize=16777216 2017-10-02T17:26:53,005 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] impl.PipelinedSorter: Reducer 2: New Span1.length = 1048576, perItem = 16, counter:292110 2017-10-02T17:26:53,026 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.PipelinedSorter: Reducer 2: Span0.length = 292123, perItem = 57 2017-10-02T17:26:53,084 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.PipelinedSorter: Newly allocated block size=268435392, index=1, Number of buffers=2, currentAllocatableMemory=556793984, currentBufferSize=268435392, total=858783744 2017-10-02T17:26:53,084 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.PipelinedSorter: Reducer 2: Getting memory from next block in the list, recordsWritten=292123 2017-10-02T17:26:53,084 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.PipelinedSorter: Reducer 2: reserved.remaining()=268435392, reserved.metasize=16777216 2017-10-02T17:26:53,084 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] impl.PipelinedSorter: Reducer 2: New Span1.length = 1048576, perItem = 16, counter:292123 2017-10-02T17:26:53,527 INFO [TezTR-683416_67_180_0_1_0 (1506602683416_0067_180_00_000001_0)] LlapIoImpl: Llap counters: Fragment counters for [hadooptest7.mydomain.com/10.251.55.187, gs_summary.my_source_table, hdfs://myhdp/apps/hive/warehouse/gs_summary.db/my_source_table/000001_0 (1485306), 0,1]: [ NUM_VECTOR_BATCHES=428, NUM_DECODED_BATCHES=43, SELECTED_ROWGROUPS=43, NUM_ERRORS=0, ROWS_EMITTED=427481, METADATA_CACHE_HIT=2, METADATA_CACHE_MISS=0, CACHE_HIT_BYTES=0, CACHE_MISS_BYTES=5069536, ALLOCATED_BYTES=10223616, ALLOCATED_USED_BYTES=7210405, TOTAL_IO_TIME_NS=253370371, DECODE_TIME_NS=153859749, HDFS_TIME_NS=66450389, CONSUMER_TIME_NS=1874586815 ] 2017-10-02T17:26:53,567 INFO [TezTR-683416_67_180_0_2_0 (1506602683416_0067_180_00_000002_0)] LlapIoImpl: Llap counters: Fragment counters for [hadooptest7.mydomain.com/10.251.55.187, gs_summary.my_source_table, hdfs://myhdp/apps/hive/warehouse/gs_summary.db/my_source_table/000002_0 (1485309), 0,1]: [ NUM_VECTOR_BATCHES=406, NUM_DECODED_BATCHES=41, SELECTED_ROWGROUPS=41, NUM_ERRORS=0, ROWS_EMITTED=405911, METADATA_CACHE_HIT=2, METADATA_CACHE_MISS=0, CACHE_HIT_BYTES=0, CACHE_MISS_BYTES=4810407, ALLOCATED_BYTES=9699328, ALLOCATED_USED_BYTES=6842812, TOTAL_IO_TIME_NS=269592701, DECODE_TIME_NS=125616446, HDFS_TIME_NS=98081733, CONSUMER_TIME_NS=1882430921 ] 2017-10-02T17:26:53,962 INFO [Task-Executor-1 (1506602683416_0067_180_00_000002_0)] task.TezTaskRunner2: TaskRunnerResult for attempt_1506602683416_0067_180_00_000002_0 : TaskRunner2Result{endReason=SUCCESS, containerShutdownRequested=false} 2017-10-02T17:26:53,962 INFO [Task-Executor-1 (1506602683416_0067_180_00_000002_0)] impl.LlapTaskReporter: Unregistered counters for fragment: 1506602683416_0067_180_00_000002_0 2017-10-02T17:26:53,962 INFO [Task-Executor-1 (1506602683416_0067_180_00_000002_0)] impl.TaskRunnerCallable: ExecutionTime for Container: container_222212222_0067_01_007482=2411 2017-10-02T17:26:54,057 INFO [Task-Executor-2 (1506602683416_0067_180_00_000001_0)] task.TezTaskRunner2: TaskRunnerResult for attempt_1506602683416_0067_180_00_000001_0 : TaskRunner2Result{endReason=SUCCESS, containerShutdownRequested=false} 2017-10-02T17:26:54,058 INFO [Task-Executor-2 (1506602683416_0067_180_00_000001_0)] impl.LlapTaskReporter: Unregistered counters for fragment: 1506602683416_0067_180_00_000001_0 2017-10-02T17:26:54,058 INFO [Task-Executor-2 (1506602683416_0067_180_00_000001_0)] impl.TaskRunnerCallable: ExecutionTime for Container: container_222212222_0067_01_007481=2510 2017-10-02T17:26:55,016 INFO [IPC Server handler 4 on 43326 (1506602683416_0067_180_01_000004_0)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_01_000004_0 : ACCEPTED 2017-10-02T17:26:55,017 INFO [Task-Executor-2 (1506602683416_0067_180_01_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Reducer 2, VertexParallelism: 10, TaskAttemptID:attempt_1506602683416_0067_180_01_000004_0, processorName=org.apache.hadoop.hive.ql.exec.tez.ReduceTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=Map 1, physicalEdgeCount=15, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=Reducer 3, physicalEdgeCount=46, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ] 2017-10-02T17:26:55,017 INFO [Task-Executor-2 (1506602683416_0067_180_01_000004_0)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:55,017 INFO [Task-Executor-2 (1506602683416_0067_180_01_000004_0)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_01_000004_0 vertexName: Reducer 2 2017-10-02T17:26:55,017 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_01_000004_0 2017-10-02T17:26:55,018 INFO [IPC Server handler 0 on 43326 (1506602683416_0067_180_01_000007_0)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_01_000007_0 : ACCEPTED 2017-10-02T17:26:55,018 INFO [Task-Executor-1 (1506602683416_0067_180_01_000007_0)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Reducer 2, VertexParallelism: 10, TaskAttemptID:attempt_1506602683416_0067_180_01_000007_0, processorName=org.apache.hadoop.hive.ql.exec.tez.ReduceTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=Map 1, physicalEdgeCount=15, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=Reducer 3, physicalEdgeCount=46, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ] 2017-10-02T17:26:55,018 DEBUG [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] log.PerfLogger: 2017-10-02T17:26:55,018 INFO [Task-Executor-1 (1506602683416_0067_180_01_000007_0)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:55,019 INFO [Task-Executor-1 (1506602683416_0067_180_01_000007_0)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_01_000007_0 vertexName: Reducer 2 2017-10-02T17:26:55,019 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_01_000007_0 2017-10-02T17:26:55,020 INFO [IPC Server handler 3 on 43326 (1506602683416_0067_180_01_000008_0)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_01_000008_0 : ACCEPTED 2017-10-02T17:26:55,020 DEBUG [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] log.PerfLogger: 2017-10-02T17:26:55,020 INFO [Task-Executor-0 (1506602683416_0067_180_01_000008_0)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Reducer 2, VertexParallelism: 10, TaskAttemptID:attempt_1506602683416_0067_180_01_000008_0, processorName=org.apache.hadoop.hive.ql.exec.tez.ReduceTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=Map 1, physicalEdgeCount=15, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=Reducer 3, physicalEdgeCount=46, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ] 2017-10-02T17:26:55,021 INFO [Task-Executor-0 (1506602683416_0067_180_01_000008_0)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:55,021 INFO [Task-Executor-0 (1506602683416_0067_180_01_000008_0)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_01_000008_0 vertexName: Reducer 2 2017-10-02T17:26:55,021 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_01_000008_0 2017-10-02T17:26:55,024 DEBUG [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] log.PerfLogger: 2017-10-02T17:26:55,025 DEBUG [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] log.PerfLogger: 2017-10-02T17:26:55,025 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:55,025 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:55,025 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:55,025 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:55,025 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] resources.MemoryDistributor: InitialRequests=[Reducer 3:OUTPUT:858783744:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput], [Map 1:INPUT:1468708992:org.apache.tez.runtime.library.input.OrderedGroupedKVInput] 2017-10-02T17:26:55,025 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:55,025 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:55,025 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 24, TotalRequested: 2327492736, TotalRequestedScaled: 1.163746368E9, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.30 2017-10-02T17:26:55,026 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] resources.MemoryDistributor: Allocations=[Reducer 3:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:858783744:858783744], [Map 1:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:1468708992:1468708992] 2017-10-02T17:26:55,026 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:55,027 DEBUG [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] log.PerfLogger: 2017-10-02T17:26:55,027 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:55,027 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:55,027 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:55,027 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Input: Map 1 being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:55,028 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:55,028 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] resources.MemoryDistributor: InitialRequests=[Map 1:INPUT:1468708992:org.apache.tez.runtime.library.input.OrderedGroupedKVInput], [Reducer 3:OUTPUT:858783744:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput] 2017-10-02T17:26:55,028 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:55,029 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:55,029 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:55,029 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:55,029 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:55,029 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 24, TotalRequested: 2327492736, TotalRequestedScaled: 1.163746368E9, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.30 2017-10-02T17:26:55,029 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] resources.MemoryDistributor: Allocations=[Map 1:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:1468708992:1468708992], [Reducer 3:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:858783744:858783744] 2017-10-02T17:26:55,029 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:55,030 DEBUG [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] log.PerfLogger: 2017-10-02T17:26:55,030 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:55,030 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:55,030 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:55,030 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:55,030 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] resources.MemoryDistributor: InitialRequests=[Map 1:INPUT:1468708992:org.apache.tez.runtime.library.input.OrderedGroupedKVInput], [Reducer 3:OUTPUT:858783744:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput] 2017-10-02T17:26:55,030 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_01_000004_0 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] runtime.LogicalIOProcessorRuntimeTask: Input: Map 1 being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:55,031 DEBUG [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] log.PerfLogger: 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 24, TotalRequested: 2327492736, TotalRequestedScaled: 1.163746368E9, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.30 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] resources.MemoryDistributor: Allocations=[Map 1:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:1468708992:1468708992], [Reducer 3:org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput:OUTPUT:858783744:858783744] 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/16dccea3-dfcd-4921-b62a-0c16b17db149/reduce.xml 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] runtime.LogicalIOProcessorRuntimeTask: Input: Map 1 being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:55,031 DEBUG [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] log.PerfLogger: 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] exec.SerializationUtilities: Deserializing ReduceWork using kryo 2017-10-02T17:26:55,031 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:55,032 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:55,032 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_01_000007_0 2017-10-02T17:26:55,032 DEBUG [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] log.PerfLogger: 2017-10-02T17:26:55,033 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/16dccea3-dfcd-4921-b62a-0c16b17db149/reduce.xml 2017-10-02T17:26:55,033 DEBUG [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] log.PerfLogger: 2017-10-02T17:26:55,033 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] exec.Utilities: Deserialized plan (via RPC) - name: Reducer 2 size: 2.92KB 2017-10-02T17:26:55,033 DEBUG [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] log.PerfLogger: 2017-10-02T17:26:55,033 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] exec.SerializationUtilities: Deserializing ReduceWork using kryo 2017-10-02T17:26:55,033 DEBUG [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] log.PerfLogger: 2017-10-02T17:26:55,034 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] tez.ReduceRecordProcessor: Waiting for ShuffleInputs to become ready 2017-10-02T17:26:55,034 DEBUG [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] log.PerfLogger: 2017-10-02T17:26:55,034 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] exec.Utilities: Deserialized plan (via RPC) - name: Reducer 2 size: 2.92KB 2017-10-02T17:26:55,034 DEBUG [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] log.PerfLogger: 2017-10-02T17:26:55,034 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:55,035 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] tez.ReduceRecordProcessor: Waiting for ShuffleInputs to become ready 2017-10-02T17:26:55,035 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_01_000008_0 2017-10-02T17:26:55,035 DEBUG [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] log.PerfLogger: 2017-10-02T17:26:55,035 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/16dccea3-dfcd-4921-b62a-0c16b17db149/reduce.xml 2017-10-02T17:26:55,036 DEBUG [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] log.PerfLogger: 2017-10-02T17:26:55,036 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] exec.SerializationUtilities: Deserializing ReduceWork using kryo 2017-10-02T17:26:55,037 DEBUG [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] log.PerfLogger: 2017-10-02T17:26:55,037 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] exec.Utilities: Deserialized plan (via RPC) - name: Reducer 2 size: 2.92KB 2017-10-02T17:26:55,037 DEBUG [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] log.PerfLogger: 2017-10-02T17:26:55,038 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] tez.ReduceRecordProcessor: Waiting for ShuffleInputs to become ready 2017-10-02T17:26:55,212 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] tez.ReduceRecordProcessor: Main work is Reducer 2 2017-10-02T17:26:55,212 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] tez.ReduceRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:55,212 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] tez.ReduceRecordProcessor: Main work is Reducer 2 2017-10-02T17:26:55,212 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] tez.ReduceRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:55,212 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] input.OrderedGroupedKVInput: Map 1: creating ValuesIterator with comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator, keyClass=org.apache.hadoop.hive.ql.io.HiveKey, valClass=org.apache.hadoop.io.BytesWritable 2017-10-02T17:26:55,213 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] input.OrderedGroupedKVInput: Map 1: creating ValuesIterator with comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator, keyClass=org.apache.hadoop.hive.ql.io.HiveKey, valClass=org.apache.hadoop.io.BytesWritable 2017-10-02T17:26:55,213 DEBUG [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] log.PerfLogger: 2017-10-02T17:26:55,213 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] vector.VectorGroupByOperator: Initializing operator GBY[14] 2017-10-02T17:26:55,213 DEBUG [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] log.PerfLogger: 2017-10-02T17:26:55,213 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] vector.VectorGroupByOperator: Initializing operator GBY[14] 2017-10-02T17:26:55,213 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] vector.VectorGroupByOperator: VectorGroupByOperator is vector output true 2017-10-02T17:26:55,213 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] vector.VectorGroupByOperator: VectorGroupByOperator is vector output true 2017-10-02T17:26:55,213 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] vector.VectorGroupByOperator: using sorted group batch aggregation processing mode 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] vector.VectorGroupByOperator: using sorted group batch aggregation processing mode 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] vector.VectorSelectOperator: Initializing operator SEL[15] 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] vector.VectorSelectOperator: Initializing operator SEL[15] 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] reducesink.VectorReduceSinkMultiKeyOperator: Initializing operator RS[16] 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] reducesink.VectorReduceSinkMultiKeyOperator: Initializing operator RS[16] 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] reducesink.VectorReduceSinkCommonOperator: Using tag = -1 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] reducesink.VectorReduceSinkCommonOperator: Using tag = -1 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] tez.ReduceRecordProcessor: Id =14 Id =15 Id =16 <\Children> Id = 15 null<\Parent> <\RS> <\Children> Id = 14 null<\Parent> <\SEL> <\Children> <\Parent> <\GBY> 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] tez.ReduceRecordProcessor: Id =14 Id =15 Id =16 <\Children> Id = 15 null<\Parent> <\RS> <\Children> Id = 14 null<\Parent> <\SEL> <\Children> <\Parent> <\GBY> 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] exec.OperatorUtils: Setting output collector: RS[16] --> Reducer 3 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] exec.OperatorUtils: Setting output collector: RS[16] --> Reducer 3 2017-10-02T17:26:55,214 DEBUG [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] log.PerfLogger: 2017-10-02T17:26:55,214 DEBUG [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] log.PerfLogger: 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] tez.ReduceRecordProcessor: Starting Output: Reducer 3 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] tez.ReduceRecordProcessor: Starting Output: Reducer 3 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] impl.ExternalSorter: Reducer 3 using: memoryMb=819, keySerializerClass=class org.apache.hadoop.hive.ql.io.HiveKey, valueSerializerClass=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@20285e52, comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator@5c13ba78, partitioner=org.apache.tez.mapreduce.partition.MRPartitioner, serialization=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.hadoop.io.serializer.WritableSerialization 2017-10-02T17:26:55,214 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] impl.ExternalSorter: Reducer 3 using: memoryMb=819, keySerializerClass=class org.apache.hadoop.hive.ql.io.HiveKey, valueSerializerClass=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@3af19dde, comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator@631af226, partitioner=org.apache.tez.mapreduce.partition.MRPartitioner, serialization=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.hadoop.io.serializer.WritableSerialization 2017-10-02T17:26:55,215 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] partition.MRPartitioner: Using oldApi, MRpartitionerClass=org.apache.hadoop.hive.ql.io.DefaultHivePartitioner 2017-10-02T17:26:55,215 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] partition.MRPartitioner: Using oldApi, MRpartitionerClass=org.apache.hadoop.hive.ql.io.DefaultHivePartitioner 2017-10-02T17:26:55,215 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] impl.PipelinedSorter: Setting up PipelinedSorter for Reducer 3: , UsingHashComparator=true 2017-10-02T17:26:55,215 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] impl.PipelinedSorter: Setting up PipelinedSorter for Reducer 3: , UsingHashComparator=true 2017-10-02T17:26:55,223 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] impl.PipelinedSorter: Newly allocated block size=33554368, index=0, Number of buffers=1, currentAllocatableMemory=825229376, currentBufferSize=33554368, total=858783744 2017-10-02T17:26:55,223 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] tez.ReduceRecordProcessor: Main work is Reducer 2 2017-10-02T17:26:55,223 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] impl.PipelinedSorter: Setting up PipelinedSorter for Reducer 3: , UsingHashComparator=true#blocks=26, maxMemUsage=858783744, lazyAllocateMem=true, minBlockSize=268435392, initial BLOCK_SIZE=33554368, finalMergeEnabled=false, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=819 2017-10-02T17:26:55,223 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] tez.ReduceRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:55,223 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] impl.PipelinedSorter: Reducer 3: reserved.remaining()=33554368, reserved.metasize=16777184 2017-10-02T17:26:55,223 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] input.OrderedGroupedKVInput: Map 1: creating ValuesIterator with comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator, keyClass=org.apache.hadoop.hive.ql.io.HiveKey, valClass=org.apache.hadoop.io.BytesWritable 2017-10-02T17:26:55,224 DEBUG [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] log.PerfLogger: 2017-10-02T17:26:55,224 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] vector.VectorGroupByOperator: Initializing operator GBY[14] 2017-10-02T17:26:55,224 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] vector.VectorGroupByOperator: VectorGroupByOperator is vector output true 2017-10-02T17:26:55,224 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] vector.VectorGroupByOperator: using sorted group batch aggregation processing mode 2017-10-02T17:26:55,224 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] vector.VectorSelectOperator: Initializing operator SEL[15] 2017-10-02T17:26:55,225 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] reducesink.VectorReduceSinkMultiKeyOperator: Initializing operator RS[16] 2017-10-02T17:26:55,225 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] reducesink.VectorReduceSinkCommonOperator: Using tag = -1 2017-10-02T17:26:55,225 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] tez.ReduceRecordProcessor: Id =14 Id =15 Id =16 <\Children> Id = 15 null<\Parent> <\RS> <\Children> Id = 14 null<\Parent> <\SEL> <\Children> <\Parent> <\GBY> 2017-10-02T17:26:55,225 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] exec.OperatorUtils: Setting output collector: RS[16] --> Reducer 3 2017-10-02T17:26:55,225 DEBUG [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] log.PerfLogger: 2017-10-02T17:26:55,225 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] tez.ReduceRecordProcessor: Starting Output: Reducer 3 2017-10-02T17:26:55,225 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] impl.ExternalSorter: Reducer 3 using: memoryMb=819, keySerializerClass=class org.apache.hadoop.hive.ql.io.HiveKey, valueSerializerClass=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@7beaffee, comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator@1da23383, partitioner=org.apache.tez.mapreduce.partition.MRPartitioner, serialization=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.hadoop.io.serializer.WritableSerialization 2017-10-02T17:26:55,226 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] partition.MRPartitioner: Using oldApi, MRpartitionerClass=org.apache.hadoop.hive.ql.io.DefaultHivePartitioner 2017-10-02T17:26:55,226 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] impl.PipelinedSorter: Setting up PipelinedSorter for Reducer 3: , UsingHashComparator=true 2017-10-02T17:26:55,226 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] impl.PipelinedSorter: Newly allocated block size=33554368, index=0, Number of buffers=1, currentAllocatableMemory=825229376, currentBufferSize=33554368, total=858783744 2017-10-02T17:26:55,226 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] impl.PipelinedSorter: Setting up PipelinedSorter for Reducer 3: , UsingHashComparator=true#blocks=26, maxMemUsage=858783744, lazyAllocateMem=true, minBlockSize=268435392, initial BLOCK_SIZE=33554368, finalMergeEnabled=false, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=819 2017-10-02T17:26:55,226 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] impl.PipelinedSorter: Reducer 3: reserved.remaining()=33554368, reserved.metasize=16777184 2017-10-02T17:26:55,233 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 1 2017-10-02T17:26:55,233 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 10 2017-10-02T17:26:55,233 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 100 2017-10-02T17:26:55,235 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 1000 2017-10-02T17:26:55,235 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] impl.PipelinedSorter: Newly allocated block size=33554368, index=0, Number of buffers=1, currentAllocatableMemory=825229376, currentBufferSize=33554368, total=858783744 2017-10-02T17:26:55,235 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] impl.PipelinedSorter: Setting up PipelinedSorter for Reducer 3: , UsingHashComparator=true#blocks=26, maxMemUsage=858783744, lazyAllocateMem=true, minBlockSize=268435392, initial BLOCK_SIZE=33554368, finalMergeEnabled=false, pipelinedShuffle=false, sendEmptyPartitions=true, tez.runtime.io.sort.mb=819 2017-10-02T17:26:55,235 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] impl.PipelinedSorter: Reducer 3: reserved.remaining()=33554368, reserved.metasize=16777184 2017-10-02T17:26:55,258 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 1 2017-10-02T17:26:55,258 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 10 2017-10-02T17:26:55,258 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 100 2017-10-02T17:26:55,260 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 1 2017-10-02T17:26:55,261 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 10 2017-10-02T17:26:55,261 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 100 2017-10-02T17:26:55,262 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 1000 2017-10-02T17:26:55,272 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 1000 2017-10-02T17:26:55,309 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 10000 2017-10-02T17:26:55,317 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 10000 2017-10-02T17:26:55,332 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 10000 2017-10-02T17:26:55,677 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 100000 2017-10-02T17:26:55,704 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 100000 2017-10-02T17:26:55,724 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 100000 2017-10-02T17:26:55,957 DEBUG [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] log.PerfLogger: 2017-10-02T17:26:55,957 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] vector.VectorGroupByOperator: Closing operator GBY[14] 2017-10-02T17:26:55,958 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] vector.VectorSelectOperator: Closing operator SEL[15] 2017-10-02T17:26:55,958 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] reducesink.VectorReduceSinkMultiKeyOperator: Closing operator RS[16] 2017-10-02T17:26:55,959 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 165593 2017-10-02T17:26:55,959 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] reducesink.VectorReduceSinkMultiKeyOperator: RECORDS_OUT_INTERMEDIATE_Reducer_2:165593, 2017-10-02T17:26:55,959 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] task.TaskRunner2Callable: Closing task, taskAttemptId=attempt_1506602683416_0067_180_01_000007_0 2017-10-02T17:26:55,959 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] orderedgrouped.Shuffle: Shutting down Shuffle for source: Map_1 2017-10-02T17:26:55,959 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] orderedgrouped.ShuffleInputEventHandlerOrderedGrouped: Map 1: numDmeEventsSeen=15, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose 2017-10-02T17:26:55,959 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] impl.PipelinedSorter: Reducer 3: Starting flush of map output 2017-10-02T17:26:55,959 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] impl.PipelinedSorter: Reducer 3: Span0.length = 165593, perItem = 56 2017-10-02T17:26:55,983 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] impl.PipelinedSorter: Reducer 3: done sorting span=0, length=165593, time=24 2017-10-02T17:26:55,984 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] impl.PipelinedSorter: Reducer 3: Heap = SpanIterator<0:165592> (span=Span[16777184,9345318]), 2017-10-02T17:26:55,985 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] impl.PipelinedSorter: Reducer 3: Spilling to /data1/hadoop/yarn/local/usercache/hive/appcache/application_1506602683416_0064/usercache/hive/appcache/application_1506602683416_0067/180/output/attempt_1506602683416_0067_180_01_000007_0_29823_0/file.out 2017-10-02T17:26:56,022 DEBUG [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] log.PerfLogger: 2017-10-02T17:26:56,022 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] vector.VectorGroupByOperator: Closing operator GBY[14] 2017-10-02T17:26:56,024 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] vector.VectorSelectOperator: Closing operator SEL[15] 2017-10-02T17:26:56,024 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] reducesink.VectorReduceSinkMultiKeyOperator: Closing operator RS[16] 2017-10-02T17:26:56,024 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 165589 2017-10-02T17:26:56,024 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] reducesink.VectorReduceSinkMultiKeyOperator: RECORDS_OUT_INTERMEDIATE_Reducer_2:165589, 2017-10-02T17:26:56,024 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] task.TaskRunner2Callable: Closing task, taskAttemptId=attempt_1506602683416_0067_180_01_000008_0 2017-10-02T17:26:56,024 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] orderedgrouped.Shuffle: Shutting down Shuffle for source: Map_1 2017-10-02T17:26:56,025 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] orderedgrouped.ShuffleInputEventHandlerOrderedGrouped: Map 1: numDmeEventsSeen=15, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose 2017-10-02T17:26:56,025 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] impl.PipelinedSorter: Reducer 3: Starting flush of map output 2017-10-02T17:26:56,025 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] impl.PipelinedSorter: Reducer 3: Span0.length = 165589, perItem = 56 2017-10-02T17:26:56,045 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] shuffle.ShuffleUtils: EmptyPartition bitsetSize=29, numOutputs=46, emptyPartitions=29, compressedSize=14 2017-10-02T17:26:56,045 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] impl.PipelinedSorter: Reducer 3: Adding spill event for spill (final update=true), spillId=0 2017-10-02T17:26:56,045 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] runtime.LogicalIOProcessorRuntimeTask: Joining on EventRouter 2017-10-02T17:26:56,046 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] task.TaskRunner2Callable: Task completed, taskAttemptId=attempt_1506602683416_0067_180_01_000007_0, askedToStop=false 2017-10-02T17:26:56,046 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] task.TaskRunner2Callable: Cleaning up task attempt_1506602683416_0067_180_01_000007_0, stopRequested=false 2017-10-02T17:26:56,046 INFO [TezTR-683416_67_180_1_7_0 (1506602683416_0067_180_01_000007_0)] runtime.LogicalIOProcessorRuntimeTask: Final Counters for attempt_1506602683416_0067_180_01_000007_0: Counters: 72 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=165593, REDUCE_INPUT_RECORDS=165593, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=331186, NUM_SHUFFLED_INPUTS=15, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=15, OUTPUT_RECORDS=165593, OUTPUT_LARGE_RECORDS=0, OUTPUT_BYTES=9345318, OUTPUT_BYTES_WITH_OVERHEAD=7358798, OUTPUT_BYTES_PHYSICAL=2473863, ADDITIONAL_SPILLS_BYTES_WRITTEN=1299285, ADDITIONAL_SPILLS_BYTES_READ=3017170, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, SHUFFLE_BYTES=3119519, SHUFFLE_BYTES_DECOMPRESSED=9842187, SHUFFLE_BYTES_TO_MEM=1401634, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=1717885, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=38, MERGE_PHASE_TIME=183, FIRST_EVENT_RECEIVED=4, LAST_EVENT_RECEIVED=11][HIVE RECORDS_OUT_INTERMEDIATE_Reducer_2=165593][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][Shuffle Errors_Reducer_2_INPUT_Map_1 BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][TaskCounter_Reducer_2_INPUT_Map_1 ADDITIONAL_SPILLS_BYTES_READ=3017170, ADDITIONAL_SPILLS_BYTES_WRITTEN=1299285, COMBINE_INPUT_RECORDS=0, FIRST_EVENT_RECEIVED=4, LAST_EVENT_RECEIVED=11, MERGED_MAP_OUTPUTS=15, MERGE_PHASE_TIME=183, NUM_DISK_TO_DISK_MERGES=0, NUM_FAILED_SHUFFLE_INPUTS=0, NUM_MEM_TO_DISK_MERGES=0, NUM_SHUFFLED_INPUTS=15, NUM_SKIPPED_INPUTS=0, REDUCE_INPUT_GROUPS=165593, REDUCE_INPUT_RECORDS=165593, SHUFFLE_BYTES=3119519, SHUFFLE_BYTES_DECOMPRESSED=9842187, SHUFFLE_BYTES_DISK_DIRECT=1717885, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_TO_MEM=1401634, SHUFFLE_PHASE_TIME=38, SPILLED_RECORDS=165593][TaskCounter_Reducer_2_OUTPUT_Reducer_3 ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILL_COUNT=0, OUTPUT_BYTES=9345318, OUTPUT_BYTES_PHYSICAL=2473863, OUTPUT_BYTES_WITH_OVERHEAD=7358798, OUTPUT_LARGE_RECORDS=0, OUTPUT_RECORDS=165593, SHUFFLE_CHUNK_COUNT=1, SPILLED_RECORDS=165593]] 2017-10-02T17:26:56,047 INFO [Task-Executor-1 (1506602683416_0067_180_01_000007_0)] task.TezTaskRunner2: TaskRunnerResult for attempt_1506602683416_0067_180_01_000007_0 : TaskRunner2Result{endReason=SUCCESS, containerShutdownRequested=false} 2017-10-02T17:26:56,047 INFO [Task-Executor-1 (1506602683416_0067_180_01_000007_0)] impl.LlapTaskReporter: Unregistered counters for fragment: 1506602683416_0067_180_01_000007_0 2017-10-02T17:26:56,047 INFO [Task-Executor-1 (1506602683416_0067_180_01_000007_0)] impl.TaskRunnerCallable: ExecutionTime for Container: container_222212222_0067_01_007490=1029 2017-10-02T17:26:56,073 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] impl.PipelinedSorter: Reducer 3: done sorting span=0, length=165589, time=48 2017-10-02T17:26:56,074 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] impl.PipelinedSorter: Reducer 3: Heap = SpanIterator<0:165588> (span=Span[16777184,9344985]), 2017-10-02T17:26:56,075 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] impl.PipelinedSorter: Reducer 3: Spilling to /data1/hadoop/yarn/local/usercache/hive/appcache/application_1506602683416_0064/usercache/hive/appcache/application_1506602683416_0067/180/output/attempt_1506602683416_0067_180_01_000008_0_29824_0/file.out 2017-10-02T17:26:56,135 DEBUG [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] log.PerfLogger: 2017-10-02T17:26:56,135 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] vector.VectorGroupByOperator: Closing operator GBY[14] 2017-10-02T17:26:56,139 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] vector.VectorSelectOperator: Closing operator SEL[15] 2017-10-02T17:26:56,139 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] reducesink.VectorReduceSinkMultiKeyOperator: Closing operator RS[16] 2017-10-02T17:26:56,139 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] reducesink.VectorReduceSinkCommonOperator: RS[16]: records written - 165849 2017-10-02T17:26:56,139 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] reducesink.VectorReduceSinkMultiKeyOperator: RECORDS_OUT_INTERMEDIATE_Reducer_2:165849, 2017-10-02T17:26:56,139 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] task.TaskRunner2Callable: Closing task, taskAttemptId=attempt_1506602683416_0067_180_01_000004_0 2017-10-02T17:26:56,139 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] orderedgrouped.Shuffle: Shutting down Shuffle for source: Map_1 2017-10-02T17:26:56,139 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] orderedgrouped.ShuffleInputEventHandlerOrderedGrouped: Map 1: numDmeEventsSeen=15, numDmeEventsSeenWithNoData=0, numObsoletionEventsSeen=0, updateOnClose 2017-10-02T17:26:56,139 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] impl.PipelinedSorter: Reducer 3: Starting flush of map output 2017-10-02T17:26:56,139 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] impl.PipelinedSorter: Reducer 3: Span0.length = 165849, perItem = 56 2017-10-02T17:26:56,176 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] shuffle.ShuffleUtils: EmptyPartition bitsetSize=29, numOutputs=46, emptyPartitions=29, compressedSize=14 2017-10-02T17:26:56,176 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] impl.PipelinedSorter: Reducer 3: Adding spill event for spill (final update=true), spillId=0 2017-10-02T17:26:56,176 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] runtime.LogicalIOProcessorRuntimeTask: Joining on EventRouter 2017-10-02T17:26:56,176 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] impl.PipelinedSorter: Reducer 3: done sorting span=0, length=165849, time=37 2017-10-02T17:26:56,176 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] task.TaskRunner2Callable: Task completed, taskAttemptId=attempt_1506602683416_0067_180_01_000008_0, askedToStop=false 2017-10-02T17:26:56,176 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] task.TaskRunner2Callable: Cleaning up task attempt_1506602683416_0067_180_01_000008_0, stopRequested=false 2017-10-02T17:26:56,176 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] impl.PipelinedSorter: Reducer 3: Heap = SpanIterator<0:165848> (span=Span[16777184,9359548]), 2017-10-02T17:26:56,176 INFO [TezTR-683416_67_180_1_8_0 (1506602683416_0067_180_01_000008_0)] runtime.LogicalIOProcessorRuntimeTask: Final Counters for attempt_1506602683416_0067_180_01_000008_0: Counters: 72 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=165589, REDUCE_INPUT_RECORDS=165589, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=331178, NUM_SHUFFLED_INPUTS=15, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=15, OUTPUT_RECORDS=165589, OUTPUT_LARGE_RECORDS=0, OUTPUT_BYTES=9344985, OUTPUT_BYTES_WITH_OVERHEAD=7358513, OUTPUT_BYTES_PHYSICAL=2474342, ADDITIONAL_SPILLS_BYTES_WRITTEN=1300266, ADDITIONAL_SPILLS_BYTES_READ=3016730, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, SHUFFLE_BYTES=3119156, SHUFFLE_BYTES_DECOMPRESSED=9841842, SHUFFLE_BYTES_TO_MEM=1402692, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=1716464, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=37, MERGE_PHASE_TIME=192, FIRST_EVENT_RECEIVED=4, LAST_EVENT_RECEIVED=4][HIVE RECORDS_OUT_INTERMEDIATE_Reducer_2=165589][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][Shuffle Errors_Reducer_2_INPUT_Map_1 BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][TaskCounter_Reducer_2_INPUT_Map_1 ADDITIONAL_SPILLS_BYTES_READ=3016730, ADDITIONAL_SPILLS_BYTES_WRITTEN=1300266, COMBINE_INPUT_RECORDS=0, FIRST_EVENT_RECEIVED=4, LAST_EVENT_RECEIVED=4, MERGED_MAP_OUTPUTS=15, MERGE_PHASE_TIME=192, NUM_DISK_TO_DISK_MERGES=0, NUM_FAILED_SHUFFLE_INPUTS=0, NUM_MEM_TO_DISK_MERGES=0, NUM_SHUFFLED_INPUTS=15, NUM_SKIPPED_INPUTS=0, REDUCE_INPUT_GROUPS=165589, REDUCE_INPUT_RECORDS=165589, SHUFFLE_BYTES=3119156, SHUFFLE_BYTES_DECOMPRESSED=9841842, SHUFFLE_BYTES_DISK_DIRECT=1716464, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_TO_MEM=1402692, SHUFFLE_PHASE_TIME=37, SPILLED_RECORDS=165589][TaskCounter_Reducer_2_OUTPUT_Reducer_3 ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILL_COUNT=0, OUTPUT_BYTES=9344985, OUTPUT_BYTES_PHYSICAL=2474342, OUTPUT_BYTES_WITH_OVERHEAD=7358513, OUTPUT_LARGE_RECORDS=0, OUTPUT_RECORDS=165589, SHUFFLE_CHUNK_COUNT=1, SPILLED_RECORDS=165589]] 2017-10-02T17:26:56,178 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] impl.PipelinedSorter: Reducer 3: Spilling to /data1/hadoop/yarn/local/usercache/hive/appcache/application_1506602683416_0064/usercache/hive/appcache/application_1506602683416_0067/180/output/attempt_1506602683416_0067_180_01_000004_0_29818_0/file.out 2017-10-02T17:26:56,178 INFO [Task-Executor-0 (1506602683416_0067_180_01_000008_0)] task.TezTaskRunner2: TaskRunnerResult for attempt_1506602683416_0067_180_01_000008_0 : TaskRunner2Result{endReason=SUCCESS, containerShutdownRequested=false} 2017-10-02T17:26:56,178 INFO [Task-Executor-0 (1506602683416_0067_180_01_000008_0)] impl.LlapTaskReporter: Unregistered counters for fragment: 1506602683416_0067_180_01_000008_0 2017-10-02T17:26:56,178 INFO [Task-Executor-0 (1506602683416_0067_180_01_000008_0)] impl.TaskRunnerCallable: ExecutionTime for Container: container_222212222_0067_01_007491=1157 2017-10-02T17:26:56,237 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] shuffle.ShuffleUtils: EmptyPartition bitsetSize=29, numOutputs=46, emptyPartitions=29, compressedSize=14 2017-10-02T17:26:56,238 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] impl.PipelinedSorter: Reducer 3: Adding spill event for spill (final update=true), spillId=0 2017-10-02T17:26:56,238 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Joining on EventRouter 2017-10-02T17:26:56,238 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] task.TaskRunner2Callable: Task completed, taskAttemptId=attempt_1506602683416_0067_180_01_000004_0, askedToStop=false 2017-10-02T17:26:56,238 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] task.TaskRunner2Callable: Cleaning up task attempt_1506602683416_0067_180_01_000004_0, stopRequested=false 2017-10-02T17:26:56,238 INFO [TezTR-683416_67_180_1_4_0 (1506602683416_0067_180_01_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Final Counters for attempt_1506602683416_0067_180_01_000004_0: Counters: 72 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=165849, REDUCE_INPUT_RECORDS=165849, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=331698, NUM_SHUFFLED_INPUTS=15, NUM_SKIPPED_INPUTS=0, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=15, OUTPUT_RECORDS=165849, OUTPUT_LARGE_RECORDS=0, OUTPUT_BYTES=9359548, OUTPUT_BYTES_WITH_OVERHEAD=7369956, OUTPUT_BYTES_PHYSICAL=2478675, ADDITIONAL_SPILLS_BYTES_WRITTEN=1300645, ADDITIONAL_SPILLS_BYTES_READ=3021473, ADDITIONAL_SPILL_COUNT=0, SHUFFLE_CHUNK_COUNT=1, SHUFFLE_BYTES=3125275, SHUFFLE_BYTES_DECOMPRESSED=9857185, SHUFFLE_BYTES_TO_MEM=1404447, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=1720828, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=39, MERGE_PHASE_TIME=186, FIRST_EVENT_RECEIVED=8, LAST_EVENT_RECEIVED=8][HIVE RECORDS_OUT_INTERMEDIATE_Reducer_2=165849][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][Shuffle Errors_Reducer_2_INPUT_Map_1 BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][TaskCounter_Reducer_2_INPUT_Map_1 ADDITIONAL_SPILLS_BYTES_READ=3021473, ADDITIONAL_SPILLS_BYTES_WRITTEN=1300645, COMBINE_INPUT_RECORDS=0, FIRST_EVENT_RECEIVED=8, LAST_EVENT_RECEIVED=8, MERGED_MAP_OUTPUTS=15, MERGE_PHASE_TIME=186, NUM_DISK_TO_DISK_MERGES=0, NUM_FAILED_SHUFFLE_INPUTS=0, NUM_MEM_TO_DISK_MERGES=0, NUM_SHUFFLED_INPUTS=15, NUM_SKIPPED_INPUTS=0, REDUCE_INPUT_GROUPS=165849, REDUCE_INPUT_RECORDS=165849, SHUFFLE_BYTES=3125275, SHUFFLE_BYTES_DECOMPRESSED=9857185, SHUFFLE_BYTES_DISK_DIRECT=1720828, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_TO_MEM=1404447, SHUFFLE_PHASE_TIME=39, SPILLED_RECORDS=165849][TaskCounter_Reducer_2_OUTPUT_Reducer_3 ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILL_COUNT=0, OUTPUT_BYTES=9359548, OUTPUT_BYTES_PHYSICAL=2478675, OUTPUT_BYTES_WITH_OVERHEAD=7369956, OUTPUT_LARGE_RECORDS=0, OUTPUT_RECORDS=165849, SHUFFLE_CHUNK_COUNT=1, SPILLED_RECORDS=165849]] 2017-10-02T17:26:56,239 INFO [Task-Executor-2 (1506602683416_0067_180_01_000004_0)] task.TezTaskRunner2: TaskRunnerResult for attempt_1506602683416_0067_180_01_000004_0 : TaskRunner2Result{endReason=SUCCESS, containerShutdownRequested=false} 2017-10-02T17:26:56,239 INFO [Task-Executor-2 (1506602683416_0067_180_01_000004_0)] impl.LlapTaskReporter: Unregistered counters for fragment: 1506602683416_0067_180_01_000004_0 2017-10-02T17:26:56,239 INFO [Task-Executor-2 (1506602683416_0067_180_01_000004_0)] impl.TaskRunnerCallable: ExecutionTime for Container: container_222212222_0067_01_007487=1223 2017-10-02T17:26:56,596 INFO [IPC Server handler 1 on 43326 (1506602683416_0067_180_02_000000_0)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_02_000000_0 : ACCEPTED 2017-10-02T17:26:56,597 INFO [Task-Executor-2 (1506602683416_0067_180_02_000000_0)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Reducer 3, VertexParallelism: 10, TaskAttemptID:attempt_1506602683416_0067_180_02_000000_0, processorName=org.apache.hadoop.hive.ql.exec.tez.ReduceTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=Reducer 2, physicalEdgeCount=50, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=out_Reducer 3, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ] 2017-10-02T17:26:56,597 INFO [Task-Executor-2 (1506602683416_0067_180_02_000000_0)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:56,597 INFO [Task-Executor-2 (1506602683416_0067_180_02_000000_0)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_02_000000_0 vertexName: Reducer 3 2017-10-02T17:26:56,598 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_02_000000_0 2017-10-02T17:26:56,598 DEBUG [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] log.PerfLogger: 2017-10-02T17:26:56,603 INFO [IPC Server handler 4 on 43326 (1506602683416_0067_180_02_000004_0)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_02_000004_0 : ACCEPTED 2017-10-02T17:26:56,604 INFO [Task-Executor-0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Reducer 3, VertexParallelism: 10, TaskAttemptID:attempt_1506602683416_0067_180_02_000004_0, processorName=org.apache.hadoop.hive.ql.exec.tez.ReduceTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=Reducer 2, physicalEdgeCount=50, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=out_Reducer 3, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ] 2017-10-02T17:26:56,604 INFO [Task-Executor-0 (1506602683416_0067_180_02_000004_0)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:56,604 INFO [Task-Executor-0 (1506602683416_0067_180_02_000004_0)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_02_000004_0 vertexName: Reducer 3 2017-10-02T17:26:56,604 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_02_000004_0 2017-10-02T17:26:56,605 INFO [IPC Server handler 0 on 43326 (1506602683416_0067_180_02_000009_0)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_02_000009_0 : ACCEPTED 2017-10-02T17:26:56,606 INFO [Task-Executor-1 (1506602683416_0067_180_02_000009_0)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Reducer 3, VertexParallelism: 10, TaskAttemptID:attempt_1506602683416_0067_180_02_000009_0, processorName=org.apache.hadoop.hive.ql.exec.tez.ReduceTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=Reducer 2, physicalEdgeCount=10, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=out_Reducer 3, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ] 2017-10-02T17:26:56,606 INFO [Task-Executor-1 (1506602683416_0067_180_02_000009_0)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:56,606 INFO [Task-Executor-1 (1506602683416_0067_180_02_000009_0)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_02_000009_0 vertexName: Reducer 3 2017-10-02T17:26:56,606 DEBUG [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] log.PerfLogger: 2017-10-02T17:26:56,606 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:56,607 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:56,607 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:56,607 DEBUG [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] log.PerfLogger: 2017-10-02T17:26:56,608 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:56,608 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_02_000009_0 2017-10-02T17:26:56,608 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] resources.MemoryDistributor: InitialRequests=[out_Reducer 3:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [Reducer 2:INPUT:1468708992:org.apache.tez.runtime.library.input.OrderedGroupedKVInput] 2017-10-02T17:26:56,608 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:56,608 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:56,608 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 1468708992, TotalRequestedScaled: 1.3557313772307694E9, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.19 2017-10-02T17:26:56,608 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] resources.MemoryDistributor: Allocations=[out_Reducer 3:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [Reducer 2:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:1468708992:1468708992] 2017-10-02T17:26:56,608 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:56,610 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] runtime.LogicalIOProcessorRuntimeTask: Input: Reducer 2 being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:56,610 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:56,610 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:56,610 DEBUG [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] log.PerfLogger: 2017-10-02T17:26:56,614 DEBUG [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] log.PerfLogger: 2017-10-02T17:26:56,615 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:56,615 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:56,615 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:56,616 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:56,616 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] resources.MemoryDistributor: InitialRequests=[Reducer 2:INPUT:1468708992:org.apache.tez.runtime.library.input.OrderedGroupedKVInput], [out_Reducer 3:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput] 2017-10-02T17:26:56,616 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:56,616 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:56,616 DEBUG [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] log.PerfLogger: 2017-10-02T17:26:56,616 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 1468708992, TotalRequestedScaled: 1.3557313772307694E9, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.19 2017-10-02T17:26:56,616 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:56,616 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:56,616 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:56,616 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] resources.MemoryDistributor: Allocations=[Reducer 2:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:1468708992:1468708992], [out_Reducer 3:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0] 2017-10-02T17:26:56,617 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:56,617 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:56,617 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_02_000000_0 2017-10-02T17:26:56,617 DEBUG [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] log.PerfLogger: 2017-10-02T17:26:56,617 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/734735d4-fd86-42fe-8fc1-6d9736bcd0b1/reduce.xml 2017-10-02T17:26:56,617 DEBUG [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] log.PerfLogger: 2017-10-02T17:26:56,618 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] exec.SerializationUtilities: Deserializing ReduceWork using kryo 2017-10-02T17:26:56,619 DEBUG [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] log.PerfLogger: 2017-10-02T17:26:56,619 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] exec.Utilities: Deserialized plan (via RPC) - name: Reducer 3 size: 2.30KB 2017-10-02T17:26:56,619 DEBUG [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] log.PerfLogger: 2017-10-02T17:26:56,620 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] tez.ReduceRecordProcessor: Waiting for ShuffleInputs to become ready 2017-10-02T17:26:56,620 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:56,620 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] resources.MemoryDistributor: InitialRequests=[Reducer 2:INPUT:1468708992:org.apache.tez.runtime.library.input.OrderedGroupedKVInput], [out_Reducer 3:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput] 2017-10-02T17:26:56,620 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:56,620 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:56,620 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 1468708992, TotalRequestedScaled: 1.3557313772307694E9, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.19 2017-10-02T17:26:56,620 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] resources.MemoryDistributor: Allocations=[Reducer 2:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:1468708992:1468708992], [out_Reducer 3:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0] 2017-10-02T17:26:56,620 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:56,620 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] runtime.LogicalIOProcessorRuntimeTask: Input: Reducer 2 being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:56,620 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:56,620 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:56,620 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Input: Reducer 2 being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:56,621 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:56,621 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:56,621 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:56,621 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_02_000004_0 2017-10-02T17:26:56,621 DEBUG [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] log.PerfLogger: 2017-10-02T17:26:56,622 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/734735d4-fd86-42fe-8fc1-6d9736bcd0b1/reduce.xml 2017-10-02T17:26:56,622 DEBUG [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] log.PerfLogger: 2017-10-02T17:26:56,622 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] exec.SerializationUtilities: Deserializing ReduceWork using kryo 2017-10-02T17:26:56,623 DEBUG [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] log.PerfLogger: 2017-10-02T17:26:56,623 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] exec.Utilities: Deserialized plan (via RPC) - name: Reducer 3 size: 2.30KB 2017-10-02T17:26:56,623 DEBUG [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] log.PerfLogger: 2017-10-02T17:26:56,623 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:56,624 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_02_000009_0 2017-10-02T17:26:56,624 DEBUG [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] log.PerfLogger: 2017-10-02T17:26:56,624 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/734735d4-fd86-42fe-8fc1-6d9736bcd0b1/reduce.xml 2017-10-02T17:26:56,624 DEBUG [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] log.PerfLogger: 2017-10-02T17:26:56,624 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] exec.SerializationUtilities: Deserializing ReduceWork using kryo 2017-10-02T17:26:56,624 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] tez.ReduceRecordProcessor: Waiting for ShuffleInputs to become ready 2017-10-02T17:26:56,625 DEBUG [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] log.PerfLogger: 2017-10-02T17:26:56,625 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] exec.Utilities: Deserialized plan (via RPC) - name: Reducer 3 size: 2.30KB 2017-10-02T17:26:56,625 DEBUG [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] log.PerfLogger: 2017-10-02T17:26:56,626 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] tez.ReduceRecordProcessor: Waiting for ShuffleInputs to become ready 2017-10-02T17:26:57,110 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] tez.ReduceRecordProcessor: Main work is Reducer 3 2017-10-02T17:26:57,110 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] tez.ReduceRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:57,110 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] input.OrderedGroupedKVInput: Reducer 2: creating ValuesIterator with comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator, keyClass=org.apache.hadoop.hive.ql.io.HiveKey, valClass=org.apache.hadoop.io.BytesWritable 2017-10-02T17:26:57,111 DEBUG [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] log.PerfLogger: 2017-10-02T17:26:57,111 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] vector.VectorSelectOperator: Initializing operator SEL[17] 2017-10-02T17:26:57,111 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] vector.VectorFileSinkOperator: Initializing operator FS[18] 2017-10-02T17:26:57,112 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.druid.serde.DruidSerDe@3ea70efe and formatter : org.apache.hadoop.hive.druid.io.DruidOutputFormat@28b02e3e 2017-10-02T17:26:57,112 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] tez.ReduceRecordProcessor: Id =17 Id =18 <\Children> Id = 17 null<\Parent> <\FS> <\Children> <\Parent> <\SEL> 2017-10-02T17:26:57,112 DEBUG [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] log.PerfLogger: 2017-10-02T17:26:57,112 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] tez.ReduceRecordProcessor: Starting Output: out_Reducer 3 2017-10-02T17:26:57,112 DEBUG [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] log.PerfLogger: 2017-10-02T17:26:57,112 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] vector.VectorSelectOperator: Closing operator SEL[17] 2017-10-02T17:26:57,112 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] vector.VectorFileSinkOperator: Closing operator FS[18] 2017-10-02T17:26:57,112 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] exec.FileSinkOperator: FS[18]: records written - 0 2017-10-02T17:26:57,116 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] tez.ReduceRecordProcessor: Main work is Reducer 3 2017-10-02T17:26:57,116 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] tez.ReduceRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:57,117 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] input.OrderedGroupedKVInput: Reducer 2: creating ValuesIterator with comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator, keyClass=org.apache.hadoop.hive.ql.io.HiveKey, valClass=org.apache.hadoop.io.BytesWritable 2017-10-02T17:26:57,117 DEBUG [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] log.PerfLogger: 2017-10-02T17:26:57,117 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] vector.VectorSelectOperator: Initializing operator SEL[17] 2017-10-02T17:26:57,117 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] vector.VectorFileSinkOperator: Initializing operator FS[18] 2017-10-02T17:26:57,118 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.druid.serde.DruidSerDe@6ab86d2c and formatter : org.apache.hadoop.hive.druid.io.DruidOutputFormat@301ae44f 2017-10-02T17:26:57,118 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] tez.ReduceRecordProcessor: Id =17 Id =18 <\Children> Id = 17 null<\Parent> <\FS> <\Children> <\Parent> <\SEL> 2017-10-02T17:26:57,118 DEBUG [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] log.PerfLogger: 2017-10-02T17:26:57,118 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] tez.ReduceRecordProcessor: Starting Output: out_Reducer 3 2017-10-02T17:26:57,118 DEBUG [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] log.PerfLogger: 2017-10-02T17:26:57,118 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] vector.VectorSelectOperator: Closing operator SEL[17] 2017-10-02T17:26:57,118 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] vector.VectorFileSinkOperator: Closing operator FS[18] 2017-10-02T17:26:57,119 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] exec.FileSinkOperator: FS[18]: records written - 0 2017-10-02T17:26:57,140 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] vector.VectorFileSinkOperator: RECORDS_OUT_1_gs_ozet.summary_tbl_druid3:0, 2017-10-02T17:26:57,140 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] task.TaskRunner2Callable: Closing task, taskAttemptId=attempt_1506602683416_0067_180_02_000000_0 2017-10-02T17:26:57,140 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] orderedgrouped.Shuffle: Shutting down Shuffle for source: Reducer_2 2017-10-02T17:26:57,140 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] orderedgrouped.ShuffleInputEventHandlerOrderedGrouped: Reducer 2: numDmeEventsSeen=50, numDmeEventsSeenWithNoData=50, numObsoletionEventsSeen=0, updateOnClose 2017-10-02T17:26:57,140 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] output.MROutput: out_Reducer 3 closed 2017-10-02T17:26:57,141 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] runtime.LogicalIOProcessorRuntimeTask: Joining on EventRouter 2017-10-02T17:26:57,141 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] task.TaskRunner2Callable: Task completed, taskAttemptId=attempt_1506602683416_0067_180_02_000000_0, askedToStop=false 2017-10-02T17:26:57,141 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] task.TaskRunner2Callable: Cleaning up task attempt_1506602683416_0067_180_02_000000_0, stopRequested=false 2017-10-02T17:26:57,141 INFO [TezTR-683416_67_180_2_0_0 (1506602683416_0067_180_02_000000_0)] runtime.LogicalIOProcessorRuntimeTask: Final Counters for attempt_1506602683416_0067_180_02_000000_0: Counters: 57 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=0, REDUCE_INPUT_RECORDS=0, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=0, NUM_SHUFFLED_INPUTS=0, NUM_SKIPPED_INPUTS=50, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=0, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, SHUFFLE_BYTES=0, SHUFFLE_BYTES_DECOMPRESSED=0, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=0, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=499, MERGE_PHASE_TIME=500, FIRST_EVENT_RECEIVED=7, LAST_EVENT_RECEIVED=499][HIVE RECORDS_OUT_1_gs_ozet.summary_tbl_druid3=0][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][Shuffle Errors_Reducer_3_INPUT_Reducer_2 BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][TaskCounter_Reducer_3_INPUT_Reducer_2 ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, COMBINE_INPUT_RECORDS=0, FIRST_EVENT_RECEIVED=7, LAST_EVENT_RECEIVED=499, MERGED_MAP_OUTPUTS=0, MERGE_PHASE_TIME=500, NUM_DISK_TO_DISK_MERGES=0, NUM_FAILED_SHUFFLE_INPUTS=0, NUM_MEM_TO_DISK_MERGES=0, NUM_SHUFFLED_INPUTS=0, NUM_SKIPPED_INPUTS=50, REDUCE_INPUT_GROUPS=0, REDUCE_INPUT_RECORDS=0, SHUFFLE_BYTES=0, SHUFFLE_BYTES_DECOMPRESSED=0, SHUFFLE_BYTES_DISK_DIRECT=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_PHASE_TIME=499, SPILLED_RECORDS=0][TaskCounter_Reducer_3_OUTPUT_out_Reducer_3 OUTPUT_RECORDS=0]] 2017-10-02T17:26:57,143 INFO [Task-Executor-2 (1506602683416_0067_180_02_000000_0)] task.TezTaskRunner2: TaskRunnerResult for attempt_1506602683416_0067_180_02_000000_0 : TaskRunner2Result{endReason=SUCCESS, containerShutdownRequested=false} 2017-10-02T17:26:57,143 INFO [Task-Executor-2 (1506602683416_0067_180_02_000000_0)] impl.LlapTaskReporter: Unregistered counters for fragment: 1506602683416_0067_180_02_000000_0 2017-10-02T17:26:57,143 INFO [Task-Executor-2 (1506602683416_0067_180_02_000000_0)] impl.TaskRunnerCallable: ExecutionTime for Container: container_222212222_0067_01_007493=546 2017-10-02T17:26:57,144 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] vector.VectorFileSinkOperator: RECORDS_OUT_1_gs_ozet.summary_tbl_druid3:0, 2017-10-02T17:26:57,144 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] task.TaskRunner2Callable: Closing task, taskAttemptId=attempt_1506602683416_0067_180_02_000009_0 2017-10-02T17:26:57,144 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] orderedgrouped.Shuffle: Shutting down Shuffle for source: Reducer_2 2017-10-02T17:26:57,144 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] orderedgrouped.ShuffleInputEventHandlerOrderedGrouped: Reducer 2: numDmeEventsSeen=10, numDmeEventsSeenWithNoData=10, numObsoletionEventsSeen=0, updateOnClose 2017-10-02T17:26:57,144 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] output.MROutput: out_Reducer 3 closed 2017-10-02T17:26:57,144 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] runtime.LogicalIOProcessorRuntimeTask: Joining on EventRouter 2017-10-02T17:26:57,145 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] task.TaskRunner2Callable: Task completed, taskAttemptId=attempt_1506602683416_0067_180_02_000009_0, askedToStop=false 2017-10-02T17:26:57,145 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] task.TaskRunner2Callable: Cleaning up task attempt_1506602683416_0067_180_02_000009_0, stopRequested=false 2017-10-02T17:26:57,145 INFO [TezTR-683416_67_180_2_9_0 (1506602683416_0067_180_02_000009_0)] runtime.LogicalIOProcessorRuntimeTask: Final Counters for attempt_1506602683416_0067_180_02_000009_0: Counters: 57 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=0, REDUCE_INPUT_RECORDS=0, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=0, NUM_SHUFFLED_INPUTS=0, NUM_SKIPPED_INPUTS=10, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=0, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, ADDITIONAL_SPILLS_BYTES_READ=0, SHUFFLE_BYTES=0, SHUFFLE_BYTES_DECOMPRESSED=0, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=0, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=495, MERGE_PHASE_TIME=495, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=495][HIVE RECORDS_OUT_1_gs_ozet.summary_tbl_druid3=0][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][Shuffle Errors_Reducer_3_INPUT_Reducer_2 BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][TaskCounter_Reducer_3_INPUT_Reducer_2 ADDITIONAL_SPILLS_BYTES_READ=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=0, COMBINE_INPUT_RECORDS=0, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=495, MERGED_MAP_OUTPUTS=0, MERGE_PHASE_TIME=495, NUM_DISK_TO_DISK_MERGES=0, NUM_FAILED_SHUFFLE_INPUTS=0, NUM_MEM_TO_DISK_MERGES=0, NUM_SHUFFLED_INPUTS=0, NUM_SKIPPED_INPUTS=10, REDUCE_INPUT_GROUPS=0, REDUCE_INPUT_RECORDS=0, SHUFFLE_BYTES=0, SHUFFLE_BYTES_DECOMPRESSED=0, SHUFFLE_BYTES_DISK_DIRECT=0, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_TO_MEM=0, SHUFFLE_PHASE_TIME=495, SPILLED_RECORDS=0][TaskCounter_Reducer_3_OUTPUT_out_Reducer_3 OUTPUT_RECORDS=0]] 2017-10-02T17:26:57,146 INFO [Task-Executor-1 (1506602683416_0067_180_02_000009_0)] task.TezTaskRunner2: TaskRunnerResult for attempt_1506602683416_0067_180_02_000009_0 : TaskRunner2Result{endReason=SUCCESS, containerShutdownRequested=false} 2017-10-02T17:26:57,146 INFO [Task-Executor-1 (1506602683416_0067_180_02_000009_0)] impl.LlapTaskReporter: Unregistered counters for fragment: 1506602683416_0067_180_02_000009_0 2017-10-02T17:26:57,146 INFO [Task-Executor-1 (1506602683416_0067_180_02_000009_0)] impl.TaskRunnerCallable: ExecutionTime for Container: container_222212222_0067_01_007502=540 2017-10-02T17:26:57,169 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] tez.ReduceRecordProcessor: Main work is Reducer 3 2017-10-02T17:26:57,169 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] tez.ReduceRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:57,169 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] input.OrderedGroupedKVInput: Reducer 2: creating ValuesIterator with comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator, keyClass=org.apache.hadoop.hive.ql.io.HiveKey, valClass=org.apache.hadoop.io.BytesWritable 2017-10-02T17:26:57,170 DEBUG [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] log.PerfLogger: 2017-10-02T17:26:57,170 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] vector.VectorSelectOperator: Initializing operator SEL[17] 2017-10-02T17:26:57,170 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] vector.VectorFileSinkOperator: Initializing operator FS[18] 2017-10-02T17:26:57,170 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.druid.serde.DruidSerDe@ae13b00 and formatter : org.apache.hadoop.hive.druid.io.DruidOutputFormat@1376a34e 2017-10-02T17:26:57,170 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] tez.ReduceRecordProcessor: Id =17 Id =18 <\Children> Id = 17 null<\Parent> <\FS> <\Children> <\Parent> <\SEL> 2017-10-02T17:26:57,170 DEBUG [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] log.PerfLogger: 2017-10-02T17:26:57,171 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] tez.ReduceRecordProcessor: Starting Output: out_Reducer 3 2017-10-02T17:26:57,172 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] exec.FileSinkOperator: New Final Path: FS hdfs://myhdp/apps/hive/warehouse/gs_summary.db/.hive-staging_hive_2017-10-02_17-26-50_363_1303943444912337303-634/_tmp.-ext-10002/000004_0 2017-10-02T17:26:57,172 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] hdfs.HdfsDataSegmentPusher: Configured HDFS as deep storage 2017-10-02T17:26:57,179 ERROR [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] tez.ReduceRecordSource: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2017-07-03 00:00:00.0, "00000000000001", "0001", "0", "0", "1", "2", 0.0, 2, 2017-07-01 00:00:00.0] --MY edit 1000 rows more at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:489) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:397) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:248) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:319) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:189) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:564) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:664) at org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:101) at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:955) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:903) at org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:145) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:464) ... 19 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:272) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketForFileIdx(FileSinkOperator.java:609) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:553) ... 25 more Caused by: java.lang.NullPointerException: cache at org.apache.hive.druid.com.google.common.base.Preconditions.checkNotNull(Preconditions.java:229) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.AppenderatorImpl.(AppenderatorImpl.java:146) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.Appenderators.createOffline(Appenderators.java:84) at org.apache.hadoop.hive.druid.io.DruidRecordWriter.(DruidRecordWriter.java:106) at org.apache.hadoop.hive.druid.io.DruidOutputFormat.getHiveRecordWriter(DruidOutputFormat.java:222) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getRecordWriter(HiveFileFormatUtils.java:284) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:269) ... 27 more 2017-10-02T17:26:57,179 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] vector.VectorSelectOperator: Closing operator SEL[17] 2017-10-02T17:26:57,179 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] vector.VectorFileSinkOperator: Closing operator FS[18] 2017-10-02T17:26:57,179 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] exec.FileSinkOperator: FS[18]: records written - 0 2017-10-02T17:26:57,201 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] vector.VectorFileSinkOperator: RECORDS_OUT_1_gs_ozet.summary_tbl_druid3:0, 2017-10-02T17:26:57,203 ERROR [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] tez.TezProcessor: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2017-07-03 00:00:00.0, "00000000000001", "0001", "0", "0", "1", "2", 0.0, 2, 2017-07-01 00:00:00.0] --MY edit 1000 rows more at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:406) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:248) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:319) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:189) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2017-07-03 00:00:00.0, "00000000000002", "0002", "0", "0", "1", "2", 0.0, 2, 2017-07-01 00:00:00.0] --MY edit 1000 rows more at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:489) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:397) ... 18 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:564) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:664) at org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:101) at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:955) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:903) at org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:145) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:464) ... 19 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:272) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketForFileIdx(FileSinkOperator.java:609) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:553) ... 25 more Caused by: java.lang.NullPointerException: cache at org.apache.hive.druid.com.google.common.base.Preconditions.checkNotNull(Preconditions.java:229) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.AppenderatorImpl.(AppenderatorImpl.java:146) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.Appenderators.createOffline(Appenderators.java:84) at org.apache.hadoop.hive.druid.io.DruidRecordWriter.(DruidRecordWriter.java:106) at org.apache.hadoop.hive.druid.io.DruidOutputFormat.getHiveRecordWriter(DruidOutputFormat.java:222) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getRecordWriter(HiveFileFormatUtils.java:284) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:269) ... 27 more 2017-10-02T17:26:57,203 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] task.TaskRunner2Callable: Cleaning up task attempt_1506602683416_0067_180_02_000004_0, stopRequested=false 2017-10-02T17:26:57,203 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Final Counters for attempt_1506602683416_0067_180_02_000004_0: Counters: 57 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=1024, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=0, NUM_SHUFFLED_INPUTS=10, NUM_SKIPPED_INPUTS=40, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=10, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=985164, ADDITIONAL_SPILLS_BYTES_READ=16, SHUFFLE_BYTES=1466622, SHUFFLE_BYTES_DECOMPRESSED=4313475, SHUFFLE_BYTES_TO_MEM=986208, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=480414, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=500, MERGE_PHASE_TIME=552, FIRST_EVENT_RECEIVED=4, LAST_EVENT_RECEIVED=495][HIVE RECORDS_OUT_1_gs_ozet.summary_tbl_druid3=0][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][Shuffle Errors_Reducer_3_INPUT_Reducer_2 BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][TaskCounter_Reducer_3_INPUT_Reducer_2 ADDITIONAL_SPILLS_BYTES_READ=16, ADDITIONAL_SPILLS_BYTES_WRITTEN=985164, COMBINE_INPUT_RECORDS=0, FIRST_EVENT_RECEIVED=4, LAST_EVENT_RECEIVED=495, MERGED_MAP_OUTPUTS=10, MERGE_PHASE_TIME=552, NUM_DISK_TO_DISK_MERGES=0, NUM_FAILED_SHUFFLE_INPUTS=0, NUM_MEM_TO_DISK_MERGES=0, NUM_SHUFFLED_INPUTS=10, NUM_SKIPPED_INPUTS=40, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=1024, SHUFFLE_BYTES=1466622, SHUFFLE_BYTES_DECOMPRESSED=4313475, SHUFFLE_BYTES_DISK_DIRECT=480414, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_TO_MEM=986208, SHUFFLE_PHASE_TIME=500, SPILLED_RECORDS=0][TaskCounter_Reducer_3_OUTPUT_out_Reducer_3 OUTPUT_RECORDS=0]] 2017-10-02T17:26:57,203 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Joining on EventRouter 2017-10-02T17:26:57,208 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] orderedgrouped.Shuffle: Shutting down Shuffle for source: Reducer_2 2017-10-02T17:26:57,209 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] orderedgrouped.ShuffleInputEventHandlerOrderedGrouped: Reducer 2: numDmeEventsSeen=50, numDmeEventsSeenWithNoData=40, numObsoletionEventsSeen=0, updateOnClose 2017-10-02T17:26:57,209 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Closed input for vertex=Reducer 3, sourceVertex=Reducer 2, interruptedStatus=true 2017-10-02T17:26:57,209 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] output.MROutput: out_Reducer 3 closed 2017-10-02T17:26:57,209 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Closed input for vertex=Reducer 3, sourceVertex=out_Reducer 3, interruptedStatus=true 2017-10-02T17:26:57,209 INFO [TezTR-683416_67_180_2_4_0 (1506602683416_0067_180_02_000004_0)] runtime.LogicalIOProcessorRuntimeTask: Closed processor for vertex=Reducer 3, index=2, interruptedStatus=true 2017-10-02T17:26:57,232 INFO [Task-Executor-0 (1506602683416_0067_180_02_000004_0)] task.TezTaskRunner2: TaskRunnerResult for attempt_1506602683416_0067_180_02_000004_0 : TaskRunner2Result{endReason=TASK_ERROR, containerShutdownRequested=false, failureType=NON_FATAL, error=java.lang.RuntimeException: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2017-07-03 00:00:00.0, "00000000000002", "0002", "0", "0", "1", "2", 0.0, 2, 2017-07-01 00:00:00.0] --MY edit 1000 rows more } 2017-10-02T17:26:57,233 INFO [Task-Executor-0 (1506602683416_0067_180_02_000004_0)] impl.LlapTaskReporter: Unregistered counters for fragment: 1506602683416_0067_180_02_000004_0 2017-10-02T17:26:57,233 INFO [Task-Executor-0 (1506602683416_0067_180_02_000004_0)] impl.TaskRunnerCallable: ExecutionTime for Container: container_222212222_0067_01_007497=629 2017-10-02T17:26:57,556 INFO [IPC Server handler 1 on 43326 (1506602683416_0067_180_02_000008_2)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_02_000008_2 : ACCEPTED 2017-10-02T17:26:57,557 INFO [Task-Executor-0 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Reducer 3, VertexParallelism: 10, TaskAttemptID:attempt_1506602683416_0067_180_02_000008_2, processorName=org.apache.hadoop.hive.ql.exec.tez.ReduceTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=Reducer 2, physicalEdgeCount=50, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=out_Reducer 3, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ] 2017-10-02T17:26:57,557 INFO [Task-Executor-0 (1506602683416_0067_180_02_000008_2)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:57,557 INFO [Task-Executor-0 (1506602683416_0067_180_02_000008_2)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_02_000008_2 vertexName: Reducer 3 2017-10-02T17:26:57,558 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_02_000008_2 2017-10-02T17:26:57,558 DEBUG [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] log.PerfLogger: 2017-10-02T17:26:57,566 DEBUG [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] log.PerfLogger: 2017-10-02T17:26:57,566 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:57,566 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:57,566 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:57,567 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:57,567 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] resources.MemoryDistributor: InitialRequests=[out_Reducer 3:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [Reducer 2:INPUT:1468708992:org.apache.tez.runtime.library.input.OrderedGroupedKVInput] 2017-10-02T17:26:57,567 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:57,567 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:57,567 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 1468708992, TotalRequestedScaled: 1.3557313772307694E9, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.19 2017-10-02T17:26:57,568 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] resources.MemoryDistributor: Allocations=[out_Reducer 3:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [Reducer 2:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:1468708992:1468708992] 2017-10-02T17:26:57,568 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:57,568 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Input: Reducer 2 being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:57,568 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:57,568 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:57,570 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:57,570 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_02_000008_2 2017-10-02T17:26:57,570 DEBUG [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] log.PerfLogger: 2017-10-02T17:26:57,571 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/734735d4-fd86-42fe-8fc1-6d9736bcd0b1/reduce.xml 2017-10-02T17:26:57,571 DEBUG [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] log.PerfLogger: 2017-10-02T17:26:57,571 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] exec.SerializationUtilities: Deserializing ReduceWork using kryo 2017-10-02T17:26:57,572 DEBUG [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] log.PerfLogger: 2017-10-02T17:26:57,572 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] exec.Utilities: Deserialized plan (via RPC) - name: Reducer 3 size: 2.30KB 2017-10-02T17:26:57,572 DEBUG [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] log.PerfLogger: 2017-10-02T17:26:57,574 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] tez.ReduceRecordProcessor: Waiting for ShuffleInputs to become ready 2017-10-02T17:26:57,617 INFO [IPC Server handler 3 on 43326 (1506602683416_0067_180_02_000003_2)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_02_000003_2 : ACCEPTED 2017-10-02T17:26:57,618 INFO [Task-Executor-1 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Reducer 3, VertexParallelism: 10, TaskAttemptID:attempt_1506602683416_0067_180_02_000003_2, processorName=org.apache.hadoop.hive.ql.exec.tez.ReduceTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=Reducer 2, physicalEdgeCount=50, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=out_Reducer 3, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ] 2017-10-02T17:26:57,618 INFO [Task-Executor-1 (1506602683416_0067_180_02_000003_2)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:57,618 INFO [Task-Executor-1 (1506602683416_0067_180_02_000003_2)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_02_000003_2 vertexName: Reducer 3 2017-10-02T17:26:57,619 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_02_000003_2 2017-10-02T17:26:57,620 DEBUG [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] log.PerfLogger: 2017-10-02T17:26:57,620 INFO [IPC Server handler 2 on 43326 (1506602683416_0067_180_02_000001_2)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_02_000001_2 : ACCEPTED 2017-10-02T17:26:57,621 INFO [Task-Executor-2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Reducer 3, VertexParallelism: 10, TaskAttemptID:attempt_1506602683416_0067_180_02_000001_2, processorName=org.apache.hadoop.hive.ql.exec.tez.ReduceTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=Reducer 2, physicalEdgeCount=50, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=out_Reducer 3, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ] 2017-10-02T17:26:57,621 INFO [Task-Executor-2 (1506602683416_0067_180_02_000001_2)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:57,621 INFO [Task-Executor-2 (1506602683416_0067_180_02_000001_2)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_02_000001_2 vertexName: Reducer 3 2017-10-02T17:26:57,621 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_02_000001_2 2017-10-02T17:26:57,622 DEBUG [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] log.PerfLogger: 2017-10-02T17:26:57,627 DEBUG [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] log.PerfLogger: 2017-10-02T17:26:57,627 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:57,627 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:57,627 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:57,630 INFO [IPC Server handler 1 on 43326 (1506602683416_0067_180_02_000007_2)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_02_000007_2 : ACCEPTED 2017-10-02T17:26:57,630 DEBUG [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] log.PerfLogger: 2017-10-02T17:26:57,630 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:57,630 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:57,630 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:57,633 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:57,634 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] resources.MemoryDistributor: InitialRequests=[out_Reducer 3:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [Reducer 2:INPUT:1468708992:org.apache.tez.runtime.library.input.OrderedGroupedKVInput] 2017-10-02T17:26:57,634 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:57,634 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:57,634 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 1468708992, TotalRequestedScaled: 1.3557313772307694E9, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.19 2017-10-02T17:26:57,634 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] resources.MemoryDistributor: Allocations=[out_Reducer 3:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [Reducer 2:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:1468708992:1468708992] 2017-10-02T17:26:57,634 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:57,634 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Input: Reducer 2 being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:57,634 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:57,634 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:57,636 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:57,636 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_02_000001_2 2017-10-02T17:26:57,636 DEBUG [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] log.PerfLogger: 2017-10-02T17:26:57,637 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/734735d4-fd86-42fe-8fc1-6d9736bcd0b1/reduce.xml 2017-10-02T17:26:57,637 DEBUG [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] log.PerfLogger: 2017-10-02T17:26:57,637 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] exec.SerializationUtilities: Deserializing ReduceWork using kryo 2017-10-02T17:26:57,637 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:57,637 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] resources.MemoryDistributor: InitialRequests=[Reducer 2:INPUT:1468708992:org.apache.tez.runtime.library.input.OrderedGroupedKVInput], [out_Reducer 3:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput] 2017-10-02T17:26:57,638 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:57,638 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:57,638 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 1468708992, TotalRequestedScaled: 1.3557313772307694E9, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.19 2017-10-02T17:26:57,638 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] resources.MemoryDistributor: Allocations=[Reducer 2:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:1468708992:1468708992], [out_Reducer 3:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0] 2017-10-02T17:26:57,638 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:57,638 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Input: Reducer 2 being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:57,638 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:57,638 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:57,640 DEBUG [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] log.PerfLogger: 2017-10-02T17:26:57,640 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] exec.Utilities: Deserialized plan (via RPC) - name: Reducer 3 size: 2.30KB 2017-10-02T17:26:57,640 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:57,640 DEBUG [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] log.PerfLogger: 2017-10-02T17:26:57,640 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_02_000003_2 2017-10-02T17:26:57,640 DEBUG [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] log.PerfLogger: 2017-10-02T17:26:57,641 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/734735d4-fd86-42fe-8fc1-6d9736bcd0b1/reduce.xml 2017-10-02T17:26:57,641 DEBUG [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] log.PerfLogger: 2017-10-02T17:26:57,641 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] exec.SerializationUtilities: Deserializing ReduceWork using kryo 2017-10-02T17:26:57,641 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] tez.ReduceRecordProcessor: Waiting for ShuffleInputs to become ready 2017-10-02T17:26:57,642 DEBUG [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] log.PerfLogger: 2017-10-02T17:26:57,642 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] exec.Utilities: Deserialized plan (via RPC) - name: Reducer 3 size: 2.30KB 2017-10-02T17:26:57,642 DEBUG [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] log.PerfLogger: 2017-10-02T17:26:57,643 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] tez.ReduceRecordProcessor: Waiting for ShuffleInputs to become ready 2017-10-02T17:26:57,675 INFO [IPC Server handler 4 on 43326 (1506602683416_0067_180_02_000005_2)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_02_000005_2 : ACCEPTED 2017-10-02T17:26:57,698 INFO [IPC Server handler 0 on 43326 (1506602683416_0067_180_02_000002_3)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_02_000002_3 : ACCEPTED 2017-10-02T17:26:57,701 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] tez.ReduceRecordProcessor: Main work is Reducer 3 2017-10-02T17:26:57,701 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] tez.ReduceRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:57,701 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] input.OrderedGroupedKVInput: Reducer 2: creating ValuesIterator with comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator, keyClass=org.apache.hadoop.hive.ql.io.HiveKey, valClass=org.apache.hadoop.io.BytesWritable 2017-10-02T17:26:57,701 DEBUG [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] log.PerfLogger: 2017-10-02T17:26:57,701 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] vector.VectorSelectOperator: Initializing operator SEL[17] 2017-10-02T17:26:57,701 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] vector.VectorFileSinkOperator: Initializing operator FS[18] 2017-10-02T17:26:57,702 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.druid.serde.DruidSerDe@199c9fca and formatter : org.apache.hadoop.hive.druid.io.DruidOutputFormat@3ae4489f 2017-10-02T17:26:57,702 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] tez.ReduceRecordProcessor: Id =17 Id =18 <\Children> Id = 17 null<\Parent> <\FS> <\Children> <\Parent> <\SEL> 2017-10-02T17:26:57,702 DEBUG [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] log.PerfLogger: 2017-10-02T17:26:57,702 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] tez.ReduceRecordProcessor: Starting Output: out_Reducer 3 2017-10-02T17:26:57,704 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] exec.FileSinkOperator: New Final Path: FS hdfs://myhdp/apps/hive/warehouse/gs_summary.db/.hive-staging_hive_2017-10-02_17-26-50_363_1303943444912337303-634/_tmp.-ext-10002/000001_2 2017-10-02T17:26:57,704 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] hdfs.HdfsDataSegmentPusher: Configured HDFS as deep storage 2017-10-02T17:26:57,710 ERROR [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] tez.ReduceRecordSource: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2016-10-01 00:00:00.0, "00000000000003", "0003", "1", "0", "4", "1", 31.5, 1, 2016-10-01 00:00:00.0] --MY edit 1000 rows more at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:489) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:397) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:248) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:319) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:189) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:564) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:664) at org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:101) at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:955) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:903) at org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:145) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:464) ... 19 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:272) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketForFileIdx(FileSinkOperator.java:609) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:553) ... 25 more Caused by: java.lang.NullPointerException: cache at org.apache.hive.druid.com.google.common.base.Preconditions.checkNotNull(Preconditions.java:229) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.AppenderatorImpl.(AppenderatorImpl.java:146) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.Appenderators.createOffline(Appenderators.java:84) at org.apache.hadoop.hive.druid.io.DruidRecordWriter.(DruidRecordWriter.java:106) at org.apache.hadoop.hive.druid.io.DruidOutputFormat.getHiveRecordWriter(DruidOutputFormat.java:222) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getRecordWriter(HiveFileFormatUtils.java:284) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:269) ... 27 more 2017-10-02T17:26:57,710 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] vector.VectorSelectOperator: Closing operator SEL[17] 2017-10-02T17:26:57,710 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] vector.VectorFileSinkOperator: Closing operator FS[18] 2017-10-02T17:26:57,711 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] exec.FileSinkOperator: FS[18]: records written - 0 2017-10-02T17:26:57,713 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] tez.ReduceRecordProcessor: Main work is Reducer 3 2017-10-02T17:26:57,713 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] tez.ReduceRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:57,714 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] input.OrderedGroupedKVInput: Reducer 2: creating ValuesIterator with comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator, keyClass=org.apache.hadoop.hive.ql.io.HiveKey, valClass=org.apache.hadoop.io.BytesWritable 2017-10-02T17:26:57,714 DEBUG [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] log.PerfLogger: 2017-10-02T17:26:57,714 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] vector.VectorSelectOperator: Initializing operator SEL[17] 2017-10-02T17:26:57,714 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] vector.VectorFileSinkOperator: Initializing operator FS[18] 2017-10-02T17:26:57,715 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.druid.serde.DruidSerDe@3e125bae and formatter : org.apache.hadoop.hive.druid.io.DruidOutputFormat@18507eb6 2017-10-02T17:26:57,715 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] tez.ReduceRecordProcessor: Id =17 Id =18 <\Children> Id = 17 null<\Parent> <\FS> <\Children> <\Parent> <\SEL> 2017-10-02T17:26:57,715 DEBUG [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] log.PerfLogger: 2017-10-02T17:26:57,715 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] tez.ReduceRecordProcessor: Starting Output: out_Reducer 3 2017-10-02T17:26:57,718 INFO [IPC Server handler 3 on 43326 (1506602683416_0067_180_02_000004_3)] impl.ContainerRunnerImpl: SubmissionState for attempt_1506602683416_0067_180_02_000004_3 : ACCEPTED 2017-10-02T17:26:57,718 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] exec.FileSinkOperator: New Final Path: FS hdfs://myhdp/apps/hive/warehouse/gs_summary.db/.hive-staging_hive_2017-10-02_17-26-50_363_1303943444912337303-634/_tmp.-ext-10002/000008_2 2017-10-02T17:26:57,718 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] hdfs.HdfsDataSegmentPusher: Configured HDFS as deep storage 2017-10-02T17:26:57,724 ERROR [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] tez.ReduceRecordSource: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2016-06-01 00:00:00.0, "00000000000004", "0004", "0", "0", "1", "1", 392.69, 21, 2016-06-01 00:00:00.0] --MY edit 1000 rows more at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:489) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:397) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:248) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:319) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:189) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:564) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:664) at org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:101) at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:955) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:903) at org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:145) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:464) ... 19 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:272) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketForFileIdx(FileSinkOperator.java:609) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:553) ... 25 more Caused by: java.lang.NullPointerException: cache at org.apache.hive.druid.com.google.common.base.Preconditions.checkNotNull(Preconditions.java:229) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.AppenderatorImpl.(AppenderatorImpl.java:146) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.Appenderators.createOffline(Appenderators.java:84) at org.apache.hadoop.hive.druid.io.DruidRecordWriter.(DruidRecordWriter.java:106) at org.apache.hadoop.hive.druid.io.DruidOutputFormat.getHiveRecordWriter(DruidOutputFormat.java:222) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getRecordWriter(HiveFileFormatUtils.java:284) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:269) ... 27 more 2017-10-02T17:26:57,725 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] vector.VectorSelectOperator: Closing operator SEL[17] 2017-10-02T17:26:57,725 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] vector.VectorFileSinkOperator: Closing operator FS[18] 2017-10-02T17:26:57,725 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] exec.FileSinkOperator: FS[18]: records written - 0 2017-10-02T17:26:57,737 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] vector.VectorFileSinkOperator: RECORDS_OUT_1_gs_ozet.summary_tbl_druid3:0, 2017-10-02T17:26:57,739 ERROR [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] tez.TezProcessor: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2016-10-01 00:00:00.0, "00000000000005", "0002", "1", "0", "4", "1", 31.5, 1, 2016-10-01 00:00:00.0] --MY edit 1000 rows more at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:406) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:248) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:319) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:189) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2016-10-01 00:00:00.0, "00000000000005", "0003", "1", "0", "4", "1", 31.5, 1, 2016-10-01 00:00:00.0] --MY edit 1000 rows more at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:489) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:397) ... 18 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:564) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:664) at org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:101) at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:955) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:903) at org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:145) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:464) ... 19 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:272) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketForFileIdx(FileSinkOperator.java:609) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:553) ... 25 more Caused by: java.lang.NullPointerException: cache at org.apache.hive.druid.com.google.common.base.Preconditions.checkNotNull(Preconditions.java:229) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.AppenderatorImpl.(AppenderatorImpl.java:146) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.Appenderators.createOffline(Appenderators.java:84) at org.apache.hadoop.hive.druid.io.DruidRecordWriter.(DruidRecordWriter.java:106) at org.apache.hadoop.hive.druid.io.DruidOutputFormat.getHiveRecordWriter(DruidOutputFormat.java:222) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getRecordWriter(HiveFileFormatUtils.java:284) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:269) ... 27 more 2017-10-02T17:26:57,739 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] task.TaskRunner2Callable: Cleaning up task attempt_1506602683416_0067_180_02_000001_2, stopRequested=false 2017-10-02T17:26:57,739 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Final Counters for attempt_1506602683416_0067_180_02_000001_2: Counters: 57 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=1024, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=0, NUM_SHUFFLED_INPUTS=10, NUM_SKIPPED_INPUTS=40, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=10, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=815076, ADDITIONAL_SPILLS_BYTES_READ=16, SHUFFLE_BYTES=1208102, SHUFFLE_BYTES_DECOMPRESSED=3641423, SHUFFLE_BYTES_TO_MEM=814844, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=393258, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=20, MERGE_PHASE_TIME=66, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=4][HIVE RECORDS_OUT_1_gs_ozet.summary_tbl_druid3=0][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][Shuffle Errors_Reducer_3_INPUT_Reducer_2 BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][TaskCounter_Reducer_3_INPUT_Reducer_2 ADDITIONAL_SPILLS_BYTES_READ=16, ADDITIONAL_SPILLS_BYTES_WRITTEN=815076, COMBINE_INPUT_RECORDS=0, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=4, MERGED_MAP_OUTPUTS=10, MERGE_PHASE_TIME=66, NUM_DISK_TO_DISK_MERGES=0, NUM_FAILED_SHUFFLE_INPUTS=0, NUM_MEM_TO_DISK_MERGES=0, NUM_SHUFFLED_INPUTS=10, NUM_SKIPPED_INPUTS=40, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=1024, SHUFFLE_BYTES=1208102, SHUFFLE_BYTES_DECOMPRESSED=3641423, SHUFFLE_BYTES_DISK_DIRECT=393258, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_TO_MEM=814844, SHUFFLE_PHASE_TIME=20, SPILLED_RECORDS=0][TaskCounter_Reducer_3_OUTPUT_out_Reducer_3 OUTPUT_RECORDS=0]] 2017-10-02T17:26:57,739 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Joining on EventRouter 2017-10-02T17:26:57,741 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] orderedgrouped.Shuffle: Shutting down Shuffle for source: Reducer_2 2017-10-02T17:26:57,741 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] orderedgrouped.ShuffleInputEventHandlerOrderedGrouped: Reducer 2: numDmeEventsSeen=50, numDmeEventsSeenWithNoData=40, numObsoletionEventsSeen=0, updateOnClose 2017-10-02T17:26:57,741 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Closed input for vertex=Reducer 3, sourceVertex=Reducer 2, interruptedStatus=true 2017-10-02T17:26:57,742 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] output.MROutput: out_Reducer 3 closed 2017-10-02T17:26:57,742 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Closed input for vertex=Reducer 3, sourceVertex=out_Reducer 3, interruptedStatus=true 2017-10-02T17:26:57,742 INFO [TezTR-683416_67_180_2_1_2 (1506602683416_0067_180_02_000001_2)] runtime.LogicalIOProcessorRuntimeTask: Closed processor for vertex=Reducer 3, index=2, interruptedStatus=true 2017-10-02T17:26:57,752 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] vector.VectorFileSinkOperator: RECORDS_OUT_1_gs_ozet.summary_tbl_druid3:0, 2017-10-02T17:26:57,754 ERROR [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] tez.TezProcessor: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2016-06-01 00:00:00.0, "00000000000007", "0001", "0", "0", "1", "1", 392.69, 21, 2016-06-01 00:00:00.0] --MY edit 1000 rows more at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:406) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:248) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:319) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:189) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2016-06-01 00:00:00.0, "00000000000007", "0001", "0", "0", "1", "1", 392.69, 21, 2016-06-01 00:00:00.0] --MY edit 1000 rows more at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:489) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:397) ... 18 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:564) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:664) at org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:101) at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:955) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:903) at org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:145) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:464) ... 19 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:272) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketForFileIdx(FileSinkOperator.java:609) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:553) ... 25 more Caused by: java.lang.NullPointerException: cache at org.apache.hive.druid.com.google.common.base.Preconditions.checkNotNull(Preconditions.java:229) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.AppenderatorImpl.(AppenderatorImpl.java:146) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.Appenderators.createOffline(Appenderators.java:84) at org.apache.hadoop.hive.druid.io.DruidRecordWriter.(DruidRecordWriter.java:106) at org.apache.hadoop.hive.druid.io.DruidOutputFormat.getHiveRecordWriter(DruidOutputFormat.java:222) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getRecordWriter(HiveFileFormatUtils.java:284) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:269) ... 27 more 2017-10-02T17:26:57,754 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] task.TaskRunner2Callable: Cleaning up task attempt_1506602683416_0067_180_02_000008_2, stopRequested=false 2017-10-02T17:26:57,754 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Final Counters for attempt_1506602683416_0067_180_02_000008_2: Counters: 57 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=1024, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=0, NUM_SHUFFLED_INPUTS=30, NUM_SKIPPED_INPUTS=20, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=30, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=2315568, ADDITIONAL_SPILLS_BYTES_READ=40, SHUFFLE_BYTES=3429377, SHUFFLE_BYTES_DECOMPRESSED=10189184, SHUFFLE_BYTES_TO_MEM=2317749, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=1111628, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=25, MERGE_PHASE_TIME=145, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=3][HIVE RECORDS_OUT_1_gs_ozet.summary_tbl_druid3=0][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][Shuffle Errors_Reducer_3_INPUT_Reducer_2 BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][TaskCounter_Reducer_3_INPUT_Reducer_2 ADDITIONAL_SPILLS_BYTES_READ=40, ADDITIONAL_SPILLS_BYTES_WRITTEN=2315568, COMBINE_INPUT_RECORDS=0, FIRST_EVENT_RECEIVED=3, LAST_EVENT_RECEIVED=3, MERGED_MAP_OUTPUTS=30, MERGE_PHASE_TIME=145, NUM_DISK_TO_DISK_MERGES=0, NUM_FAILED_SHUFFLE_INPUTS=0, NUM_MEM_TO_DISK_MERGES=0, NUM_SHUFFLED_INPUTS=30, NUM_SKIPPED_INPUTS=20, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=1024, SHUFFLE_BYTES=3429377, SHUFFLE_BYTES_DECOMPRESSED=10189184, SHUFFLE_BYTES_DISK_DIRECT=1111628, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_TO_MEM=2317749, SHUFFLE_PHASE_TIME=25, SPILLED_RECORDS=0][TaskCounter_Reducer_3_OUTPUT_out_Reducer_3 OUTPUT_RECORDS=0]] 2017-10-02T17:26:57,754 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Joining on EventRouter 2017-10-02T17:26:57,755 INFO [Task-Executor-2 (1506602683416_0067_180_02_000001_2)] task.TezTaskRunner2: TaskRunnerResult for attempt_1506602683416_0067_180_02_000001_2 : TaskRunner2Result{endReason=TASK_ERROR, containerShutdownRequested=false, failureType=NON_FATAL, error=java.lang.RuntimeException: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2016-10-01 00:00:00.0, "00000000000008", "1000", "1", "0", "4", "1", 31.5, 1, 2016-10-01 00:00:00.0] --MY edit 1000 rows more } 2017-10-02T17:26:57,755 INFO [Task-Executor-2 (1506602683416_0067_180_02_000001_2)] impl.LlapTaskReporter: Unregistered counters for fragment: 1506602683416_0067_180_02_000001_2 2017-10-02T17:26:57,756 INFO [Task-Executor-2 (1506602683416_0067_180_02_000001_2)] impl.TaskRunnerCallable: ExecutionTime for Container: container_222212222_0067_01_007514=135 2017-10-02T17:26:57,757 INFO [Task-Executor-2 (1506602683416_0067_180_02_000002_3)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Reducer 3, VertexParallelism: 10, TaskAttemptID:attempt_1506602683416_0067_180_02_000002_3, processorName=org.apache.hadoop.hive.ql.exec.tez.ReduceTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=Reducer 2, physicalEdgeCount=50, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=out_Reducer 3, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ] 2017-10-02T17:26:57,757 INFO [Task-Executor-2 (1506602683416_0067_180_02_000002_3)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:57,757 INFO [Task-Executor-2 (1506602683416_0067_180_02_000002_3)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_02_000002_3 vertexName: Reducer 3 2017-10-02T17:26:57,758 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_02_000002_3 2017-10-02T17:26:57,759 DEBUG [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] log.PerfLogger: 2017-10-02T17:26:57,760 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] orderedgrouped.Shuffle: Shutting down Shuffle for source: Reducer_2 2017-10-02T17:26:57,760 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] orderedgrouped.ShuffleInputEventHandlerOrderedGrouped: Reducer 2: numDmeEventsSeen=50, numDmeEventsSeenWithNoData=20, numObsoletionEventsSeen=0, updateOnClose 2017-10-02T17:26:57,760 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Closed input for vertex=Reducer 3, sourceVertex=Reducer 2, interruptedStatus=true 2017-10-02T17:26:57,760 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] output.MROutput: out_Reducer 3 closed 2017-10-02T17:26:57,760 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Closed input for vertex=Reducer 3, sourceVertex=out_Reducer 3, interruptedStatus=true 2017-10-02T17:26:57,760 INFO [TezTR-683416_67_180_2_8_2 (1506602683416_0067_180_02_000008_2)] runtime.LogicalIOProcessorRuntimeTask: Closed processor for vertex=Reducer 3, index=2, interruptedStatus=true 2017-10-02T17:26:57,767 DEBUG [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] log.PerfLogger: 2017-10-02T17:26:57,767 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:57,767 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:57,767 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:57,768 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:57,768 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] resources.MemoryDistributor: InitialRequests=[out_Reducer 3:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput], [Reducer 2:INPUT:1468708992:org.apache.tez.runtime.library.input.OrderedGroupedKVInput] 2017-10-02T17:26:57,768 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:57,768 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:57,768 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 1468708992, TotalRequestedScaled: 1.3557313772307694E9, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.19 2017-10-02T17:26:57,768 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] resources.MemoryDistributor: Allocations=[out_Reducer 3:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0], [Reducer 2:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:1468708992:1468708992] 2017-10-02T17:26:57,768 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:57,768 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] runtime.LogicalIOProcessorRuntimeTask: Input: Reducer 2 being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:57,768 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:57,769 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:57,771 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:57,771 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_02_000002_3 2017-10-02T17:26:57,771 DEBUG [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] log.PerfLogger: 2017-10-02T17:26:57,771 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/734735d4-fd86-42fe-8fc1-6d9736bcd0b1/reduce.xml 2017-10-02T17:26:57,771 DEBUG [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] log.PerfLogger: 2017-10-02T17:26:57,771 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] exec.SerializationUtilities: Deserializing ReduceWork using kryo 2017-10-02T17:26:57,772 INFO [Task-Executor-0 (1506602683416_0067_180_02_000008_2)] task.TezTaskRunner2: TaskRunnerResult for attempt_1506602683416_0067_180_02_000008_2 : TaskRunner2Result{endReason=TASK_ERROR, containerShutdownRequested=false, failureType=NON_FATAL, error=java.lang.RuntimeException: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2016-06-01 00:00:00.0, "00000000000010", "0002", "0", "0", "1", "1", 392.69, 21, 2016-06-01 00:00:00.0] --MY edit 1000 rows more } 2017-10-02T17:26:57,772 DEBUG [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] log.PerfLogger: 2017-10-02T17:26:57,773 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] exec.Utilities: Deserialized plan (via RPC) - name: Reducer 3 size: 2.30KB 2017-10-02T17:26:57,773 INFO [Task-Executor-0 (1506602683416_0067_180_02_000008_2)] impl.LlapTaskReporter: Unregistered counters for fragment: 1506602683416_0067_180_02_000008_2 2017-10-02T17:26:57,773 INFO [Task-Executor-0 (1506602683416_0067_180_02_000008_2)] impl.TaskRunnerCallable: ExecutionTime for Container: container_222212222_0067_01_007511=216 2017-10-02T17:26:57,773 DEBUG [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] log.PerfLogger: 2017-10-02T17:26:57,774 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] tez.ReduceRecordProcessor: Waiting for ShuffleInputs to become ready 2017-10-02T17:26:57,775 INFO [Task-Executor-0 (1506602683416_0067_180_02_000004_3)] runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : CREATE TABLE gs_summary.summary_tbl_d...string)(Stage-1), VertexName: Reducer 3, VertexParallelism: 10, TaskAttemptID:attempt_1506602683416_0067_180_02_000004_3, processorName=org.apache.hadoop.hive.ql.exec.tez.ReduceTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=Reducer 2, physicalEdgeCount=50, inputClassName=org.apache.tez.runtime.library.input.OrderedGroupedKVInput }}, ], outputSpecList=[{{ destinationVertexName=out_Reducer 3, physicalEdgeCount=0, outputClassName=org.apache.tez.mapreduce.output.MROutput }}, ] 2017-10-02T17:26:57,775 INFO [Task-Executor-0 (1506602683416_0067_180_02_000004_3)] resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=7730102272, allocatorClassName=org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2017-10-02T17:26:57,775 INFO [Task-Executor-0 (1506602683416_0067_180_02_000004_3)] impl.LlapTaskReporter: Registered counters for fragment: 1506602683416_0067_180_02_000004_3 vertexName: Reducer 3 2017-10-02T17:26:57,777 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] task.TaskRunner2Callable: Initializing task, taskAttemptId=attempt_1506602683416_0067_180_02_000004_3 2017-10-02T17:26:57,778 DEBUG [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] log.PerfLogger: 2017-10-02T17:26:57,784 DEBUG [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] log.PerfLogger: 2017-10-02T17:26:57,784 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] runtime.LogicalIOProcessorRuntimeTask: Initialized processor 2017-10-02T17:26:57,784 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2017-10-02T17:26:57,784 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2017-10-02T17:26:57,794 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2017-10-02T17:26:57,794 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] resources.MemoryDistributor: InitialRequests=[Reducer 2:INPUT:1468708992:org.apache.tez.runtime.library.input.OrderedGroupedKVInput], [out_Reducer 3:OUTPUT:0:org.apache.tez.mapreduce.output.MROutput] 2017-10-02T17:26:57,795 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] resources.WeightedScalingMemoryDistributor: ScaleRatiosUsed=[PARTITIONED_UNSORTED_OUTPUT:1][UNSORTED_OUTPUT:1][UNSORTED_INPUT:1][SORTED_OUTPUT:12][SORTED_MERGED_INPUT:12][PROCESSOR:1][OTHER:1] 2017-10-02T17:26:57,795 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2017-10-02T17:26:57,795 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 13, TotalRequested: 1468708992, TotalRequestedScaled: 1.3557313772307694E9, TotalJVMHeap: 7730102272, TotalAvailable: 5179168522, TotalRequested/TotalJVMHeap:0.19 2017-10-02T17:26:57,795 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] resources.MemoryDistributor: Allocations=[Reducer 2:org.apache.tez.runtime.library.input.OrderedGroupedKVInput:INPUT:1468708992:1468708992], [out_Reducer 3:org.apache.tez.mapreduce.output.MROutput:OUTPUT:0:0] 2017-10-02T17:26:57,795 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2017-10-02T17:26:57,795 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] runtime.LogicalIOProcessorRuntimeTask: Input: Reducer 2 being auto started by the framework. Subsequent instances will not be auto-started 2017-10-02T17:26:57,795 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2017-10-02T17:26:57,795 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2017-10-02T17:26:57,797 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2017-10-02T17:26:57,797 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] task.TaskRunner2Callable: Running task, taskAttemptId=attempt_1506602683416_0067_180_02_000004_3 2017-10-02T17:26:57,797 DEBUG [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] log.PerfLogger: 2017-10-02T17:26:57,797 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] exec.Utilities: PLAN PATH = hdfs://myhdp/tmp/hive/hive/3c9d0105-d5d3-4d78-b469-475a7f11ed31/hive_2017-10-02_17-26-50_363_1303943444912337303-635/hive/_tez_scratch_dir/734735d4-fd86-42fe-8fc1-6d9736bcd0b1/reduce.xml 2017-10-02T17:26:57,798 DEBUG [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] log.PerfLogger: 2017-10-02T17:26:57,798 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] exec.SerializationUtilities: Deserializing ReduceWork using kryo 2017-10-02T17:26:57,799 DEBUG [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] log.PerfLogger: 2017-10-02T17:26:57,799 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] exec.Utilities: Deserialized plan (via RPC) - name: Reducer 3 size: 2.30KB 2017-10-02T17:26:57,799 DEBUG [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] log.PerfLogger: 2017-10-02T17:26:57,800 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] tez.ReduceRecordProcessor: Waiting for ShuffleInputs to become ready 2017-10-02T17:26:57,825 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] tez.ReduceRecordProcessor: Main work is Reducer 3 2017-10-02T17:26:57,825 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] tez.ReduceRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:57,825 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] input.OrderedGroupedKVInput: Reducer 2: creating ValuesIterator with comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator, keyClass=org.apache.hadoop.hive.ql.io.HiveKey, valClass=org.apache.hadoop.io.BytesWritable 2017-10-02T17:26:57,825 DEBUG [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] log.PerfLogger: 2017-10-02T17:26:57,825 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] vector.VectorSelectOperator: Initializing operator SEL[17] 2017-10-02T17:26:57,826 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] vector.VectorFileSinkOperator: Initializing operator FS[18] 2017-10-02T17:26:57,826 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.druid.serde.DruidSerDe@50bd1eb3 and formatter : org.apache.hadoop.hive.druid.io.DruidOutputFormat@57cdbcae 2017-10-02T17:26:57,826 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] tez.ReduceRecordProcessor: Id =17 Id =18 <\Children> Id = 17 null<\Parent> <\FS> <\Children> <\Parent> <\SEL> 2017-10-02T17:26:57,826 DEBUG [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] log.PerfLogger: 2017-10-02T17:26:57,826 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] tez.ReduceRecordProcessor: Starting Output: out_Reducer 3 2017-10-02T17:26:57,828 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] exec.FileSinkOperator: New Final Path: FS hdfs://myhdp/apps/hive/warehouse/gs_summary.db/.hive-staging_hive_2017-10-02_17-26-50_363_1303943444912337303-634/_tmp.-ext-10002/000003_2 2017-10-02T17:26:57,828 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] hdfs.HdfsDataSegmentPusher: Configured HDFS as deep storage 2017-10-02T17:26:57,834 ERROR [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] tez.ReduceRecordSource: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2016-01-10 00:00:00.0, "00000000000009", "1001", "1", "0", "16", "2", 0.0, 1, 2016-01-01 00:00:00.0] --MY edit 1000 rows more at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:489) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:397) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:248) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:319) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:189) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:564) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:664) at org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:101) at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:955) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:903) at org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:145) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:464) ... 19 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:272) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketForFileIdx(FileSinkOperator.java:609) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:553) ... 25 more Caused by: java.lang.NullPointerException: cache at org.apache.hive.druid.com.google.common.base.Preconditions.checkNotNull(Preconditions.java:229) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.AppenderatorImpl.(AppenderatorImpl.java:146) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.Appenderators.createOffline(Appenderators.java:84) at org.apache.hadoop.hive.druid.io.DruidRecordWriter.(DruidRecordWriter.java:106) at org.apache.hadoop.hive.druid.io.DruidOutputFormat.getHiveRecordWriter(DruidOutputFormat.java:222) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getRecordWriter(HiveFileFormatUtils.java:284) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:269) ... 27 more 2017-10-02T17:26:57,834 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] vector.VectorSelectOperator: Closing operator SEL[17] 2017-10-02T17:26:57,834 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] vector.VectorFileSinkOperator: Closing operator FS[18] 2017-10-02T17:26:57,834 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] exec.FileSinkOperator: FS[18]: records written - 0 2017-10-02T17:26:57,859 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] vector.VectorFileSinkOperator: RECORDS_OUT_1_gs_ozet.summary_tbl_druid3:0, 2017-10-02T17:26:57,860 ERROR [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] tez.TezProcessor: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2016-01-10 00:00:00.0, "00000000000009", "1001", "1", "0", "16", "2", 0.0, 1, 2016-01-01 00:00:00.0] --MY edit 1000 rows more at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:406) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:248) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:319) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:189) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:172) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73) at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37) at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP [2016-01-10 00:00:00.0, "00000000000009", "1001", "1", "0", "16", "2", 0.0, 1, 2016-01-01 00:00:00.0] --MY edit 1000 rows more at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:489) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:397) ... 18 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:564) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:664) at org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:101) at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:955) at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:903) at org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:145) at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:464) ... 19 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:272) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketForFileIdx(FileSinkOperator.java:609) at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:553) ... 25 more Caused by: java.lang.NullPointerException: cache at org.apache.hive.druid.com.google.common.base.Preconditions.checkNotNull(Preconditions.java:229) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.AppenderatorImpl.(AppenderatorImpl.java:146) at org.apache.hive.druid.io.druid.segment.realtime.appenderator.Appenderators.createOffline(Appenderators.java:84) at org.apache.hadoop.hive.druid.io.DruidRecordWriter.(DruidRecordWriter.java:106) at org.apache.hadoop.hive.druid.io.DruidOutputFormat.getHiveRecordWriter(DruidOutputFormat.java:222) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getRecordWriter(HiveFileFormatUtils.java:284) at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:269) ... 27 more 2017-10-02T17:26:57,860 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] task.TaskRunner2Callable: Cleaning up task attempt_1506602683416_0067_180_02_000003_2, stopRequested=false 2017-10-02T17:26:57,860 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Final Counters for attempt_1506602683416_0067_180_02_000003_2: Counters: 57 [[org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=1024, COMBINE_INPUT_RECORDS=0, SPILLED_RECORDS=0, NUM_SHUFFLED_INPUTS=40, NUM_SKIPPED_INPUTS=10, NUM_FAILED_SHUFFLE_INPUTS=0, MERGED_MAP_OUTPUTS=40, OUTPUT_RECORDS=0, ADDITIONAL_SPILLS_BYTES_WRITTEN=2656738, ADDITIONAL_SPILLS_BYTES_READ=52, SHUFFLE_BYTES=3936515, SHUFFLE_BYTES_DECOMPRESSED=11659865, SHUFFLE_BYTES_TO_MEM=2658025, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_DISK_DIRECT=1278490, NUM_MEM_TO_DISK_MERGES=0, NUM_DISK_TO_DISK_MERGES=0, SHUFFLE_PHASE_TIME=40, MERGE_PHASE_TIME=186, FIRST_EVENT_RECEIVED=5, LAST_EVENT_RECEIVED=11][HIVE RECORDS_OUT_1_gs_ozet.summary_tbl_druid3=0][Shuffle Errors BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][Shuffle Errors_Reducer_3_INPUT_Reducer_2 BAD_ID=0, CONNECTION=0, IO_ERROR=0, WRONG_LENGTH=0, WRONG_MAP=0, WRONG_REDUCE=0][TaskCounter_Reducer_3_INPUT_Reducer_2 ADDITIONAL_SPILLS_BYTES_READ=52, ADDITIONAL_SPILLS_BYTES_WRITTEN=2656738, COMBINE_INPUT_RECORDS=0, FIRST_EVENT_RECEIVED=5, LAST_EVENT_RECEIVED=11, MERGED_MAP_OUTPUTS=40, MERGE_PHASE_TIME=186, NUM_DISK_TO_DISK_MERGES=0, NUM_FAILED_SHUFFLE_INPUTS=0, NUM_MEM_TO_DISK_MERGES=0, NUM_SHUFFLED_INPUTS=40, NUM_SKIPPED_INPUTS=10, REDUCE_INPUT_GROUPS=1, REDUCE_INPUT_RECORDS=1024, SHUFFLE_BYTES=3936515, SHUFFLE_BYTES_DECOMPRESSED=11659865, SHUFFLE_BYTES_DISK_DIRECT=1278490, SHUFFLE_BYTES_TO_DISK=0, SHUFFLE_BYTES_TO_MEM=2658025, SHUFFLE_PHASE_TIME=40, SPILLED_RECORDS=0][TaskCounter_Reducer_3_OUTPUT_out_Reducer_3 OUTPUT_RECORDS=0]] 2017-10-02T17:26:57,860 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Joining on EventRouter 2017-10-02T17:26:57,865 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] orderedgrouped.Shuffle: Shutting down Shuffle for source: Reducer_2 2017-10-02T17:26:57,865 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] orderedgrouped.ShuffleInputEventHandlerOrderedGrouped: Reducer 2: numDmeEventsSeen=50, numDmeEventsSeenWithNoData=10, numObsoletionEventsSeen=0, updateOnClose 2017-10-02T17:26:57,865 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Closed input for vertex=Reducer 3, sourceVertex=Reducer 2, interruptedStatus=true 2017-10-02T17:26:57,865 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] output.MROutput: out_Reducer 3 closed 2017-10-02T17:26:57,865 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Closed input for vertex=Reducer 3, sourceVertex=out_Reducer 3, interruptedStatus=true 2017-10-02T17:26:57,865 INFO [TezTR-683416_67_180_2_3_2 (1506602683416_0067_180_02_000003_2)] runtime.LogicalIOProcessorRuntimeTask: Closed processor for vertex=Reducer 3, index=2, interruptedStatus=true 2017-10-02T17:26:57,870 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] tez.ReduceRecordProcessor: Main work is Reducer 3 2017-10-02T17:26:57,870 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] tez.ReduceRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:57,870 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] input.OrderedGroupedKVInput: Reducer 2: creating ValuesIterator with comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator, keyClass=org.apache.hadoop.hive.ql.io.HiveKey, valClass=org.apache.hadoop.io.BytesWritable 2017-10-02T17:26:57,870 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] tez.ReduceRecordProcessor: Main work is Reducer 3 2017-10-02T17:26:57,871 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] tez.ReduceRecordProcessor: Memory available for operators set to 2.28GB 2017-10-02T17:26:57,871 DEBUG [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] log.PerfLogger: 2017-10-02T17:26:57,871 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] input.OrderedGroupedKVInput: Reducer 2: creating ValuesIterator with comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator, keyClass=org.apache.hadoop.hive.ql.io.HiveKey, valClass=org.apache.hadoop.io.BytesWritable 2017-10-02T17:26:57,871 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] vector.VectorSelectOperator: Initializing operator SEL[17] 2017-10-02T17:26:57,871 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] vector.VectorFileSinkOperator: Initializing operator FS[18] 2017-10-02T17:26:57,871 DEBUG [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] log.PerfLogger: 2017-10-02T17:26:57,871 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] vector.VectorSelectOperator: Initializing operator SEL[17] 2017-10-02T17:26:57,871 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] vector.VectorFileSinkOperator: Initializing operator FS[18] 2017-10-02T17:26:57,871 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.druid.serde.DruidSerDe@43aef361 and formatter : org.apache.hadoop.hive.druid.io.DruidOutputFormat@29ff10cf 2017-10-02T17:26:57,872 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] tez.ReduceRecordProcessor: Id =17 Id =18 <\Children> Id = 17 null<\Parent> <\FS> <\Children> <\Parent> <\SEL> 2017-10-02T17:26:57,872 DEBUG [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] log.PerfLogger: 2017-10-02T17:26:57,872 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] tez.ReduceRecordProcessor: Starting Output: out_Reducer 3 2017-10-02T17:26:57,872 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] exec.FileSinkOperator: Using serializer : org.apache.hadoop.hive.druid.serde.DruidSerDe@3839ba56 and formatter : org.apache.hadoop.hive.druid.io.DruidOutputFormat@1600c853 2017-10-02T17:26:57,872 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] tez.ReduceRecordProcessor: Id =17 Id =18 <\Children> Id = 17 null<\Parent> <\FS> <\Children> <\Parent> <\SEL> 2017-10-02T17:26:57,872 DEBUG [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] log.PerfLogger: 2017-10-02T17:26:57,872 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] tez.ReduceRecordProcessor: Starting Output: out_Reducer 3 2017-10-02T17:26:57,873 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] exec.FileSinkOperator: New Final Path: FS hdfs://myhdp/apps/hive/warehouse/gs_summary.db/.hive-staging_hive_2017-10-02_17-26-50_363_1303943444912337303-634/_tmp.-ext-10002/000004_3 2017-10-02T17:26:57,874 INFO [TezTR-683416_67_180_2_4_3 (1506602683416_0067_180_02_000004_3)] hdfs.HdfsDataSegmentPusher: Configured HDFS as deep storage 2017-10-02T17:26:57,874 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] exec.FileSinkOperator: New Final Path: FS hdfs://myhdp/apps/hive/warehouse/gs_summary.db/.hive-staging_hive_2017-10-02_17-26-50_363_1303943444912337303-634/_tmp.-ext-10002/000002_3 2017-10-02T17:26:57,874 INFO [TezTR-683416_67_180_2_2_3 (1506602683416_0067_180_02_000002_3)] hdfs.HdfsDataSegmentPusher: Configured HDFS as deep storage 2017-10-02T17:26:57,880 INFO [Task-Executor-1 (1506602683416_0067_180_02_000003_2)] task.TezTaskRunner2: TaskRunnerResult for attempt_1506602683416_0067_180_02_000003_2 : TaskRunner2Result{endReason=TASK_ERROR, containerShutdownRequested=false, failureType=NON_FATAL, error=java.lang.RuntimeException: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing vector batch (tag=0) (vectorizedVertexNum 2) Column vector types: 1:TIMESTAMP, 2:BYTES, 3:BYTES, 4:BYTES, 5:BYTES, 6:BYTES, 7:BYTES, 8:DOUBLE, 9:LONG, 0:TIMESTAMP --more and more same errors } 2017-10-02T17:26:58,121 INFO [Task-Executor-0 (1506602683416_0067_180_02_000007_2)] impl.LlapTaskReporter: Unregistered counters for fragment: 1506602683416_0067_180_02_000007_2 2017-10-02T17:26:58,121 INFO [Task-Executor-0 (1506602683416_0067_180_02_000007_2)] impl.TaskRunnerCallable: ExecutionTime for Container: container_222212222_0067_01_007515=193 End of LogType:hive_20171002172650_1672cd6f-dec7-46ca-bb45-f52491e7ba33-dag_1506602683416_0067_180.log.done.This log file belongs to a running container (container_e47_1506602683416_0064_01_000003) and so may not be complete. *************************************************************************************************************************************************************