WARNING: Use "yarn jar" to launch YARN applications. 16/01/25 11:32:55 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL 16/01/25 11:32:55 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE 16/01/25 11:32:55 INFO pig.ExecTypeProvider: Trying ExecType : TEZ_LOCAL 16/01/25 11:32:55 INFO pig.ExecTypeProvider: Trying ExecType : TEZ 16/01/25 11:32:55 INFO pig.ExecTypeProvider: Picked TEZ as the ExecType 2016-01-25 11:32:55,585 [main] INFO org.apache.pig.Main - Apache Pig version 0.15.0.2.3.2.0-2950 (rexported) compiled Sep 30 2015, 19:39:20 2016-01-25 11:32:55,587 [main] INFO org.apache.pig.Main - Logging error messages to: /hadoop/yarn/local/usercache/admin/appcache/application_1453721160224_0004/container_e16_1453721160224_0004_01_000002/pig_1453721575584.log 2016-01-25 11:32:56,602 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /home/yarn/.pigbootup not found 2016-01-25 11:32:56,775 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://sandbox.hortonworks.com:8020 2016-01-25 11:32:58,301 [main] WARN org.apache.pig.newplan.BaseOperatorPlan - Encountered Warning IMPLICIT_CAST_TO_INT 1 time(s). 2016-01-25 11:32:58,302 [main] WARN org.apache.pig.newplan.BaseOperatorPlan - Encountered Warning IMPLICIT_CAST_TO_DOUBLE 1 time(s). 2016-01-25 11:32:58,336 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: HASH_JOIN,GROUP_BY,FILTER 2016-01-25 11:32:58,408 [main] INFO org.apache.pig.data.SchemaTupleBackend - Key [pig.schematuple] was not set... will not generate code. 2016-01-25 11:32:58,499 [main] INFO org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer - {RULES_ENABLED=[AddForEach, ColumnMapKeyPrune, ConstantCalculator, GroupByConstParallelSetter, LimitOptimizer, LoadTypeCastInserter, MergeFilter, MergeForEach, PartitionFilterOptimizer, PredicatePushdownOptimizer, PushDownForEachFlatten, PushUpFilter, SplitFilter, StreamTypeCastInserter]} 2016-01-25 11:32:58,743 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher - Tez staging directory is /tmp/temp43768549 2016-01-25 11:32:58,810 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.plan.TezCompiler - File concatenation threshold: 100 optimistic? false 2016-01-25 11:32:58,866 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.CombinerOptimizerUtil - Choosing to move algebraic foreach to combiner 2016-01-25 11:32:59,098 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1 2016-01-25 11:32:59,098 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1 2016-01-25 11:32:59,206 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths (combined) to process : 1 2016-01-25 11:32:59,665 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - Local resource: joda-time-2.8.2.jar 2016-01-25 11:32:59,665 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - Local resource: pig-0.15.0.2.3.2.0-2950-core-h2.jar 2016-01-25 11:32:59,665 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - Local resource: antlr-runtime-3.4.jar 2016-01-25 11:32:59,665 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - Local resource: automaton-1.11-8.jar 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.merge.percent to 0.66 from MR setting mapreduce.reduce.shuffle.merge.percent 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.fetch.buffer.percent to 0.7 from MR setting mapreduce.reduce.shuffle.input.buffer.percent 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.io.sort.mb to 64 from MR setting mapreduce.task.io.sort.mb 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.memory.limit.percent to 0.25 from MR setting mapreduce.reduce.shuffle.memory.limit.percent 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.io.sort.factor to 100 from MR setting mapreduce.task.io.sort.factor 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.connect.timeout to 180000 from MR setting mapreduce.reduce.shuffle.connect.timeout 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.internal.sorter.class to org.apache.hadoop.util.QuickSort from MR setting map.sort.class 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.merge.progress.records to 10000 from MR setting mapreduce.task.merge.progress.records 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.compress to false from MR setting mapreduce.map.output.compress 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.sort.spill.percent to 0.7 from MR setting mapreduce.map.sort.spill.percent 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.ssl.enable to false from MR setting mapreduce.shuffle.ssl.enabled 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.ifile.readahead to true from MR setting mapreduce.ifile.readahead 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.parallel.copies to 30 from MR setting mapreduce.reduce.shuffle.parallelcopies 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.ifile.readahead.bytes to 4194304 from MR setting mapreduce.ifile.readahead.bytes 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.task.input.post-merge.buffer.percent to 0.0 from MR setting mapreduce.reduce.input.buffer.percent 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.credentials.path to /hadoop/yarn/local/usercache/admin/appcache/application_1453721160224_0004/container_e16_1453721160224_0004_01_000002/container_tokens from MR setting mapreduce.job.credentials.binary 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.read.timeout to 180000 from MR setting mapreduce.reduce.shuffle.read.timeout 2016-01-25 11:32:59,856 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.compress.codec to org.apache.hadoop.io.compress.DefaultCodec from MR setting mapreduce.map.output.compress.codec 2016-01-25 11:32:59,962 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - For vertex - scope-54: parallelism=1, memory=250, java opts=-Xmx256m 2016-01-25 11:33:00,055 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.merge.percent to 0.66 from MR setting mapreduce.reduce.shuffle.merge.percent 2016-01-25 11:33:00,055 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.fetch.buffer.percent to 0.7 from MR setting mapreduce.reduce.shuffle.input.buffer.percent 2016-01-25 11:33:00,056 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.io.sort.mb to 64 from MR setting mapreduce.task.io.sort.mb 2016-01-25 11:33:00,056 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.memory.limit.percent to 0.25 from MR setting mapreduce.reduce.shuffle.memory.limit.percent 2016-01-25 11:33:00,056 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.io.sort.factor to 100 from MR setting mapreduce.task.io.sort.factor 2016-01-25 11:33:00,056 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.connect.timeout to 180000 from MR setting mapreduce.reduce.shuffle.connect.timeout 2016-01-25 11:33:00,056 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.internal.sorter.class to org.apache.hadoop.util.QuickSort from MR setting map.sort.class 2016-01-25 11:33:00,056 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.merge.progress.records to 10000 from MR setting mapreduce.task.merge.progress.records 2016-01-25 11:33:00,057 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.compress to false from MR setting mapreduce.map.output.compress 2016-01-25 11:33:00,057 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.sort.spill.percent to 0.7 from MR setting mapreduce.map.sort.spill.percent 2016-01-25 11:33:00,057 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.ssl.enable to false from MR setting mapreduce.shuffle.ssl.enabled 2016-01-25 11:33:00,057 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.ifile.readahead to true from MR setting mapreduce.ifile.readahead 2016-01-25 11:33:00,057 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.parallel.copies to 30 from MR setting mapreduce.reduce.shuffle.parallelcopies 2016-01-25 11:33:00,057 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.ifile.readahead.bytes to 4194304 from MR setting mapreduce.ifile.readahead.bytes 2016-01-25 11:33:00,057 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.task.input.post-merge.buffer.percent to 0.0 from MR setting mapreduce.reduce.input.buffer.percent 2016-01-25 11:33:00,057 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.credentials.path to /hadoop/yarn/local/usercache/admin/appcache/application_1453721160224_0004/container_e16_1453721160224_0004_01_000002/container_tokens from MR setting mapreduce.job.credentials.binary 2016-01-25 11:33:00,058 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.read.timeout to 180000 from MR setting mapreduce.reduce.shuffle.read.timeout 2016-01-25 11:33:00,058 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.compress.codec to org.apache.hadoop.io.compress.DefaultCodec from MR setting mapreduce.map.output.compress.codec 2016-01-25 11:33:00,118 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - Set auto parallelism for vertex scope-58 2016-01-25 11:33:00,119 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - For vertex - scope-58: parallelism=1, memory=250, java opts=-Xmx256m 2016-01-25 11:33:00,173 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.merge.percent to 0.66 from MR setting mapreduce.reduce.shuffle.merge.percent 2016-01-25 11:33:00,174 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.fetch.buffer.percent to 0.7 from MR setting mapreduce.reduce.shuffle.input.buffer.percent 2016-01-25 11:33:00,174 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.io.sort.mb to 64 from MR setting mapreduce.task.io.sort.mb 2016-01-25 11:33:00,174 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.memory.limit.percent to 0.25 from MR setting mapreduce.reduce.shuffle.memory.limit.percent 2016-01-25 11:33:00,174 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.io.sort.factor to 100 from MR setting mapreduce.task.io.sort.factor 2016-01-25 11:33:00,174 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.connect.timeout to 180000 from MR setting mapreduce.reduce.shuffle.connect.timeout 2016-01-25 11:33:00,174 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.internal.sorter.class to org.apache.hadoop.util.QuickSort from MR setting map.sort.class 2016-01-25 11:33:00,174 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.merge.progress.records to 10000 from MR setting mapreduce.task.merge.progress.records 2016-01-25 11:33:00,175 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.compress to false from MR setting mapreduce.map.output.compress 2016-01-25 11:33:00,175 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.sort.spill.percent to 0.7 from MR setting mapreduce.map.sort.spill.percent 2016-01-25 11:33:00,175 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.ssl.enable to false from MR setting mapreduce.shuffle.ssl.enabled 2016-01-25 11:33:00,175 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.ifile.readahead to true from MR setting mapreduce.ifile.readahead 2016-01-25 11:33:00,175 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.parallel.copies to 30 from MR setting mapreduce.reduce.shuffle.parallelcopies 2016-01-25 11:33:00,175 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.ifile.readahead.bytes to 4194304 from MR setting mapreduce.ifile.readahead.bytes 2016-01-25 11:33:00,175 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.task.input.post-merge.buffer.percent to 0.0 from MR setting mapreduce.reduce.input.buffer.percent 2016-01-25 11:33:00,175 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.credentials.path to /hadoop/yarn/local/usercache/admin/appcache/application_1453721160224_0004/container_e16_1453721160224_0004_01_000002/container_tokens from MR setting mapreduce.job.credentials.binary 2016-01-25 11:33:00,175 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.read.timeout to 180000 from MR setting mapreduce.reduce.shuffle.read.timeout 2016-01-25 11:33:00,175 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.compress.codec to org.apache.hadoop.io.compress.DefaultCodec from MR setting mapreduce.map.output.compress.codec 2016-01-25 11:33:00,234 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.merge.percent to 0.66 from MR setting mapreduce.reduce.shuffle.merge.percent 2016-01-25 11:33:00,234 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.fetch.buffer.percent to 0.7 from MR setting mapreduce.reduce.shuffle.input.buffer.percent 2016-01-25 11:33:00,234 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.io.sort.mb to 64 from MR setting mapreduce.task.io.sort.mb 2016-01-25 11:33:00,234 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.memory.limit.percent to 0.25 from MR setting mapreduce.reduce.shuffle.memory.limit.percent 2016-01-25 11:33:00,235 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.io.sort.factor to 100 from MR setting mapreduce.task.io.sort.factor 2016-01-25 11:33:00,235 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.connect.timeout to 180000 from MR setting mapreduce.reduce.shuffle.connect.timeout 2016-01-25 11:33:00,236 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.internal.sorter.class to org.apache.hadoop.util.QuickSort from MR setting map.sort.class 2016-01-25 11:33:00,236 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.merge.progress.records to 10000 from MR setting mapreduce.task.merge.progress.records 2016-01-25 11:33:00,237 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.compress to false from MR setting mapreduce.map.output.compress 2016-01-25 11:33:00,237 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.sort.spill.percent to 0.7 from MR setting mapreduce.map.sort.spill.percent 2016-01-25 11:33:00,237 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.ssl.enable to false from MR setting mapreduce.shuffle.ssl.enabled 2016-01-25 11:33:00,237 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.ifile.readahead to true from MR setting mapreduce.ifile.readahead 2016-01-25 11:33:00,237 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.parallel.copies to 30 from MR setting mapreduce.reduce.shuffle.parallelcopies 2016-01-25 11:33:00,237 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.ifile.readahead.bytes to 4194304 from MR setting mapreduce.ifile.readahead.bytes 2016-01-25 11:33:00,237 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.task.input.post-merge.buffer.percent to 0.0 from MR setting mapreduce.reduce.input.buffer.percent 2016-01-25 11:33:00,237 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.credentials.path to /hadoop/yarn/local/usercache/admin/appcache/application_1453721160224_0004/container_e16_1453721160224_0004_01_000002/container_tokens from MR setting mapreduce.job.credentials.binary 2016-01-25 11:33:00,237 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.read.timeout to 180000 from MR setting mapreduce.reduce.shuffle.read.timeout 2016-01-25 11:33:00,237 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.compress.codec to org.apache.hadoop.io.compress.DefaultCodec from MR setting mapreduce.map.output.compress.codec 2016-01-25 11:33:00,266 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - Set auto parallelism for vertex scope-61 2016-01-25 11:33:00,267 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler - For vertex - scope-61: parallelism=2, memory=250, java opts=-Xmx256m 2016-01-25 11:33:00,302 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.merge.percent to 0.66 from MR setting mapreduce.reduce.shuffle.merge.percent 2016-01-25 11:33:00,302 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.fetch.buffer.percent to 0.7 from MR setting mapreduce.reduce.shuffle.input.buffer.percent 2016-01-25 11:33:00,302 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.io.sort.mb to 64 from MR setting mapreduce.task.io.sort.mb 2016-01-25 11:33:00,302 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.memory.limit.percent to 0.25 from MR setting mapreduce.reduce.shuffle.memory.limit.percent 2016-01-25 11:33:00,302 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.io.sort.factor to 100 from MR setting mapreduce.task.io.sort.factor 2016-01-25 11:33:00,303 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.connect.timeout to 180000 from MR setting mapreduce.reduce.shuffle.connect.timeout 2016-01-25 11:33:00,303 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.internal.sorter.class to org.apache.hadoop.util.QuickSort from MR setting map.sort.class 2016-01-25 11:33:00,303 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.merge.progress.records to 10000 from MR setting mapreduce.task.merge.progress.records 2016-01-25 11:33:00,303 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.compress to false from MR setting mapreduce.map.output.compress 2016-01-25 11:33:00,303 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.sort.spill.percent to 0.7 from MR setting mapreduce.map.sort.spill.percent 2016-01-25 11:33:00,303 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.ssl.enable to false from MR setting mapreduce.shuffle.ssl.enabled 2016-01-25 11:33:00,303 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.ifile.readahead to true from MR setting mapreduce.ifile.readahead 2016-01-25 11:33:00,303 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.parallel.copies to 30 from MR setting mapreduce.reduce.shuffle.parallelcopies 2016-01-25 11:33:00,303 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.ifile.readahead.bytes to 4194304 from MR setting mapreduce.ifile.readahead.bytes 2016-01-25 11:33:00,303 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.task.input.post-merge.buffer.percent to 0.0 from MR setting mapreduce.reduce.input.buffer.percent 2016-01-25 11:33:00,304 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.credentials.path to /hadoop/yarn/local/usercache/admin/appcache/application_1453721160224_0004/container_e16_1453721160224_0004_01_000002/container_tokens from MR setting mapreduce.job.credentials.binary 2016-01-25 11:33:00,304 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.read.timeout to 180000 from MR setting mapreduce.reduce.shuffle.read.timeout 2016-01-25 11:33:00,304 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.compress.codec to org.apache.hadoop.io.compress.DefaultCodec from MR setting mapreduce.map.output.compress.codec 2016-01-25 11:33:00,355 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.merge.percent to 0.66 from MR setting mapreduce.reduce.shuffle.merge.percent 2016-01-25 11:33:00,355 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.fetch.buffer.percent to 0.7 from MR setting mapreduce.reduce.shuffle.input.buffer.percent 2016-01-25 11:33:00,355 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.io.sort.mb to 64 from MR setting mapreduce.task.io.sort.mb 2016-01-25 11:33:00,355 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.memory.limit.percent to 0.25 from MR setting mapreduce.reduce.shuffle.memory.limit.percent 2016-01-25 11:33:00,355 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.io.sort.factor to 100 from MR setting mapreduce.task.io.sort.factor 2016-01-25 11:33:00,355 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.connect.timeout to 180000 from MR setting mapreduce.reduce.shuffle.connect.timeout 2016-01-25 11:33:00,356 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.internal.sorter.class to org.apache.hadoop.util.QuickSort from MR setting map.sort.class 2016-01-25 11:33:00,356 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.merge.progress.records to 10000 from MR setting mapreduce.task.merge.progress.records 2016-01-25 11:33:00,356 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.compress to false from MR setting mapreduce.map.output.compress 2016-01-25 11:33:00,356 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.sort.spill.percent to 0.7 from MR setting mapreduce.map.sort.spill.percent 2016-01-25 11:33:00,356 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.ssl.enable to false from MR setting mapreduce.shuffle.ssl.enabled 2016-01-25 11:33:00,356 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.ifile.readahead to true from MR setting mapreduce.ifile.readahead 2016-01-25 11:33:00,356 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.parallel.copies to 30 from MR setting mapreduce.reduce.shuffle.parallelcopies 2016-01-25 11:33:00,356 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.ifile.readahead.bytes to 4194304 from MR setting mapreduce.ifile.readahead.bytes 2016-01-25 11:33:00,356 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.task.input.post-merge.buffer.percent to 0.0 from MR setting mapreduce.reduce.input.buffer.percent 2016-01-25 11:33:00,356 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.credentials.path to /hadoop/yarn/local/usercache/admin/appcache/application_1453721160224_0004/container_e16_1453721160224_0004_01_000002/container_tokens from MR setting mapreduce.job.credentials.binary 2016-01-25 11:33:00,356 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.shuffle.read.timeout to 180000 from MR setting mapreduce.reduce.shuffle.read.timeout 2016-01-25 11:33:00,357 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.util.MRToTezHelper - Setting tez.runtime.compress.codec to org.apache.hadoop.io.compress.DefaultCodec from MR setting mapreduce.map.output.compress.codec 2016-01-25 11:33:00,455 [PigTezLauncher-0] INFO org.apache.pig.tools.pigstats.tez.TezScriptState - Pig script settings are added to the job 2016-01-25 11:33:00,500 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez Client Version: [ component=tez-api, version=0.7.0.2.3.2.0-2950, revision=4900a9cea70487666ace4c9e490d4d8fc1fee96f, SCM-URL=scm:git:https://git-wip-us.apache.org/repos/asf/tez.git, buildTime=20150930-1859 ] 2016-01-25 11:33:00,946 [PigTezLauncher-0] INFO org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl - Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 2016-01-25 11:33:01,074 [PigTezLauncher-0] INFO org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at sandbox.hortonworks.com/10.0.2.15:8050 2016-01-25 11:33:01,197 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Using org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager to manage Timeline ACLs 2016-01-25 11:33:01,318 [PigTezLauncher-0] INFO org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl - Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 2016-01-25 11:33:01,319 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Session mode. Starting session. 2016-01-25 11:33:01,323 [PigTezLauncher-0] INFO org.apache.tez.common.security.TokenCache - Merging additional tokens from binary file, binaryFileName=/hadoop/yarn/local/usercache/admin/appcache/application_1453721160224_0004/container_e16_1453721160224_0004_01_000002/container_tokens 2016-01-25 11:33:01,324 [PigTezLauncher-0] INFO org.apache.tez.client.TezClientUtils - Using tez.lib.uris value from configuration: /hdp/apps/2.3.2.0-2950/tez/tez.tar.gz 2016-01-25 11:33:01,377 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Tez system stage directory hdfs://sandbox.hortonworks.com:8020/tmp/temp43768549/.tez/application_1453721160224_0005 doesn't exist and is created 2016-01-25 11:33:01,481 [PigTezLauncher-0] INFO org.apache.tez.dag.history.ats.acls.ATSHistoryACLPolicyManager - Created Timeline Domain for History ACLs, domainId=Tez_ATS_application_1453721160224_0005 2016-01-25 11:33:02,021 [PigTezLauncher-0] INFO org.apache.hadoop.yarn.client.api.impl.YarnClientImpl - Submitted application application_1453721160224_0005 2016-01-25 11:33:02,025 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - The url to track the Tez Session: http://sandbox.hortonworks.com:8088/proxy/application_1453721160224_0005/ 2016-01-25 11:33:07,667 [PigTezLauncher-0] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Submitting DAG PigLatin:script.pig-0_scope-0 2016-01-25 11:33:07,667 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Submitting dag to TezSession, sessionName=PigLatin:script.pig, applicationId=application_1453721160224_0005, dagName=PigLatin:script.pig-0_scope-0 2016-01-25 11:33:08,202 [PigTezLauncher-0] INFO org.apache.tez.client.TezClient - Submitted dag to TezSession, sessionName=PigLatin:script.pig, applicationId=application_1453721160224_0005, dagName=PigLatin:script.pig-0_scope-0 2016-01-25 11:33:08,445 [PigTezLauncher-0] INFO org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl - Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/ 2016-01-25 11:33:08,445 [PigTezLauncher-0] INFO org.apache.hadoop.yarn.client.RMProxy - Connecting to ResourceManager at sandbox.hortonworks.com/10.0.2.15:8050 2016-01-25 11:33:08,453 [PigTezLauncher-0] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJob - Submitted DAG PigLatin:script.pig-0_scope-0. Application id: application_1453721160224_0005 2016-01-25 11:33:09,415 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher - HadoopJobId: job_1453721160224_0005 2016-01-25 11:33:09,455 [Timer-0] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJob - DAG Status: status=RUNNING, progress=TotalTasks: 4 Succeeded: 0 Running: 0 Failed: 0 Killed: 0, diagnostics=, counters=null 2016-01-25 11:33:15,626 [PigTezLauncher-0] INFO org.apache.tez.common.counters.Limits - Counter limits initialized with parameters: GROUP_NAME_MAX=256, MAX_GROUPS=1000, COUNTER_NAME_MAX=64, MAX_COUNTERS=2000 2016-01-25 11:33:15,631 [PigTezLauncher-0] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezJob - DAG Status: status=SUCCEEDED, progress=TotalTasks: 3 Succeeded: 3 Running: 0 Failed: 0 Killed: 0, diagnostics=, counters=Counters: 170 org.apache.tez.common.counters.DAGCounter NUM_SUCCEEDED_TASKS=3 TOTAL_LAUNCHED_TASKS=3 DATA_LOCAL_TASKS=1 AM_CPU_MILLISECONDS=1530 AM_GC_TIME_MILLIS=22 File System Counters FILE_BYTES_READ=963407 FILE_BYTES_WRITTEN=870657 FILE_READ_OPS=0 FILE_LARGE_READ_OPS=0 FILE_WRITE_OPS=0 HDFS_BYTES_READ=6398886 HDFS_BYTES_WRITTEN=4507 HDFS_READ_OPS=4 HDFS_LARGE_READ_OPS=0 HDFS_WRITE_OPS=2 org.apache.tez.common.counters.TaskCounter REDUCE_INPUT_GROUPS=13901 REDUCE_INPUT_RECORDS=95477 COMBINE_INPUT_RECORDS=0 SPILLED_RECORDS=190954 NUM_SHUFFLED_INPUTS=5 NUM_SKIPPED_INPUTS=0 NUM_FAILED_SHUFFLE_INPUTS=0 MERGED_MAP_OUTPUTS=5 GC_TIME_MILLIS=539 CPU_MILLISECONDS=7740 PHYSICAL_MEMORY_BYTES=686292992 VIRTUAL_MEMORY_BYTES=2698252288 COMMITTED_HEAP_BYTES=686292992 INPUT_RECORDS_PROCESSED=95195 OUTPUT_RECORDS=190682 OUTPUT_BYTES=5344674 OUTPUT_BYTES_WITH_OVERHEAD=2014410 OUTPUT_BYTES_PHYSICAL=870513 ADDITIONAL_SPILLS_BYTES_WRITTEN=0 ADDITIONAL_SPILLS_BYTES_READ=870513 ADDITIONAL_SPILL_COUNT=0 SHUFFLE_CHUNK_COUNT=3 SHUFFLE_BYTES=870513 SHUFFLE_BYTES_DECOMPRESSED=2014410 SHUFFLE_BYTES_TO_MEM=0 SHUFFLE_BYTES_TO_DISK=0 SHUFFLE_BYTES_DISK_DIRECT=870513 NUM_MEM_TO_DISK_MERGES=0 NUM_DISK_TO_DISK_MERGES=0 SHUFFLE_PHASE_TIME=92 MERGE_PHASE_TIME=117 FIRST_EVENT_RECEIVED=58 LAST_EVENT_RECEIVED=62 Shuffle Errors BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 Shuffle Errors_scope_58_INPUT_scope_54 BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 Shuffle Errors_scope_61_INPUT_scope_54 BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 Shuffle Errors_scope_61_INPUT_scope_58 BAD_ID=0 CONNECTION=0 IO_ERROR=0 WRONG_LENGTH=0 WRONG_MAP=0 WRONG_REDUCE=0 TaskCounter_scope_54_INPUT_scope_0 INPUT_RECORDS_PROCESSED=95195 TaskCounter_scope_54_OUTPUT_scope_58 ADDITIONAL_SPILLS_BYTES_READ=0 ADDITIONAL_SPILLS_BYTES_WRITTEN=0 ADDITIONAL_SPILL_COUNT=0 OUTPUT_BYTES=2044018 OUTPUT_BYTES_PHYSICAL=1129 OUTPUT_BYTES_WITH_OVERHEAD=3390 OUTPUT_RECORDS=95195 SHUFFLE_CHUNK_COUNT=1 SPILLED_RECORDS=141 TaskCounter_scope_54_OUTPUT_scope_61 ADDITIONAL_SPILLS_BYTES_READ=0 ADDITIONAL_SPILLS_BYTES_WRITTEN=0 ADDITIONAL_SPILL_COUNT=0 OUTPUT_BYTES=3297695 OUTPUT_BYTES_PHYSICAL=868133 OUTPUT_BYTES_WITH_OVERHEAD=2007765 OUTPUT_RECORDS=95195 SHUFFLE_CHUNK_COUNT=1 SPILLED_RECORDS=95195 TaskCounter_scope_58_INPUT_scope_54 ADDITIONAL_SPILLS_BYTES_READ=1129 ADDITIONAL_SPILLS_BYTES_WRITTEN=0 COMBINE_INPUT_RECORDS=0 FIRST_EVENT_RECEIVED=29 LAST_EVENT_RECEIVED=29 MERGED_MAP_OUTPUTS=1 MERGE_PHASE_TIME=58 NUM_DISK_TO_DISK_MERGES=0 NUM_FAILED_SHUFFLE_INPUTS=0 NUM_MEM_TO_DISK_MERGES=0 NUM_SHUFFLED_INPUTS=1 NUM_SKIPPED_INPUTS=0 REDUCE_INPUT_GROUPS=141 REDUCE_INPUT_RECORDS=141 SHUFFLE_BYTES=1129 SHUFFLE_BYTES_DECOMPRESSED=3390 SHUFFLE_BYTES_DISK_DIRECT=1129 SHUFFLE_BYTES_TO_DISK=0 SHUFFLE_BYTES_TO_MEM=0 SHUFFLE_PHASE_TIME=45 SPILLED_RECORDS=141 TaskCounter_scope_58_OUTPUT_scope_61 ADDITIONAL_SPILLS_BYTES_READ=0 ADDITIONAL_SPILLS_BYTES_WRITTEN=0 ADDITIONAL_SPILL_COUNT=0 OUTPUT_BYTES=2961 OUTPUT_BYTES_PHYSICAL=1251 OUTPUT_BYTES_WITH_OVERHEAD=3255 OUTPUT_RECORDS=141 SHUFFLE_CHUNK_COUNT=1 SPILLED_RECORDS=141 TaskCounter_scope_61_INPUT_scope_54 ADDITIONAL_SPILLS_BYTES_READ=868133 ADDITIONAL_SPILLS_BYTES_WRITTEN=0 COMBINE_INPUT_RECORDS=0 FIRST_EVENT_RECEIVED=13 LAST_EVENT_RECEIVED=16 MERGED_MAP_OUTPUTS=2 MERGE_PHASE_TIME=25 NUM_DISK_TO_DISK_MERGES=0 NUM_FAILED_SHUFFLE_INPUTS=0 NUM_MEM_TO_DISK_MERGES=0 NUM_SHUFFLED_INPUTS=2 NUM_SKIPPED_INPUTS=0 REDUCE_INPUT_GROUPS=13619 REDUCE_INPUT_RECORDS=95195 SHUFFLE_BYTES=868133 SHUFFLE_BYTES_DECOMPRESSED=2007765 SHUFFLE_BYTES_DISK_DIRECT=868133 SHUFFLE_BYTES_TO_DISK=0 SHUFFLE_BYTES_TO_MEM=0 SHUFFLE_PHASE_TIME=19 SPILLED_RECORDS=95195 TaskCounter_scope_61_INPUT_scope_58 ADDITIONAL_SPILLS_BYTES_READ=1251 ADDITIONAL_SPILLS_BYTES_WRITTEN=0 COMBINE_INPUT_RECORDS=0 FIRST_EVENT_RECEIVED=16 LAST_EVENT_RECEIVED=17 MERGED_MAP_OUTPUTS=2 MERGE_PHASE_TIME=34 NUM_DISK_TO_DISK_MERGES=0 NUM_FAILED_SHUFFLE_INPUTS=0 NUM_MEM_TO_DISK_MERGES=0 NUM_SHUFFLED_INPUTS=2 NUM_SKIPPED_INPUTS=0 REDUCE_INPUT_GROUPS=141 REDUCE_INPUT_RECORDS=141 SHUFFLE_BYTES=1251 SHUFFLE_BYTES_DECOMPRESSED=3255 SHUFFLE_BYTES_DISK_DIRECT=1251 SHUFFLE_BYTES_TO_DISK=0 SHUFFLE_BYTES_TO_MEM=0 SHUFFLE_PHASE_TIME=28 SPILLED_RECORDS=141 TaskCounter_scope_61_OUTPUT_scope_53 OUTPUT_RECORDS=151 org.apache.hadoop.mapreduce.TaskCounter COMBINE_INPUT_RECORDS=141 COMBINE_OUTPUT_RECORDS=95195 org.apache.hadoop.mapreduce.TaskCounter_scope_54_OUTPUT_scope_58 COMBINE_INPUT_RECORDS=141 COMBINE_OUTPUT_RECORDS=95195 org.apache.hadoop.mapreduce.TaskCounter_scope_58_INPUT_scope_54 COMBINE_INPUT_RECORDS=0 COMBINE_OUTPUT_RECORDS=0 2016-01-25 11:33:16,420 [main] INFO org.apache.pig.tools.pigstats.tez.TezPigScriptStats - Script Statistics: HadoopVersion: 2.7.1.2.3.2.0-2950 PigVersion: 0.15.0.2.3.2.0-2950 TezVersion: 0.7.0.2.3.2.0-2950 UserId: yarn FileName: script.pig StartedAt: 2016-01-25 11:32:58 FinishedAt: 2016-01-25 11:33:16 Features: HASH_JOIN,GROUP_BY,FILTER Success! DAG PigLatin:script.pig-0_scope-0: ApplicationId: job_1453721160224_0005 TotalLaunchedTasks: 3 FileBytesRead: 963407 FileBytesWritten: 870657 HdfsBytesRead: 6398886 HdfsBytesWritten: 4507 Input(s): Successfully read 95195 records (6398886 bytes) from: "/tmp/Batting.csv" Output(s): Successfully stored 151 records (4507 bytes) in: "hdfs://sandbox.hortonworks.com:8020/tmp/temp738556172/tmp-880727649" 2016-01-25 11:33:16,440 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1 2016-01-25 11:33:16,440 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1 2016-01-25 11:33:16,567 [main] INFO org.apache.pig.Main - Pig script completed in 21 seconds and 206 milliseconds (21206 ms) 2016-01-25 11:33:16,573 [main] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher - Shutting down thread pool 2016-01-25 11:33:16,589 [Thread-17] INFO org.apache.pig.backend.hadoop.executionengine.tez.TezSessionManager - Shutting down Tez session org.apache.tez.client.TezClient@5ee5aa77 2016-01-25 11:33:16,593 [Thread-17] INFO org.apache.tez.client.TezClient - Shutting down Tez Session, sessionName=PigLatin:script.pig, applicationId=application_1453721160224_0005