Pig editor progress bar show 100% but doesn't turn green

kirubel87 — Fri, 16 Sep 2022 10:56:25 GMT

The pig job completes successfully but progress bar doesn't turn green once reached 100%.

Re: Pig editor progress bar show 100% but doesn't turn green

Romainr — Thu, 26 Jan 2017 02:37:14 GMT

Is the job actually successful?

What do you see when you click on the status link to see it in the Oozie
dashboard? (there is usually more log there)

Re: Pig editor progress bar show 100% but doesn't turn green

kirubel87 — Thu, 26 Jan 2017 13:06:48 GMT

Hi Romainr,

Yes it is job finished successfully.

Once I clicked ok,I see that the pig and oozie completed successfully. The below is the stderr/stdout for the job.

Thanks!

stderr:

Log Upload Time: Thu Jan 26 05:24:36 -0500 2017

Log Length: 771
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/grid/3/hadoop/yarn/local/filecache/12/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/data/hadoop/yarn/local/filecache/113/slf4j-log4j12-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

stdout:

2017-01-26 05:24:28,896 [main] INFO org.apache.hadoop.mapred.ClientServiceDelegate - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2017-01-26 05:24:28,915 [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Encountered Warning ACCESSING_NON_EXISTENT_FIELD 1 time(s).
2017-01-26 05:24:28,915 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Success!
2017-01-26 05:24:28,930 [main] INFO org.apache.pig.Main - Pig script completed in 28 seconds and 656 milliseconds (28656 ms)
Hadoop Job IDs executed by Pig: job_1484883986418_0768

<<< Invocation of Pig command completed <<<

<<< Invocation of Main class completed <<<

Oozie Launcher, uploading action data to HDFS sequence file: hdfs://CLUSTERNAME/user/USERNAME/oozie-oozi/0000247-170119225311187-oozie-oozi-W/pig-5760--pig/action-data.seq
2017-01-26 05:24:28,960 [main] INFO org.apache.hadoop.io.compress.zlib.ZlibFactory - Successfully loaded & initialized native-zlib library
2017-01-26 05:24:28,960 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new compressor [.deflate]

Oozie Launcher ends

2017-01-26 05:24:29,003 [main] INFO org.apache.hadoop.mapred.Task - Task:attempt_1484883986418_0767_m_000000_0 is done. And is in the process of committing
2017-01-26 05:24:29,064 [main] INFO org.apache.hadoop.mapred.Task - Task attempt_1484883986418_0767_m_000000_0 is allowed to commit now
2017-01-26 05:24:29,075 [main] INFO org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter - Saved output of task 'attempt_1484883986418_0767_m_000000_0' to hdfs://clustername/user/username/oozie-oozi/0000247-170119225311187-oozie-oozi-W/pig-5760--pig/output/_temporary/1/task_1484883986418_0767_m_000000
2017-01-26 05:24:29,133 [main] INFO org.apache.hadoop.mapred.Task - Task 'attempt_1484883986418_0767_m_000000_0' done.

Re: Pig editor progress bar show 100% but doesn't turn green

jtasipit — Fri, 16 Jun 2017 03:35:41 GMT

It was fixed on Hue 4.0

But if you want to apply the patch edit apps/pig/src/pig/api.py

Replace this line:
LOG_END_PATTERN = '(<<< Invocation of Pig command completed <<<|<<< Invocation of Main class completed <<<)'

With this line:
LOG_END_PATTERN = '(<<< Invocation of Pig command completed <<<|<<< Invocation of Main class completed <<<)'

Ref: https://github.com/cloudera/hue/commit/76273c0165da5dbca5cf7741fea6e0037a928a36

Re: Pig editor progress bar show 100% but doesn't turn green

kirubel87 — Fri, 16 Jun 2017 05:45:15 GMT

Hi Jtasipit,

It works!!

Thank you!

question Re: Pig editor progress bar show 100% but doesn't turn green in Support Questions

Pig editor progress bar show 100% but doesn't turn green

Re: Pig editor progress bar show 100% but doesn't turn green

Re: Pig editor progress bar show 100% but doesn't turn green

Re: Pig editor progress bar show 100% but doesn't turn green

Re: Pig editor progress bar show 100% but doesn't turn green