Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Pig editor progress bar show 100% but doesn't turn green

avatar
Contributor

The pig job completes successfully but progress bar doesn't turn green once reached 100%.

 

 

progress bar.PNG

1 ACCEPTED SOLUTION

avatar
Contributor
It was fixed on Hue 4.0

But if you want to apply the patch edit apps/pig/src/pig/api.py

Replace this line:
LOG_END_PATTERN = '(<<< Invocation of Pig command completed <<<|<<< Invocation of Main class completed <<<)'

With this line:
LOG_END_PATTERN = '(&lt;&lt;&lt; Invocation of Pig command completed &lt;&lt;&lt;|&lt;&lt;&lt; Invocation of Main class completed &lt;&lt;&lt;)'


Ref: https://github.com/cloudera/hue/commit/76273c0165da5dbca5cf7741fea6e0037a928a36

View solution in original post

4 REPLIES 4

avatar
Super Guru
Is the job actually successful?

What do you see when you click on the status link to see it in the Oozie
dashboard? (there is usually more log there)

avatar
Contributor

Hi Romainr,

 

Yes it is job finished successfully.

 

 

Once I clicked ok,I see that the pig and oozie completed successfully. The below is the stderr/stdout for the job.

 

Thanks!

 

 

stderr:

 

 Log Upload Time: Thu Jan 26 05:24:36 -0500 2017

Log Length: 771
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/grid/3/hadoop/yarn/local/filecache/12/mapreduce.tar.gz/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/data/hadoop/yarn/local/filecache/113/slf4j-log4j12-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

 

stdout:

 

2017-01-26 05:24:28,896 [main] INFO org.apache.hadoop.mapred.ClientServiceDelegate - Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2017-01-26 05:24:28,915 [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Encountered Warning ACCESSING_NON_EXISTENT_FIELD 1 time(s).
2017-01-26 05:24:28,915 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Success!
2017-01-26 05:24:28,930 [main] INFO org.apache.pig.Main - Pig script completed in 28 seconds and 656 milliseconds (28656 ms)
Hadoop Job IDs executed by Pig: job_1484883986418_0768

<<< Invocation of Pig command completed <<<


<<< Invocation of Main class completed <<<

Oozie Launcher, uploading action data to HDFS sequence file: hdfs://CLUSTERNAME/user/USERNAME/oozie-oozi/0000247-170119225311187-oozie-oozi-W/pig-5760--pig/action-data.seq
2017-01-26 05:24:28,960 [main] INFO org.apache.hadoop.io.compress.zlib.ZlibFactory - Successfully loaded & initialized native-zlib library
2017-01-26 05:24:28,960 [main] INFO org.apache.hadoop.io.compress.CodecPool - Got brand-new compressor [.deflate]

Oozie Launcher ends

2017-01-26 05:24:29,003 [main] INFO org.apache.hadoop.mapred.Task - Task:attempt_1484883986418_0767_m_000000_0 is done. And is in the process of committing
2017-01-26 05:24:29,064 [main] INFO org.apache.hadoop.mapred.Task - Task attempt_1484883986418_0767_m_000000_0 is allowed to commit now
2017-01-26 05:24:29,075 [main] INFO org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter - Saved output of task 'attempt_1484883986418_0767_m_000000_0' to hdfs://clustername/user/username/oozie-oozi/0000247-170119225311187-oozie-oozi-W/pig-5760--pig/output/_temporary/1/task_1484883986418_0767_m_000000
2017-01-26 05:24:29,133 [main] INFO org.apache.hadoop.mapred.Task - Task 'attempt_1484883986418_0767_m_000000_0' done.

 

avatar
Contributor
It was fixed on Hue 4.0

But if you want to apply the patch edit apps/pig/src/pig/api.py

Replace this line:
LOG_END_PATTERN = '(<<< Invocation of Pig command completed <<<|<<< Invocation of Main class completed <<<)'

With this line:
LOG_END_PATTERN = '(&lt;&lt;&lt; Invocation of Pig command completed &lt;&lt;&lt;|&lt;&lt;&lt; Invocation of Main class completed &lt;&lt;&lt;)'


Ref: https://github.com/cloudera/hue/commit/76273c0165da5dbca5cf7741fea6e0037a928a36

avatar
Contributor

Hi Jtasipit,

 

It works!!

 

Thank you!