Support Questions

Find answers, ask questions, and share your expertise

The sqoop import job is paused(Aggregate Resource Allocation for a job in YARN)

avatar
Explorer

I want to know the reason for Acquired lock.

 

# sqoop command in hue

import --connect jdbc:mysql://3.36.24.230:3306/demo --username hue --password hue111 --table calendar --target-dir /user/hue/eeeeee -m 1 --as-textfile

 

 

2022-10-25 09:16:16,785 [main] INFO  org.apache.hadoop.mapreduce.Job  - The url to track the job: http://bigdata:8088/proxy/application_1666660764861_0120/
2022-10-25 09:16:16,786 [main] INFO  org.apache.hadoop.mapreduce.Job  - Running job: job_1666660764861_0120

 

 

2022-10-25 07:59:21,457  INFO PauseTransitService:520 - SERVER[bigdata] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] Acquired lock for [org.apache.oozie.service.PauseTransitService]
2022-10-25 07:59:21,495  INFO PauseTransitService:520 - SERVER[bigdata] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] Released lock for [org.apache.oozie.service.PauseTransitService]

 

2 REPLIES 2

avatar
Master Collaborator

Hi,

 

As per the below Git, PauseTransitRunnable is the runnable which is scheduled to run at the configured interval, it checks all bundles. to see if they should be paused, un-paused or started.

 

https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/service/PauseTransit...

 

It also released the lock, Are you running this sqoop-import from oozie? If yes try to rerun outside of oozie and check if it still get stucks and review the corresponding NM and RM logs if anything interrupting.

 

Regards,

Chethan YM

avatar
Explorer

External shell sqoop import works fine.
But with oozie,
org.apache.hadoop.mapreduce.Job - Running job: job_1666660764861_0120
It stops at this part.
If it's ok, you should see the progress of the sqoop import next.
However, even after a day has passed, it keeps showing org.apache.hadoop.mapreduce.Job - Running job: job_1666660764861_0120.
There are no errors.