Created on 03-15-2017 11:29 AM - edited 09-16-2022 04:15 AM
Hello -
I am trying to identify when a user runs a sqoop job at the command line. I was told I could use the YARN application monitor/page, but that still doesn't seem to show the sqoop jobs.
Does anyone know a way i could monitor or audit whether users are running sqoop jobs?
thanks...d
Created 03-15-2017 12:05 PM
The job might already been completed, so you have to check that under Finished link
As an alternate, When you run the job in command line it will show the URL to track the job as follows
INFO mapreduce.Job: The url to track the job: http://ipaddress:8088/proxy/application_1489467591893_1234/
Created 03-15-2017 12:58 PM
Hi...
thanks for the reply and info.
Is there any way for me to find job history...for jobs that have already finished...like from the previous week? I was wondering if the one of the log files (not sure which one) might capture that info.
I won't have the ability to know when the user's run the job...so i won't be able to get the URL from the command line.
thanks
Created 03-15-2017 04:46 PM
Pls go to the YARN application monitor/page that you have mentioned above, there will be a link called 'Finished' in the left side