Reply
New Contributor
Posts: 5
Registered: ‎09-30-2014

Simple 'ls -l" oozie SSH Action Node takes 10 minutes to run

A simple oozie [ cloudera 5.2 ] SSH action takes 10 minutes to execute or times out, though succeeds eventaully ..... Why

We have a sood size oozie server [ where the shh action executes from ] and a giant target linux box [ where the ssh action is remotely executed ], yet the time to execute takes nearly 10 minutes....the result is succesful ....eventually .  Is this normal?

 

 

  <action name="remote-1">

    <ssh xmlns="uri:oozie:ssh-action:0.1">

    <host>${user}@${host}</host>

    <command>ls -l</command>

    <capture-output/>

  </ssh>

  <ok to="check-stage-2-return"/>

  <error to="kill"/>

  </action>

New Contributor
Posts: 5
Registered: ‎09-30-2014

Re: Simple 'ls -l" oozie SSH Action Node takes 10 minutes to run

No response yet.....not even from cloudera ?  Hmmmmm

Cloudera Employee
Posts: 35
Registered: ‎07-08-2013

Re: Simple 'ls -l" oozie SSH Action Node takes 10 minutes to run

Usually if there is a delay between actions, especially if it's 10 minutes, it means that Oozie didn't receive the callback that the job finished.  To avoid having to poll the remote server frequently, Oozie only checks once every 10 minutes (by default).  Obviously we want the Oozie server to find out sooner, so the SSH action is configured to issue an http callback to the Oozie server once it's finished to let Oozie know.  If that callback gets blocked somehow, then Oozie will take 10 minutes to notice.  Can you make sure that the target machine is able to send a GET request to the Oozie server?  curl also needs to be installed (the SSH action uses curl to make the GET request).

Software Engineer | Cloudera, Inc. | http://cloudera.com
Explorer
Posts: 24
Registered: ‎12-05-2017

Re: Simple 'ls -l" oozie SSH Action Node takes 10 minutes to run

HOW did you solved this problem? thanks

Explorer
Posts: 24
Registered: ‎12-05-2017

Re: Simple 'ls -l" oozie SSH Action Node takes 10 minutes to run

hello!

i meet the same problem as this subject,  and  "curl" is installed on machines. how can i test the httprequest?

Cloudera Employee
Posts: 35
Registered: ‎07-08-2013

Re: Simple 'ls -l" oozie SSH Action Node takes 10 minutes to run

Try running

 

curl http://oozie_host:oozie_port/oozie/v2/admin/status

 

Software Engineer | Cloudera, Inc. | http://cloudera.com
Explorer
Posts: 24
Registered: ‎12-05-2017

Re: Simple 'ls -l" oozie SSH Action Node takes 10 minutes to run

THANKS!  I solved this problem by updating the "/etc/hosts" on the target oracle12c machine.

 

 now another problem is that, run "ls" or"pwd" or "mkdir dirtest" or "java -version" with ssh action is successful. but, when i run "sqlplus","sqlplus user/pass","sqlplus user/pass@localhost/pdb1 @test.sql " is failed and there is not any useful log in "log" tab or "oozie-oozie" directory. and you know i want execute some oracle sql statement bu oozie ssh action. thank you very much.

Cloudera Employee
Posts: 260
Registered: ‎01-16-2014

Re: Simple 'ls -l" oozie SSH Action Node takes 10 minutes to run

Explorer
Posts: 24
Registered: ‎12-05-2017

Re: Simple 'ls -l" oozie SSH Action Node takes 10 minutes to run

thanks . i have solved this problem by input "source /home/oracle/.bash_profile" in the ssh-action.but i don't know how to run sql shell  in hue+oozie. how to use it?

Explorer
Posts: 24
Registered: ‎12-05-2017

Re: Simple 'ls -l" oozie SSH Action Node takes 10 minutes to run

hello . now i can execute sql query by oozie ssh-acion with sqlplus command. it isn't a good way to do this and there are some bugs... thanks

Announcements