You can use the API to stop and then subsequently start the cluster programatically if you'd like.

The one question I have is why you feel it is required to restart all the services in between test runs.  Is it because you want to make sure heap is cleared and just assure there are no lingering file handles/etc. from the last job?