Hello @vowxx007,  The driver port is ephimeral and only exist during the app executions, so for your intention it will not work.  There are some options, for example the Spark History Server REST API. For example, http://<server-url>:18080/api/v1/applications returns a JSON with data for both active and completed apps.  Then you can play with the options this API offers.  Note: check and confirm the SHS Port on the Spark service configuration. Another tool that may work is the YARN Resource Manager REST API there you can use options such as "Cluster Applications API".  This one will be something like this: http://rm-http-address:port/ws/v1/cluster/apps  That option will give information about the user, start and finish time, status, and more.  Hopefully this help you on your monitoring tasks.  ... View more