question Re: CDSW Jobs are shown as "Success" when python code throws an Exception in Support Questions

CDSW Jobs are shown as "Success" when python code throws an Exception

cdsw_user_23432 — Tue, 21 Apr 2026 07:15:45 GMT

We have several CDSW jobs set up where we call a python script with a main() function which is called via

if __name__ == "__main__":

main()

Our problem is that these jobs are erronously shown as "Success" even if the python code throws an Exception.

How can we set up our CDSW such that these jobs are correctly shown as "Failure"?

Re: CDSW Jobs are shown as "Success" when python code throws an Exception

DianaTorres — Wed, 26 Apr 2023 15:55:32 GMT

@cdsw_user_23432 Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our CDSW experts @Gopinath and @Mike who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Re: CDSW Jobs are shown as "Success" when python code throws an Exception

cdsw_user_23432 — Thu, 27 Apr 2023 19:10:47 GMT

Thank you @DianaTorres .

I'm looking forward to hearing back from your team

Re: CDSW Jobs are shown as "Success" when python code throws an Exception

cdsw_user_23432 — Mon, 08 May 2023 07:39:47 GMT

Hi @DianaTorres , any updates on this?

Re: CDSW Jobs are shown as "Success" when python code throws an Exception

Gopinath — Mon, 08 May 2023 08:32:22 GMT

seems to be a gap in the exception handling. Could you please share the actual script snippet for analysis.

Re: CDSW Jobs are shown as "Success" when python code throws an Exception

cdsw_user_23432 — Mon, 22 May 2023 10:14:06 GMT

Thank you for your reply, which made me take a closer look at which exceptions were handled unexpectedly and I found that the use of rich.traceback.install() in one of the scripts messed up the return status of the CDSW Job.

The issue was solved by removing rich.traceback.install() from the code, which is only cosmetic anyhow

Re: CDSW Jobs are shown as "Success" when python code throws an Exception

cjervis — Mon, 22 May 2023 13:50:47 GMT

Congratulations on resolving the issue @cdsw_user_23432. Please use the "Accept as Solution" button to mark the reply that resolved the issue for you. It helps others in a similar situation find assistance in the future.