Hello @ISC
Thanks for using Cloudera Community. Based on the Post, You are experiencing an Error as shared while using Python with Spark. We shall need full trace of the Error along with which Operation cause the same (Even though the Operation is apparent in the trace shared). Along with the full trace, the Client used (Example: pySpark) & the CDP/CDH/HDP release used.
The above details would help us review your Issue & proceed accordingly.
Regards, Smarak