Regarding the 1st error about your personal module, adding the zip of the module to the addPyFile should fix the problem. Refer to this link for details.   Once you do that, the pandas error likely means that you are not using the same env on the worker nodes as on the driver node. Double check to make sure that all the required libraries are installed on the worker nodes.   Hope that helps. ... View more