Reply
New Contributor
Posts: 1
Registered: ‎05-07-2018

DiskBlockManager throwing exception "Failed to create local dir" when trying to broadcast variable

Hello,

 

I am getting a java.io.IOException: Failed to create local dir in /mnt/tmp/blockmgr ...

This exception is thrown when I am trying to create a broadcast variable(This is on a 6 node cluster). 

 

This error is not happening consistently. Sometimes it runs fine and some time it fails. I checked the cluster and there is enough disk space left(more than 500GB) and I have permissions to write to /tmp folder. [The exception is not thrown every run].

 

Any sugestions on this?

 

Thanks in advance

 

New Contributor
Posts: 1
Registered: ‎08-07-2018

Re: DiskBlockManager throwing exception "Failed to create local dir" when trying to broadc

Hello arundh93, Even I am facing the same issue.
Did you get any solution yet ?

New Contributor
Posts: 1
Registered: ‎08-10-2018

Re: DiskBlockManager throwing exception "Failed to create local dir" when trying to broadc

Hi, 

 

Please check your Network Configuration. You might be seeing mutiple random jobs hitting your cluster and failing. So while confuguring your network permissions, allow only that IP from which you are doing SSH. It has resolved the same problem for me and you may do the same.

 

Thanks!!

Announcements