Created on 03-28-2017 11:44 PM - edited 09-16-2022 04:21 AM
Sqoop unable to import data into hadoop thorwing error as " No Space Left on Device" on random table. We have plenty of space on both HDFS and Local FS. Not sure why, Please let me know how to fix it.
ALTR_DESC WHERE 1=1 WITH UR
2017-03-29 00:32:27 ERROR SqoopThread:165 - Error occurred while importing data HALS.CLOUD_AESC
java.lang.RuntimeException: java.io.FileNotFoundException: /apps/data/cloud.log 170329.003227.HALSDBP3.1694.TBA_ALTR_DESC.log (No space left on device)
at com.apache.sqoop.log.LogWriter.close(LogWriter.java:137)
at com.apache.sqoop.log.LogWriter.flush(LogWriter.java:155)
at com.apche.sqoop.log.LogWriter.write(LogWriter.java:41)
at com.apache.sqoop.service.SqoopThread.run(SqoopThread.java:100)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.FileNotFoundException: /apps/data/cloud.log/170329.003227.HALSDBP3.1694.TBA_ALTR_DESC.log (No space left on device)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:221)
at java.io.FileOutputStream.<init>(FileOutputStream.java:142)
at java.io.FileWriter.<init>(FileWriter.java:78)
at com.apache.sqoop.log.LogWriter.close(LogWriter.java:127)
Created 05-15-2017 03:52 AM
We found the problem. It not related to Disk Space. Problem with Directory index full of the directory
Created 04-01-2017 09:56 AM
Can you confirm that you have enough space in the error's logging directories listed? Perhaps they are on different mount points that do not have the same capacity as other directories you have setup?
Created 05-15-2017 03:52 AM
We found the problem. It not related to Disk Space. Problem with Directory index full of the directory
Created on 07-10-2018 03:11 PM - edited 07-10-2018 03:12 PM
@MughilWhat did you do,,,, How did you diagnose the problem? Where is the directory index?