- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Sqoop Import Faile "No Space Left on Device"
- Labels:
-
Apache Hive
-
Apache Sqoop
-
HDFS
Created on ‎03-28-2017 11:44 PM - edited ‎09-16-2022 04:21 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Sqoop unable to import data into hadoop thorwing error as " No Space Left on Device" on random table. We have plenty of space on both HDFS and Local FS. Not sure why, Please let me know how to fix it.
ALTR_DESC WHERE 1=1 WITH UR
2017-03-29 00:32:27 ERROR SqoopThread:165 - Error occurred while importing data HALS.CLOUD_AESC
java.lang.RuntimeException: java.io.FileNotFoundException: /apps/data/cloud.log 170329.003227.HALSDBP3.1694.TBA_ALTR_DESC.log (No space left on device)
at com.apache.sqoop.log.LogWriter.close(LogWriter.java:137)
at com.apache.sqoop.log.LogWriter.flush(LogWriter.java:155)
at com.apche.sqoop.log.LogWriter.write(LogWriter.java:41)
at com.apache.sqoop.service.SqoopThread.run(SqoopThread.java:100)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.FileNotFoundException: /apps/data/cloud.log/170329.003227.HALSDBP3.1694.TBA_ALTR_DESC.log (No space left on device)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:221)
at java.io.FileOutputStream.<init>(FileOutputStream.java:142)
at java.io.FileWriter.<init>(FileWriter.java:78)
at com.apache.sqoop.log.LogWriter.close(LogWriter.java:127)
Created ‎05-15-2017 03:52 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We found the problem. It not related to Disk Space. Problem with Directory index full of the directory
Created ‎04-01-2017 09:56 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Can you confirm that you have enough space in the error's logging directories listed? Perhaps they are on different mount points that do not have the same capacity as other directories you have setup?
Created ‎05-15-2017 03:52 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We found the problem. It not related to Disk Space. Problem with Directory index full of the directory
Created on ‎07-10-2018 03:11 PM - edited ‎07-10-2018 03:12 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@MughilWhat did you do,,,, How did you diagnose the problem? Where is the directory index?
