- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Hive LOAD DATA INPATH (problems with OVERWRITE clause)
- Labels:
-
Apache Hadoop
-
Apache Hive
-
Cloudera Hue
-
HDFS
Created on ‎10-09-2014 11:11 AM - edited ‎09-16-2022 02:09 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
Has sombody facing some problem like that?
I've been facing some problems with OVERWRITE clause on command:
load data local inpath 'emp.dat' overwrite into table emp;
Loading data to table default.emp
Failed with exception Unable to move sourcehdfs://localhost:8020/tmp/hive-stabbler/hive_2014-10-09_12-13-44_624_7988255974532992081-1/-ext-10000 to destination /user/hive/warehouse/default.db/emp
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
workaround 1
- Tried to change the /tmp/hive-stabbler permission on hdfs to 777. It didn't work.
- Tried via Hue interface but it didn't work. Submit button to upload the file was not enabled.
- but when I came back to the previous hue screen, a message was displayed saying the file was successfuly uploaded.
- Weird !!
- I dropped the table emp and recreated it.
- Tried the command: !hdfs dfs -copyFromLocal emp.dat /user/hive/warehouse/default.db/emp;
- It worked.
--
workaround 2
- Tried to create a table with different name as the file emp.dat. This time tablename employee, file emp.dat
- load data local inpath 'employee.dat' overwrite into table emp;
- Same error.
- I dropped the table emp;
- Recreated it.
- Tried to load data without overwrite parameter, it worked with table emp and file emp.dat
- load data local inpath 'emp.dat'into table emp;
- It worked.
--
It seems could be a problem with overwrite parameter.
I've followed this cloudera instructions link
I saw the same problem here but it has no reply.
and this one from apache hive community related to the problem where the table has the same name of the table.
Thanks
Fabricio
Created ‎11-12-2014 01:51 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
it is a clear permission issue only..
Created ‎12-10-2014 11:41 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yea I agree, it is mostly likely a permission error, I would check the hive logs to see exactly which file/dir path is giving the error.
Thanks
Szehon
