- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
unable to upload files to hdfs
- Labels:
-
Apache Hadoop
-
Cloudera Hue
-
HDFS
Created on ‎10-31-2015 03:12 AM - edited ‎09-16-2022 02:47 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
When i try to upload files to HDFS it shows "Error:undefined". Howerver from terminal i can upload files successfully.
Is there any permission issue?
I've set in core-site.xml
<property> <name>hadoop.proxyuser.hue.hosts</name> <value>*</value> </property> <property> <name>hadoop.proxyuser.hue.groups</name> <value>*</value> </property>
Created ‎11-08-2015 09:28 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hey everyone!
I've fixed this issue by setting "dfs.support.broken.append" to true in hdfs-site.xml.
http://hadoop.apache.org/docs/r1.2.1/releasenotes.html
As hadoop 1.2.1 release dfs.support.append not supported in 1.x versions.
Created ‎10-31-2015 08:54 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Same for the NameNode logs?
Romain
Created on ‎10-31-2015 10:41 AM - edited ‎10-31-2015 10:44 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks for pointing out.
Namenode contain following error.
error: java.io.IOException: Append is not supported. Please see the dfs.support.append configuration parameter java.io.IOException: Append is not supported. Please see the dfs.support.append configuration parameter at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.appendFile(FSNamesystem.java:1781) at org.apache.hadoop.hdfs.server.namenode.NameNode.append(NameNode.java:725) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)
I've set "dfs.support.append" to true and restarted cluster and tried again to upload file but still error is there.
Created ‎11-04-2015 06:57 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Do you try to upload a file that already exists in the directory ?
Created ‎11-06-2015 10:22 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Rightnow permission is drwxr-xr-x and owner is hadoop user. As 3rd group is x only other users(hue) have only execute permission.
i've tried to change using hadoop fs -chmod 777 but there is no effect on it.
Actually i have different superuser for hadoop and hue.
How to solve this issue ?
Created ‎11-08-2015 09:28 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hey everyone!
I've fixed this issue by setting "dfs.support.broken.append" to true in hdfs-site.xml.
http://hadoop.apache.org/docs/r1.2.1/releasenotes.html
As hadoop 1.2.1 release dfs.support.append not supported in 1.x versions.
Created ‎11-09-2015 11:37 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
