Support Questions

Find answers, ask questions, and share your expertise

unable to upload files to hdfs

avatar

When i try to upload files to HDFS it shows "Error:undefined". Howerver from terminal i can upload files successfully.
Is there any permission issue?
I've set in core-site.xml

 
<property>
  <name>hadoop.proxyuser.hue.hosts</name>
  <value>*</value>
</property>
<property>
  <name>hadoop.proxyuser.hue.groups</name>
  <value>*</value>
</property>
 
1 ACCEPTED SOLUTION

avatar

Hey everyone!

I've fixed this issue by setting "dfs.support.broken.append" to true in hdfs-site.xml.

http://hadoop.apache.org/docs/r1.2.1/releasenotes.html
As hadoop 1.2.1 release dfs.support.append not supported in 1.x versions.

View solution in original post

6 REPLIES 6

avatar
Super Guru
Do you see any error on the /logs page of Hue afterwards?
Same for the NameNode logs?

Romain



avatar

Thanks for pointing out.
Namenode contain following error.

 

error: java.io.IOException: Append is not supported. Please see the dfs.support.append configuration parameter
java.io.IOException: Append is not supported. Please see the dfs.support.append configuration parameter
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.appendFile(FSNamesystem.java:1781)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.append(NameNode.java:725)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)

I've set "dfs.support.append" to true and restarted cluster and tried again to upload file but still error is there.

avatar
Super Collaborator
Does the user you're logged with in HUE has write permission in the directory where you try to "upload the file" ?

Do you try to upload a file that already exists in the directory ?

avatar

Rightnow permission is drwxr-xr-x and owner is hadoop user. As 3rd group is x only other users(hue) have only execute permission.
i've tried to change using hadoop fs -chmod 777 but there is no effect on it. 

Actually i have different superuser for hadoop and hue.
How to solve this issue ?

avatar

Hey everyone!

I've fixed this issue by setting "dfs.support.broken.append" to true in hdfs-site.xml.

http://hadoop.apache.org/docs/r1.2.1/releasenotes.html
As hadoop 1.2.1 release dfs.support.append not supported in 1.x versions.

avatar
Super Guru
Thanks for the tip!