Support Questions
Find answers, ask questions, and share your expertise

unable to upload files to hdfs

Solved Go to solution
Highlighted

unable to upload files to hdfs

When i try to upload files to HDFS it shows "Error:undefined". Howerver from terminal i can upload files successfully.
Is there any permission issue?
I've set in core-site.xml

 
<property>
  <name>hadoop.proxyuser.hue.hosts</name>
  <value>*</value>
</property>
<property>
  <name>hadoop.proxyuser.hue.groups</name>
  <value>*</value>
</property>
 
1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: unable to upload files to hdfs

Hey everyone!

I've fixed this issue by setting "dfs.support.broken.append" to true in hdfs-site.xml.

http://hadoop.apache.org/docs/r1.2.1/releasenotes.html
As hadoop 1.2.1 release dfs.support.append not supported in 1.x versions.

View solution in original post

6 REPLIES 6
Highlighted

Re: unable to upload files to hdfs

Do you see any error on the /logs page of Hue afterwards?
Same for the NameNode logs?

Romain



Re: unable to upload files to hdfs

Thanks for pointing out.
Namenode contain following error.

 

error: java.io.IOException: Append is not supported. Please see the dfs.support.append configuration parameter
java.io.IOException: Append is not supported. Please see the dfs.support.append configuration parameter
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.appendFile(FSNamesystem.java:1781)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.append(NameNode.java:725)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:587)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1432)
	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1428)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1426)

I've set "dfs.support.append" to true and restarted cluster and tried again to upload file but still error is there.

Highlighted

Re: unable to upload files to hdfs

Super Collaborator
Does the user you're logged with in HUE has write permission in the directory where you try to "upload the file" ?

Do you try to upload a file that already exists in the directory ?
Highlighted

Re: unable to upload files to hdfs

Rightnow permission is drwxr-xr-x and owner is hadoop user. As 3rd group is x only other users(hue) have only execute permission.
i've tried to change using hadoop fs -chmod 777 but there is no effect on it. 

Actually i have different superuser for hadoop and hue.
How to solve this issue ?

Highlighted

Re: unable to upload files to hdfs

Hey everyone!

I've fixed this issue by setting "dfs.support.broken.append" to true in hdfs-site.xml.

http://hadoop.apache.org/docs/r1.2.1/releasenotes.html
As hadoop 1.2.1 release dfs.support.append not supported in 1.x versions.

View solution in original post

Highlighted

Re: unable to upload files to hdfs

Thanks for the tip!