Reply
New Contributor
Posts: 4
Registered: ‎01-27-2015

Cannot upload file greater than 64MB

Hi I am very new to Cloudera Hadoop and I have set up a 3 Datanode cluster. I am trying to upload a file that is approximately 1GB via the File Browser and unfortunately I can not get this working. The file uploads and subsequently gets truncated to 64MB. When I check the log files I see that there is a role permissions warning relating to this upload.

 

Any ideas of what is happening and what I have to do to resolve this?

Cloudera Employee
Posts: 723
Registered: ‎07-30-2013

Re: Cannot upload file greater than 64MB

What is your CDH / Hue version?

Romain

New Contributor
Posts: 4
Registered: ‎01-27-2015

Re: Cannot upload file greater than 64MB

Hue is version 3.7 and CDH the latest 4.7

 

Thanks

Dimitris

Cloudera Employee
Posts: 723
Registered: ‎07-30-2013

Re: Cannot upload file greater than 64MB

Could you check the logs of the NameNode?

It should provide more information, like:
https://groups.google.com/a/cloudera.org/forum/#!searchin/hue-user/Upload$20fails$20for$20files$20la...

Romain

New Contributor
Posts: 4
Registered: ‎01-27-2015

Re: Cannot upload file greater than 64MB

I get this main message: 

 

org.apache.hadoop.security.UserGroupInformation  No groups available for user <myusername>

Cloudera Employee
Posts: 723
Registered: ‎07-30-2013

Re: Cannot upload file greater than 64MB

So did you checks the groups of your user?

New Contributor
Posts: 4
Registered: ‎01-27-2015

Re: Cannot upload file greater than 64MB

Is that located within the admin function of the Cloudera Management service or within Hue?

Explorer
Posts: 7
Registered: ‎09-19-2016

Re: Cannot upload file greater than 64MB

Using CDH 5.14, it looks like this issue still happens with a 3 nodes cluster. When adding a 4th node, the issue doesn't happen anymore.