These should be helpful http://stackoverflow.com/questions/32080475/how-to-read-a-zip-containing-multiple-files-in-apache-spark http://stackoverflow.com/questions/28569788/how-to-open-stream-zip-files-through-spark ... View more

You will need to specify the column you are clustering on, and then achieve it in multiple statements: CREATE TABLE emp1 LIKE emp; ALTER TABLE emp1 SET FILEFORMAT ORC; ALTER TABLE emp1 CLUSTERED BY (empId) INTO 4 BUCKETS; ... View more

If accessing the NameNode web UI indicates that you are "dr.who", then this likely indicates that the cluster is not performing authentication on HTTP endpoints. The logs URL requires administrator access, so it is inaccessible unless authenticated as an administrator. Enabling HTTP authentication is a separate step from enabling Kerberos security, so it's possible that the cluster has done one but not the other. For full details on how to enable HTTP authentication, please refer to the Apache Hadoop documentation for HTTP Authentication. ... View more