Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Re: HFile PriviledgedActionException - cause missing JAR?

Re: HFile PriviledgedActionException - cause missing JAR?

New Contributor

I am not sure why/if i had to do this (didn't see anything like this in any of the startup docs anywhere)

but I ran one of these:


hdfs dfs -put /hadoop/hbase-*.jar /hadoop/hbase- MR job seems to run now




HFile PriviledgedActionException - cause missing JAR?

New Contributor



I have a single node setup in pseudodistributed mode and am attempting to create HFiles for bulk loading

I have successfully been able to run simple MR inserts and lookups, however when submitting the MR job to create HFiles I am getting an PriviledgedActionException that indicates dependent JARs cannot be found in HDFS


I am not clear what the reference to HDFS here is for (i.e. why is the submit looking for the JARS in HDFS?)

I suspect I have a configuration error?


Any advice here is sincerely appreaciated - let me know if there is any other detail i can provide.



Here's my exception:


2014-01-13 13:39:40,582 INFO  [main] mapreduce.HFileOutputFormat: Incremental table pcoa output configured.
2014-01-13 13:39:40,608 INFO  [main] Configuration.deprecation: is deprecated. Instead, use dfs.metrics.session-id
2014-01-13 13:39:40,609 INFO  [main] jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
2014-01-13 13:39:40,862 WARN  [main] mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2014-01-13 13:39:40,877 WARN  [main] mapreduce.JobSubmitter: No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2014-01-13 13:39:40,880 INFO  [main] mapreduce.JobSubmitter: Cleaning up the staging area file:/tmp/hadoop-mbeening/mapred/staging/mbeening2031672872/.staging/job_local2031672872_0001
2014-01-13 13:39:40,880 ERROR [main] security.UserGroupInformation: PriviledgedActionException as:mbeening (auth:SIMPLE) File does not exist: hdfs://localhost/local/mbeening/hbase/hbase-
Exception in thread "main" File does not exist: hdfs://localhost/local/mbeening/hbase/hbase-
        at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(
        at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(
        at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(
        at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(
        at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(
        at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(
        at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(
        at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestampsAndCacheVisibilities(
        at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(
        at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(
        at org.apache.hadoop.mapreduce.Job$
        at org.apache.hadoop.mapreduce.Job$
        at Method)
        at org.apache.hadoop.mapreduce.Job.submit(
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(
        at com.hadoop.BulkImportDriver.main(

I have confirmed that the JAR is question does exist on my system


-rw-r--r-- 1 mbeening ACL_UNIX_flprod 533455 Aug 21 12:47 /local/mbeening/hbase/hbase-

Here is my driver routine:


public static void main(String[] args) throws Exception {

    Configuration conf = new Configuration();
    Job job = new Job(conf, "HBase Bulk Import");



    HTable hTable = new HTable(conf, args[2]);
    HFileOutputFormat.configureIncrementalLoad(job, hTable);

    FileInputFormat.addInputPath(job, new Path(args[0]));
    FileOutputFormat.setOutputPath(job, new Path(args[1]));




Re: HFile PriviledgedActionException - cause missing JAR?

Master Collaborator



  I have moved this thread to our Mapreduce board in hopes that one of the experts in here might have some insight into why that happened.  It does sound odd to me that you had to do that.