Reply
Explorer
Posts: 6
Registered: ‎03-29-2016

exportSnapshotFails with FileNotFound CDH 5.4.11

 

HBase snapshot jobs are failing, it seems to be looking for a .jar file on the cluster instead of the local filesystem. 

hdfs://dlpm-build.corp.emc.com:8020/usr/local/src/hadoop-2.6.0/share/hadoop/common/hadoop-common-2.6.0.jar does not exist, but why is it looking for it on the cluster itself?

Normal distcp jobs and other hadoop operations are working fine as far as I can tell.

--------------------------------------

2017-07-26 16:03:31.735085 [warning] Child output: 17/07/26 16:03:31 INFO security.ShellBasedIdMapping: Updated group map size: 1519
2017-07-26 16:03:32.874979 [warning] Child output: 17/07/26 16:03:32 INFO snapshot.ExportSnapshot: Copy Snapshot Manifest
2017-07-26 16:03:33.491364 [warning] Child output: 17/07/26 16:03:33 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
2017-07-26 16:03:33.492437 [warning] Child output: 17/07/26 16:03:33 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
2017-07-26 16:03:33.684881 [warning] Child output: 17/07/26 16:03:33 INFO mapreduce.JobSubmitter: Cleaning up the staging area file:/tmp/hadoop-hdfs/mapred/staging/hdfs1635554460/.staging/job_local1635554460_0001
2017-07-26 16:03:33.689140 [warning] Child output: 17/07/26 16:03:33 ERROR snapshot.ExportSnapshot: Snapshot export failed
2017-07-26 16:03:33.689269 [warning] Child output: java.io.FileNotFoundException: File does not exist: hdfs://cluster.emc.com:8020/usr/local/src/hadoop-2.6.0/share/hadoop/common/hadoop-common-2.6.0.jar
2017-07-26 16:03:33.689308 [warning] Child output:     at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1122)
2017-07-26 16:03:33.689343 [warning] Child output:     at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1114)
2017-07-26 16:03:33.689376 [warning] Child output:     at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
2017-07-26 16:03:33.689410 [warning] Child output:     at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1114)
2017-07-26 16:03:33.689447 [warning] Child output:     at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:288)
2017-07-26 16:03:33.689487 [warning] Child output:     at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:224)
2017-07-26 16:03:33.689523 [warning] Child output:     at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(ClientDistributedCacheManager.java:99)

 

Announcements