Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

exportSnapshotFails with FileNotFound CDH 5.4.11

Highlighted

exportSnapshotFails with FileNotFound CDH 5.4.11

Explorer

 

HBase snapshot jobs are failing, it seems to be looking for a .jar file on the cluster instead of the local filesystem. 

hdfs://dlpm-build.corp.emc.com:8020/usr/local/src/hadoop-2.6.0/share/hadoop/common/hadoop-common-2.6.0.jar does not exist, but why is it looking for it on the cluster itself?

Normal distcp jobs and other hadoop operations are working fine as far as I can tell.

--------------------------------------

2017-07-26 16:03:31.735085 [warning] Child output: 17/07/26 16:03:31 INFO security.ShellBasedIdMapping: Updated group map size: 1519
2017-07-26 16:03:32.874979 [warning] Child output: 17/07/26 16:03:32 INFO snapshot.ExportSnapshot: Copy Snapshot Manifest
2017-07-26 16:03:33.491364 [warning] Child output: 17/07/26 16:03:33 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
2017-07-26 16:03:33.492437 [warning] Child output: 17/07/26 16:03:33 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
2017-07-26 16:03:33.684881 [warning] Child output: 17/07/26 16:03:33 INFO mapreduce.JobSubmitter: Cleaning up the staging area file:/tmp/hadoop-hdfs/mapred/staging/hdfs1635554460/.staging/job_local1635554460_0001
2017-07-26 16:03:33.689140 [warning] Child output: 17/07/26 16:03:33 ERROR snapshot.ExportSnapshot: Snapshot export failed
2017-07-26 16:03:33.689269 [warning] Child output: java.io.FileNotFoundException: File does not exist: hdfs://cluster.emc.com:8020/usr/local/src/hadoop-2.6.0/share/hadoop/common/hadoop-common-2.6.0.jar
2017-07-26 16:03:33.689308 [warning] Child output:     at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1122)
2017-07-26 16:03:33.689343 [warning] Child output:     at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1114)
2017-07-26 16:03:33.689376 [warning] Child output:     at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
2017-07-26 16:03:33.689410 [warning] Child output:     at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1114)
2017-07-26 16:03:33.689447 [warning] Child output:     at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:288)
2017-07-26 16:03:33.689487 [warning] Child output:     at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:224)
2017-07-26 16:03:33.689523 [warning] Child output:     at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(ClientDistributedCacheManager.java:99)