Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Ambari/HDP Upgrade : Can we force to backup only one fsimage file if redundancy is in place?

Solved Go to solution
Highlighted

Ambari/HDP Upgrade : Can we force to backup only one fsimage file if redundancy is in place?

For redundancy, dfs.namenode.name.dir has paths to two different disks.

Thus there are FSImage files on two different disks so that on failure of one disk, the fs image is available from another disk and the Failover Controller is not triggered just because of one disk failure.

Typically, the HDP upgrade will create a backup of FS Images from the path mentioned in dfs.namenode.dir.
In this case it will create a backup of the redundant copy as well, which will be expensive in terms of storage and time.

Is there a way, where we can guide ambari upgrade process to choose one of the redundant files instead of all of them ?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Ambari/HDP Upgrade : Can we force to backup only one fsimage file if redundancy is in place?

Contributor

The way Ambari has been designed is that during the upgrade it will backup all paths listed under dfs.namenode.name.dir

Thus, currently there is no feature that let's you select a particular file to backup instead of all.

This could be a new feature!

1 REPLY 1

Re: Ambari/HDP Upgrade : Can we force to backup only one fsimage file if redundancy is in place?

Contributor

The way Ambari has been designed is that during the upgrade it will backup all paths listed under dfs.namenode.name.dir

Thus, currently there is no feature that let's you select a particular file to backup instead of all.

This could be a new feature!