Member since
05-24-2019
12
Posts
0
Kudos Received
0
Solutions
06-11-2019
09:47 AM
[hbase@server ~]$ hbase backup create "full" hdfs:// server /backup 2019-06-11 10:53:32,100 INFO [main] util.BackupClientUtil: Using existing backup root dir: hdfs:// server /backup Backup session finished. Status: FAILURE 2019-06-11 10:53:40,555 ERROR [main] util.AbstractHBaseTool: Error running command-line tool java.io.IOException: Failed of exporting snapshot snapshot_1560243212806_default_ATLAS_ENTITY_AUDIT_EVENTS to hdfs:// server /backup/backup_1560243212277/default/ATLAS_ENTITY_AUDIT_EVENTS/ with reason code 1 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95) at org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45) at org.apache.hadoop.hbase.client.HBaseAdmin$TableBackupFuture.convertResult(HBaseAdmin.java:2787) at org.apache.hadoop.hbase.client.HBaseAdmin$TableBackupFuture.convertResult(HBaseAdmin.java:2766) at org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4779) at org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4713) at org.apache.hadoop.hbase.client.HBaseAdmin.get(HBaseAdmin.java:2744) at org.apache.hadoop.hbase.client.HBaseAdmin.backupTables(HBaseAdmin.java:2760) at org.apache.hadoop.hbase.client.HBaseBackupAdmin.backupTables(HBaseBackupAdmin.java:243) at org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:197) at org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:111) at org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:126) at org.apache.hadoop.hbase.util.AbstractHBaseTool.run(AbstractHBaseTool.java:112) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.hadoop.hbase.backup.BackupDriver.main(BackupDriver.java:131) Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): Failed of exporting snapshot snapshot_1560243212806_default_ATLAS_ENTITY_AUDIT_EVENTS to hdfs:// server /backup/backup_1560243212277/default/ATLAS_ENTITY_AUDIT_EVENTS/ with reason code 1 at org.apache.hadoop.hbase.backup.master.FullTableBackupProcedure.snapshotCopy(FullTableBackupProcedure.java:321) at org.apache.hadoop.hbase.backup.master.FullTableBackupProcedure.executeFromState(FullTableBackupProcedure.java:577) at org.apache.hadoop.hbase.backup.master.FullTableBackupProcedure.executeFromState(FullTableBackupProcedure.java:69) at org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:107) at org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:500) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1086) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:888) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:841) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$200(ProcedureExecutor.java:77) at org.apache.hadoop.hbase.procedure2.ProcedureExecutor$1.run(ProcedureExecutor.java:443)
... View more
06-07-2019
06:02 PM
Here are my issues : [hbase@xxxx ~]$ hbase backup history ID : backup_1559901919878 Type : FULL Tables : ATLAS_ENTITY_AUDIT_EVENTS,atlas_titan,newns:ATLAS_ENTITY_AUDIT_EVENTS,newns:atlas_titan State : FAILED Start time : Fri Jun 07 12:05:20 CEST 2019 Failed message : Failed of exporting snapshot snapshot_1559901920544_default_ATLAS_ENTITY_AUDIT_EVENTS to hdfs://xxxxx/backup/testesa/backup_1559901919878/default/ATLAS_ENTITY_AUDIT_EVENTS/ with reason code 1 Progress : 0 [hbase@xxxxx ~]$ bin/hbase backup show -bash: bin/hbase: No such file or directory [hbase@xxxxx ~]$ hdfs dfs -ls /$backup-dir ls: `/-dir': No such file or directory [hbase@xxxxx ~]$ hdfs dfs -ls /backup Found 2 items -rw------- 3 hdfs hdfs 0 2019-06-06 09:14 /backup/test_full drwx------ - hbase hdfs 0 2019-06-07 12:05 /backup/testesa [hbase@xxxxx ~]$
... View more
06-07-2019
06:02 PM
Here are the issues : [hbase@xxxx ~]$ bin/hbase backup show -bash: bin/hbase: No such file or directory [hbase@XXX ~]$ hdfs dfs -ls /$backup-dir ls: `/-dir': No such file or directory [hbase@XXXX ~]$ hdfs dfs -ls /backup Found 3 items drwx------ - hbase hdfs 0 2019-06-07 09:43 /backup/backup_1559893402505 -rw------- 3 hdfs hdfs 0 2019-06-06 09:14 /backup/test_full drwx------ - hbase hdfs 0 2019-06-07 12:05 /backup/testesa [hbase@xxxx ~]$ hbase backup history ID : backup_1559901919878 Type : FULL Tables : ATLAS_ENTITY_AUDIT_EVENTS,atlas_titan,newns:ATLAS_ENTITY_AUDIT_EVENTS,newns:atlas_titan State : FAILED Start time : Fri Jun 07 12:05:20 CEST 2019 Failed message : Failed of exporting snapshot snapshot_1559901920544_default_ATLAS_ENTITY_AUDIT_EVENTS to hdfs://xxx/backup/testesa/backup_1559901919878/default/ATLAS_ENTITY_AUDIT_EVENTS/ with reason code 1 Progress : 0 ID : backup_1559893402505 Type : FULL Tables : ATLAS_ENTITY_AUDIT_EVENTS,atlas_titan,newns:ATLAS_ENTITY_AUDIT_EVENTS,newns:atlas_titan State : FAILED Start time : Fri Jun 07 09:43:22 CEST 2019 Failed message : Failed of exporting snapshot snapshot_1559893403048_default_ATLAS_ENTITY_AUDIT_EVENTS to hdfs://xxxx/backup/backup_1559893402505/default/ATLAS_ENTITY_AUDIT_EVENTS/ with reason code 1 Progress : 0 [hbase@xxxx ~]$
... View more
06-07-2019
07:04 AM
Hello Geoffrey Shelton Okot , here are the returns of the commands you asked me to do [hbase@xxxx ~]$ hbase backup history ID : backup_1559901919878 Type : FULL Tables : ATLAS_ENTITY_AUDIT_EVENTS,atlas_titan,newns:ATLAS_ENTITY_AUDIT_EVENTS,newns:atlas_titan State : FAILED Start time : Fri Jun 07 12:05:20 CEST 2019 Failed message : Failed of exporting snapshot snapshot_1559901920544_default_ATLAS_ENTITY_AUDIT_EVENTS to hdfs://xxxxx/backup/testesa/backup_1559901919878/default/ATLAS_ENTITY_AUDIT_EVENTS/ with reason code 1 Progress : 0 [hbase@xxxxx ~]$ bin/hbase backup show -bash: bin/hbase: No such file or directory [hbase@xxxxx ~]$ hdfs dfs -ls /$backup-dir ls: `/-dir': No such file or directory [hbase@xxxxx ~]$ hdfs dfs -ls /backup Found 2 items -rw------- 3 hdfs hdfs 0 2019-06-06 09:14 /backup/test_full drwx------ - hbase hdfs 0 2019-06-07 12:05 /backup/testesa [hbase@xxxxx ~]$
... View more
06-06-2019
09:59 AM
Geoffrey Shelton Okot Thanks again for your explications, now I see a backup created (but failed) I think the issue is due to a permission denied by Atlas the backup directory created is empty
... View more
06-06-2019
07:01 AM
Hi @Geoffrey Shelton Okot , thanks a lot for your answer, it's very usefull to me. Have a nice day 🙂
... View more
06-05-2019
12:17 PM
Hi, I'm new in big DATA, I'm working with HDP 2.6.5, Ambari 2.6.2, HBase 1.1.2 I would like to make a weekly full backups of all tables of HBase (all regionservers and my HBase master) and daily incremental backups of same things No one has made a backup, so that's reason I am trying to make one. HBase is kerberised. so I did a kinit as hbase user I tried those commands on my hbase master (in local on it) : hbase backup create full hdfs://[FQDN server]:[port]/ -set /etc/hbase/hbase_backup_full/test -w 3 goal : backup all tables in the file called test (I've created it so I don't understand why it tells me that's empty, and I've made a chown hbase:hbase on it as well as on the directory hbase_backup_full) issue : 634 ERROR [main] util.AbstractHBaseTool: Error running command-line tool IOException: Backup set '/etc/hbase/hbase_backup_full/test' is either empty or does not exist could anyone help me please ? Do I need to modify some config files to do this ? if yes which ? Thanks 🙂
... View more
Labels:
- Labels:
-
Apache HBase