Hi , Currently I am writing a python script which is in my local machine and I am calling a shell script which is residing in remote server. The Shell script has the Hbase Backup command to push backup to S3. Shell script works fine taking backup and pushing to s3 when executed in that remote machine. But when I call that script from my local machine through python it errors out. Below is the command which I am running in my shell script. hbase backup create full s3a://$AccessKey:$SecretKey@$BucketPath -set $BackupSet I get this below error ERROR [main] util.AbstractHBaseTool: Error running command-line tool java.io.IOException: Failed of exporting snapshot snapshot_1521106075558_default_tablename to s3a://AccessKey:SecretKey@swe-backup-test/backup_1521106069410/default/tablename/ with reason code 1 \tat sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) \tat sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) \tat sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) \tat java.lang.reflect.Constructor.newInstance(Constructor.java:526) \tat org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) \tat org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95) \tat org.apache.hadoop.hbase.util.ForeignExceptionUtil.toIOException(ForeignExceptionUtil.java:45) \tat org.apache.hadoop.hbase.client.HBaseAdmin$TableBackupFuture.convertResult(HBaseAdmin.java:2787) \tat org.apache.hadoop.hbase.client.HBaseAdmin$TableBackupFuture.convertResult(HBaseAdmin.java:2766) \tat org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.waitProcedureResult(HBaseAdmin.java:4769) \tat org.apache.hadoop.hbase.client.HBaseAdmin$ProcedureFuture.get(HBaseAdmin.java:4703) \tat org.apache.hadoop.hbase.client.HBaseAdmin.get(HBaseAdmin.java:2744) \tat org.apache.hadoop.hbase.client.HBaseAdmin.backupTables(HBaseAdmin.java:2760) \tat org.apache.hadoop.hbase.client.HBaseBackupAdmin.backupTables(HBaseBackupAdmin.java:243) \tat org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:197) \tat org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:111) \tat org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:126) \tat org.apache.hadoop.hbase.util.AbstractHBaseTool.run(AbstractHBaseTool.java:112) \tat org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) \tat org.apache.hadoop.hbase.backup.BackupDriver.main(BackupDriver.java:131) Caused by: org.apache.hadoop.ipc.RemoteException(java.io.IOException): Failed of exporting snapshot snapshot_1521106075558_default_US_tablename to s3a://Accesskey:SecretKey@swe-backup-test/backup_1521106069410/default/tablename/ with reason code 1 \tat org.apache.hadoop.hbase.backup.master.FullTableBackupProcedure.snapshotCopy(FullTableBackupProcedure.java:321) \tat org.apache.hadoop.hbase.backup.master.FullTableBackupProcedure.executeFromState(FullTableBackupProcedure.java:577) \tat org.apache.hadoop.hbase.backup.master.FullTableBackupProcedure.executeFromState(FullTableBackupProcedure.java:69) \tat org.apache.hadoop.hbase.procedure2.StateMachineProcedure.execute(StateMachineProcedure.java:107) \tat org.apache.hadoop.hbase.procedure2.Procedure.doExecute(Procedure.java:500) \tat org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execProcedure(ProcedureExecutor.java:1086) \tat org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:888) \tat org.apache.hadoop.hbase.procedure2.ProcedureExecutor.execLoop(ProcedureExecutor.java:841) \tat org.apache.hadoop.hbase.procedure2.ProcedureExecutor.access$200(ProcedureExecutor.java:77) \tat org.apache.hadoop.hbase.procedure2.ProcedureExecutor$1.run(ProcedureExecutor.java:443) After some research I found the below link which has the same error which I am receiving when I call my python from my local machine. https://issues.apache.org/jira/browse/HBASE-15853 In that link , they say /user/hbase directory should be present in hdfs and should be writable. I already have that directory present in my hdfs and also i have made it writable. But still facing the same error. can anybody please help me out to resolve this issue. It is urgent. @Jay Kumar SenSharma Thanks ... View more

Hi, Why is it that I am not able to see the tables which I create in Hbase shell in my SYSTEM.CATALOG Table. But Tables created through Phoenix are listed in SYSTEM.CATALOG Table. Can someone please explain why ? Thanks! ... View more

Hi, I came across two links 1. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_support-matrices/content/ch_matrices-ambari.html 2. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.3/bk_support-matrices/content/ch_matrices-ambari.html#ambari_stack The first link shows the stack compatibility , where HDP 2.6 is not compatible with Ambari 2.4.x, but compatible with 2.5. But the second link shows HDP 2.6 is compatible with Ambari 2.4.x, 2.5.x and 2.6.x. May I please know which one is correct ? And whether Ambari 2.4.x supports HDP 2.6 version or not ? Thanks. ... View more

Hi, I am new to Hbase and Ambari. I am exploring options for user authentication in phoenix via Rangers services.Right now I am stuck with Ranger admin UI which is not opening even though the port 6080 is open. Steps: 1. Created test ambari cluster, with one master, one zookeeper, one node. 2. Installed Ranger services through ambari UI 3. Set up mysql in master where Rangers services are installed 4. Created Ranger user and ranger database in mysql Right now , trying to open the Ranger Admin UI from quick links which opens at `http://<masters-hostname>:6080` , but the page does not open (Have stopped the firewall to test if it works, but no luck) says "Site cant be reached, <hostname> is taking too long time to respond". I have checked logs in /var/log/ranger/admin/xa_portal.log . I dont see any error in logs, only below warn i can see. WARN org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker (ChecksumFileSystem.java:165) - Problem opening checksum file: file:/etc/ranger/admin/rangeradmin.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/admin/.rangeradmin.jceks.crc (Permission denied) Could anybody please help me on this issue. Thanks ... View more