Support Questions
Find answers, ask questions, and share your expertise

Fetal error while delete the hdfs data which is having hive partitions in blob storage

Fetal error while delete the hdfs data which is having hive partitions in blob storage

Rising Star

Hi Team,

while i deleting the hdfs data in blob which is having hive paritioned data , i am getting below error but data was deleted successfully..can you please us to understand why i am receiving this error ?

hadoop fs -rm -r wasbs://dev001data@datadev.blob.core.windows.net/prodcp/fact_tm_all/ 18/07/09 13:43:34 WARN azure.AzureFileSystemThreadPoolExecutor: Disabling threads for Rename operation as thread count 0 is <= 1 18/07/09 13:47:04 INFO azure.AzureFileSystemThreadPoolExecutor: Time taken for Rename operation is: 210770 ms with threads: 0 -rm: Fatal internal error java.lang.NullPointerException at org.apache.hadoop.fs.azure.NativeAzureFileSystem$FolderRenamePending.execute(NativeAzureFileSystem.java:448) at org.apache.hadoop.fs.azure.NativeAzureFileSystem.rename(NativeAzureFileSystem.java:2707) at org.apache.hadoop.fs.FileSystem.rename(FileSystem.java:1340) at org.apache.hadoop.fs.TrashPolicyDefault.moveToTrash(TrashPolicyDefault.java:166) at org.apache.hadoop.fs.Trash.moveToTrash(Trash.java:109) at org.apache.hadoop.fs.Trash.moveToAppropriateTrash(Trash.java:95) at org.apache.hadoop.fs.shell.Delete$Rm.moveToTrash(Delete.java:153) at org.apache.hadoop.fs.shell.Delete$Rm.processPath(Delete.java:118) at org.apache.hadoop.fs.shell.Command.processPaths(Command.java:317) at org.apache.hadoop.fs.shell.Command.processPathArgument(Command.java:289) at org.apache.hadoop.fs.shell.Command.processArgument(Command.java:271) at org.apache.hadoop.fs.shell.Command.processArguments(Command.java:255) at org.apache.hadoop.fs.shell.FsCommand.processRawArguments(FsCommand.java:119) at org.apache.hadoop.fs.shell.Command.run(Command.java:165) at org.apache.hadoop.fs.FsShell.run(FsShell.java:297) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90) at org.apache.hadoop.fs.FsShell.main(FsShell.java:356)