Apache NiFi writing to HDFS on Windows HDP 2.4.2

TimothySpann — Mon, 19 Aug 2019 11:18:19 GMT
When I do a PutHDFS I get
The directory in HDFS is chmod 777
2017-02-17 08:00:29,703 INFO [FileSystemRepository Workers Thread-3] o.a.n.c.repository.FileSystemRepository Successfully archived 1 Resource Claims for Container default in 8 millis
2017-02-17 08:00:36,859 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@193710c3 checkpointed with 8 Records and 0 Swap Files in 53 milliseconds (Stop-the-world time = 25 milliseconds, Clear Edit Logs time = 10 millis), max Transaction ID 612570
2017-02-17 08:00:45,483 INFO [Timer-Driven Process Thread-3] o.a.hadoop.hive.ql.io.orc.WriterImpl Padding ORC by 909609 bytes (<=  0.01 * 67108864)
2017-02-17 08:01:20,966 ERROR [Timer-Driven Process Thread-3] o.apache.nifi.processors.hadoop.PutHDFS PutHDFS[id=44443db5-015a-1000-c206-8210d8a75e26] Failed to write to HDFS due to org.apache.nifi.processor.exception.ProcessException: IOException thrown from PutHDFS[id=44443db5-015a-1000-c206-8210d8a75e26]: java.io.IOException: (null) entry in command string: null chmod 0644 E:\import\requestid\.182390590411603.orc: org.apache.nifi.processor.exception.ProcessException: IOException thrown from PutHDFS[id=44443db5-015a-1000-c206-8210d8a75e26]: java.io.IOException: (null) entry in command string: null chmod 0644 E:\import\requestid\.182390590411603.orc
2017-02-17 08:01:20,981 ERROR [Timer-Driven Process Thread-3] o.apache.nifi.processors.hadoop.PutHDFS 
org.apache.nifi.processor.exception.ProcessException: IOException thrown from PutHDFS[id=44443db5-015a-1000-c206-8210d8a75e26]: java.io.IOException: (null) entry in command string: null chmod 0644 E:\import\requestid\.182390590411603.orc
at org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2105) ~[na:na]
at org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2053) ~[na:na]
at org.apache.nifi.processors.hadoop.PutHDFS$1.run(PutHDFS.java:300) ~[nifi-hdfs-processors-1.1.1.jar:1.1.1]
at java.security.AccessController.doPrivileged(Native Method) [na:1.8.0_121]
at javax.security.auth.Subject.doAs(Unknown Source) [na:1.8.0_121]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1678) [hadoop-common-2.7.3.jar:na]
at org.apache.nifi.processors.hadoop.PutHDFS.onTrigger(PutHDFS.java:230) [nifi-hdfs-processors-1.1.1.jar:1.1.1]
at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27) [nifi-api-1.1.1.jar:1.1.1]
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1099) [nifi-framework-core-1.1.1.jar:1.1.1]
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136) [nifi-framework-core-1.1.1.jar:1.1.1]
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47) [nifi-framework-core-1.1.1.jar:1.1.1]
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132) [nifi-framework-core-1.1.1.jar:1.1.1]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) [na:1.8.0_121]
at java.util.concurrent.FutureTask.runAndReset(Unknown Source) [na:1.8.0_121]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(Unknown Source) [na:1.8.0_121]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) [na:1.8.0_121]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [na:1.8.0_121]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [na:1.8.0_121]
at java.lang.Thread.run(Unknown Source) [na:1.8.0_121]
Caused by: java.io.IOException: (null) entry in command string: null chmod 0644 E:\import\requestid\.182390590411603.orc
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:770) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.util.Shell.execCommand(Shell.java:866) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.util.Shell.execCommand(Shell.java:849) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:733) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:225) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:209) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.fs.RawLocalFileSystem.createOutputStreamWithMode(RawLocalFileSystem.java:307) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:296) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:328) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:398) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:461) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:440) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:911) ~[hadoop-common-2.7.3.jar:na]
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:892) ~[hadoop-common-2.7.3.jar:na]
at org.apache.nifi.processors.hadoop.PutHDFS$1$1.process(PutHDFS.java:310) ~[nifi-hdfs-processors-1.1.1.jar:1.1.1]
at org.apache.nifi.controller.repository.StandardProcessSession.read(StandardProcessSession.java:2082) ~[na:na]
... 18 common frames omitted
question Re: Apache NiFi writing to HDFS on Windows HDP 2.4.2 in Archives of Support Questions (Read Only)

Apache NiFi writing to HDFS on Windows HDP 2.4.2

Re: Apache NiFi writing to HDFS on Windows HDP 2.4.2
