Support Questions

Find answers, ask questions, and share your expertise

How do i stream data from a file to hdfs using spring XD

 I am trying to stream my data from a file to hdfs by using spring XD.


stream create --name fieltest1 --definition "file --dir=/home/hdfs/spring-xd-1.3.2.RELEASE/tmp/xd/input/filetest --outputType=text/plain | hdfs" --deploy



but I am getting below error. can some one suggest how can I achieve this?


org.springframework.messaging.MessageHandlingException: failed to write Message payload to HDFS; nested exception is failure to login

                at org.springframework.xd.integration.hadoop.outbound.HdfsStoreMessageHandler.handleMessageInternal(


I got the solution...we need to provide fsUri after hdfs to acces hdfs location