Reply
Explorer
Posts: 13
Registered: ‎10-21-2018

How do i stream data from a file to hdfs using spring XD

 I am trying to stream my data from a file to hdfs by using spring XD.

 

stream create --name fieltest1 --definition "file --dir=/home/hdfs/spring-xd-1.3.2.RELEASE/tmp/xd/input/filetest --outputType=text/plain | hdfs" --deploy

 

 

but I am getting below error. can some one suggest how can I achieve this?

 

org.springframework.messaging.MessageHandlingException: failed to write Message payload to HDFS; nested exception is java.io.IOException: failure to login

                at org.springframework.xd.integration.hadoop.outbound.HdfsStoreMessageHandler.handleMessageInternal(HdfsStoreMessageHandler.java:129)

Explorer
Posts: 13
Registered: ‎10-21-2018

Re: How do i stream data from a file to hdfs using spring XD

I got the solution...we need to provide fsUri after hdfs to acces hdfs location

Announcements
New solutions