I am consuming messages from IBM MQ using Nifi. Each message is 1000 chars long. Based on the index I have to split the flowfile and then add the splits to JSON object. e.g. 2525252525M123456789JohnDoe to : {"Phone":"2525252525", "Sex":M, "Ssn":"123456789", "Name":"JohnDoe" } Is there a way to do this using any of the Nifi processors. The other approach is to use python or some other script to do that and use Execute Processors. But, if there is some other way please let me know. ... View more

I am ingesting messages from MQ to HDFS (to a staging area). I want to copy these files to local. The issues is the ingestion process runs 24x7. I only want files ingested on a particular date (or between a particular time on that day) i.e. 23rd April, 2019 etc. Is there a way to copyToLocal/get the files/messages from HDFS ingested/created on a particular date? Doing it manually is a pain. ... View more

My Flow contains getting XML files from a directory and then transform them to json. Before converting them to json, I need to validate my input xmls. I use a GetFile to get the files and then use ValidateXML to validate those files before they proceed to be transformed to json using TramsformXML processor in Nifi. I have attached the screens of the error, flow and validateXml settings. help! ... View more

I am trying to do a POC using ExecuteProcess to start a .sh file on a remote server. Right now I am just trying to move a file on remote server from one location to another. But I am getting an error (Host Key Verification Failed) on the Nifi Processor. I am able to do the same via terminal on host machine (on which Nifi is installed and running). What could be the issue here? I followed the steps mentioned here. Help! ssh -i user@hostname 'mv ~/folder1/test.txt ~/folder2/' <-- I am able to do this successfully on terminal. ExecuteProcess Properties : Command: ssh Command Arguments: -i "~/.ssh" user@hostname 'mv ~/folder1/test.txt ~/folder2/' Batch Duration : No value set Redirect Error Stream : false Working Directory : No value set Argument Delimiter : No value set ... View more

error-while-clearing-connection-queue.png nifi-queue.png I am not able to clear the connection queue in Nifi. The only change i made to the PutJMS processor was to change the URL to failover:(address)?randomize=false. The message just stopped in the queue and did not proceed to PutJMS. I stopped all the processors after sometime in the hope that I will change the config again for further testing. But since the queue is not empty and it is not allowing me to change the config in PutJMS processor. PS: I am trying to send messages to IBM MQ using PutJMS. ... View more