How can I parse through a txt file that's ":" deli...

carlo_bustos · ‎07-12-2019

I have a txt file (attached) and I would like split the lines and to parse out the data and set the values to flowfile attributes (PPGRAW : 1.76, PPGCORR : 5.15, etc.). Ideally I would like to just get the very last row of values (ignoring the last couple rows of "878 LOG,STOP" and ignoring that first numeric value separated by the space) and set those values to flowfile attributes accordingly. I was able to split the original text file by line to include headers (first image). I can split them to not include the headers (since I already know which values are for which properties - second image). My flow consists of GetFile -> SplitText for now. m6_sample.txt

carlo_bustos · ‎06-17-2019

DetectDuplicate error "unable to communicate with cache when processing due to connection refused." Retrieving data from mongo collection, setting flowfile attribute "oid" to the mongo generated id given to each entry from the collection, then detecting any duplicate data based on that oid for when GetMongo runs again.

carlo_bustos · ‎03-13-2019

@Matt Burgess I just wanted to clarify your 2 recipes for getting incoming flowfiles. The first mentions getting 1 incoming flow file and the second mentions getting multiple. If there are multiple flow files in queue, but you want the script to modify all flow files but only one at a time, which recipe is the one to follow? I'm assuming the first recipe is appropriate for this but wanted to clarify. Thanks

carlo_bustos · ‎03-13-2019

multiple_json_not_array.txt

carlo_bustos · ‎07-25-2018

Hi Matt, I am trying to use the RunMongoAggregation processor and ran into 2 issues. 1. I ran an aggregation in my mongo very similar to this: [ { $project: { lastUpdated: { $dateFromString: { dateString: '$lastUpdated' } } } } ] It changes the "lastUpdated" value from a string type to a DateTime type. The result looks like this: lastUpdated 2018-07-23T10:15:05Z DateTime I tried this in the RunMongoAggregation and with double quotes around each field as this link suggests https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-mongodb-nar/1.6.0/org.apache.nifi.processors.mongodb.RunMongoAggregation/additionalDetails.html But the result I got looks like this: lastUpdated NumberLong("1532340905000") Int64 2. When data gets aggregated in this processor, the mongo id is lost and becomes some sort of timestamp _id timestamp machingIdentifier processIdentifier counter time date timeSecond I wanted to keep the mongo id but it gets transformed to this. Any suggestions would help. Thank you

Online	Offline
Last Visited	‎07-15-2019 11:44 AM

Date Registered	‎07-25-2018 02:36 PM
Last Visited	‎07-15-2019 11:44 AM
Total Messages Posted	5

How can I parse through a txt file that's ":" deli...

DetectDuplicate error "unable to communicate with...

Re: ExecuteScript Cookbook (part 1)

I have a JSON file that contains a number of JSON ...

Re: how to use mongodb aggregate querys in get mon...