@murali2425  Here are two possible solutions. At solution 1 the value is set into an array. At solution 2 I took the flowfile-content (json) and set it into an attribute. Then you can work with expression language to get the value. For testing the syntax I recommend this site: http://jsonpath.herokuapp.com/ ... View more

@murali2425   The solution you are looking for is QueryRecord configured with a CSV Record Reader and Record Writer.   You also have UpdateRecord and ConvertRecord which can use the Readers/Writers.  This method is preferred over splitting the file and adds some nice functionality.  This method allows you to provide a schema for both the inbound csv (reader) and the downstream csv (writer).   Using QueryRecord you should be able to split the file, and set attribute of filename set to column1.  At the end of the flow you should be able to leverage that filename attribute to resave the new file.   You can find some specific examples and configuration screen shots here:   https://community.cloudera.com/t5/Community-Articles/Running-SQL-on-FlowFiles-using-QueryRecord-Processor-Apache/ta-p/246671   If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.   Thanks, Steven ... View more

Hi Matt,   Great,  with your suggestion, I got what I was expecting.   Thank You, --Murali ... View more

The issue is with the missing of square brackets at starting and @ ending .. The working query is .. [{ "$group": { "_id": { "X": "$X", "Y_DT": "$Y_DT", "Z": "$Z" }, "adj": {"$sum": "$adj" }, "bjc": {"$sum": "$bjc" }, "jbc": {"$sum": "$jbc" }, "mnk": {"$sum": "$mnk"} } }]   ... View more

it did work after adding '\t' to read_csv as 2nd arg. ... View more

Hi,    This issue is resolved, it was the issue with the kafka server, which was stopped due /tmp log issue ... View more