Member since
05-06-2019
4
Posts
0
Kudos Received
0
Solutions
05-06-2019
08:14 AM
Worked for me too. Thank you.
... View more
10-12-2018
02:26 PM
@Matt Burgess Thanks for your response Matt. I have used PutMongoRecord before for bulk ingestion use cases where requirement was only to insert records. Worked fine for me. On this use case I need to do upserts. Not sure if I can upsert using PutMongoRecord. If yes, could you please suggest the processor configuration of PutMongoRecord for doing upsert using two keys. Thanks, Rajesh
... View more
10-11-2018
08:23 PM
@Karthik Narayanan Thanks for your response. I will definitely try this. Few points I would like to understand. 1. Are there any alternative to splitting this JSON file (using splitline or splittext )? Sounds like a definite performance hit when ingesting large number of records (> 100,000). 2. Is this a limitation of PutMongo Processor that it is not able to read this JSON file? How does PutMongo expect the JSON to be so that it can ingest multiple records from one single JSON file. Thanks, Rajesh
... View more
10-04-2018
12:16 AM
Hi, Using NiFi 1.7.1 I am using one JSON file with a batch of 20 json records separated by newline to be Upserted into MongoDB. My flow is like: GetFile-->PutMongo-->PutFile GetFile pulls the JSON , PutMongo upserts into MongoDB based on two keys, PutFile archives the JSON file Looks simple but the issue I am having is that the PutMongo processor only creates the first record from this JSON file into MongoDB. My JSON file is a multiline file, contains 20 records separated by newline. Sample from this input JSON file is as below, {"key1":abcd,"key2":1234,"data1":12500.0000000000,"data2":true}
{"key1":efgh,"key2":6541,"data1":19999.0000000000,"data2":true} PutMongo properties as below, SSL Context Service: No value set Client Auth: NONE Mode: update Upsert: true Update Query Key: key1,key2 Update Query: No value set Update Mode: With whole document Write Concern: ACKNOWLEDGED Character Set: UTF-8 Please suggest. Thanks, Rajesh
... View more
Labels:
- Labels:
-
Apache NiFi