Member since
06-13-2018
25
Posts
0
Kudos Received
0
Solutions
07-13-2018
07:24 AM
Hi,
I am getting multiple CSV files as input and in that there is a date column(Joining_Date) in all the files.
Requirement is to validate the date as check if the date is in proper format.
Pass the files if the records are valid and fail the whole pipeline if any of the record is abd in any of the file.
... View more
Labels:
- Labels:
-
Apache NiFi
07-13-2018
07:21 AM
Hi, I am getting multiple CSV files as input and in that there is a date column(Joining_Date) in all the files. Requirement is to validate the date as check if the date is in proper format. Pass the files if the records are valid and fail the whole pipeline if any of the record is abd in any of the file.
... View more
Labels:
- Labels:
-
Apache NiFi
07-04-2018
11:14 AM
Hi @sunile.manjee, Not only record, any failure either becouse of the properties defined or any kind of failure. like whenever there is a failure the whole flow should terminate.
... View more
07-04-2018
11:11 AM
Hi @Matt Clarke, By session i meant the whole process. How can i stop the flow whenever there is a failure..? @Matt Burges:- standard Nifi components.
... View more
07-02-2018
06:08 AM
Can anyone please tell me how to fail the session in Nifi whenever there is a failue or how to fail the session whenever there is any bad record...?
... View more
Labels:
- Labels:
-
Apache NiFi
06-26-2018
11:51 AM
Hi @Matt Burgess, how can we do thos for a csv file..? for example i am having a csv file(studentid_name_city.csv). I want to break the filename and put it into different columns of Studend table(Studentid,name,city).
... View more
06-26-2018
07:27 AM
Hi @Vinicius Higa Murakami, m trying two merge json files with the help of merge record and using controller service JsonTreeReader and CSVWriter. but it is putting all the records in separate files instead of putting in one. and if i use merge content which is giving me one output file as required but it is puting header for each record.
... View more
06-25-2018
06:45 PM
Hi @mqureshi, Can you please tell me how to conver JSON to csv in nifi..?
... View more
06-25-2018
10:06 AM
I am trying to fetch data from Mongodb usng getmongo processor in Nifi.But i am getting the records multiple times as data is getting duplicated. How i can get unique data..?
... View more
Labels:
- Labels:
-
Apache NiFi
06-21-2018
11:06 AM
Hi, can anyone please tell me how to apply group by on json or csv records in nifi..?
... View more
Labels:
- Labels:
-
Apache NiFi
06-21-2018
03:56 AM
Hi @Matt Burgess, i am having some multiple csv files with different schema,just one column is common(lets say id) and they may or may not have matching values. I want to merge them all before sending it to dynamo db and and dont know how can i put them in dynamodb. for example InputFile 1 deptid firstname lastname 1 Aman Sharma 2 Raman Verma InputFile 2 deptid salary email 1 20000 abc@gmail.com 2 30000 bgf@gmail.com OutputFile(By merging file1 and file2):- deptid firstname lastname salary email 1 Aman Sharma 20000 abc@gmail.com 2 Raman Verma 30000 bgf@gmail.com
... View more
06-20-2018
05:18 AM
Hi @Hellmar Becker,thanks for the info. But can you please give an example what should be the jsonpath like..?
... View more
06-20-2018
04:48 AM
Hi @Vinicius Higa Murakami, thanks for your quick response. Can you please share the screenshot of properties tab of evaluatejsonpath and mergerecord processor. as i am new to Nifi
... View more
06-19-2018
11:31 AM
Hi @Matt Burgess, Can you please explain how can we do this using mergerecord as I am not able to to do it..
... View more
06-19-2018
10:27 AM
How to merge multiple jaoni files using nifi
... View more
Labels:
- Labels:
-
Apache NiFi
06-19-2018
04:54 AM
How can i load data from CSV file to dynmaodb using putdynamodb in nifi..?
... View more
Labels:
- Labels:
-
Apache NiFi
06-18-2018
09:51 AM
How to export processor group from nifi to local Pc as in how to save it locally or how can i have its back.?
... View more
Labels:
- Labels:
-
Apache NiFi
06-14-2018
06:11 AM
Hi Michel, I am having different metadata in all the files except one common column. So which property i should use for Metadata Strategy in merge content processor.
... View more
06-14-2018
06:03 AM
Thank you @Shu. Actually i am tryng to merge(Union) records based on Id. eg in input file1 the Id can be:1,2,3 and in iinputfile2 deptid can be:-3,4,5. So it will merge all the records. Shall i use the queryrecord processor befire or after the mergecontent..?
... View more
06-13-2018
02:18 PM
Hi @msumbul Thanks for your answer. I tried to do that but it was creating files again and again and data was getting duplicated. i tried to did it like getting files from get file(2 processors and then mergecontent-->Putfile)..
... View more
06-13-2018
02:14 PM
@Shu InputFile 1 deptid firstname lastname 1 Aman Sharma 2 Raman Verma InputFile 2 deptid salary email 1 20000 abc@gmail.com 2 30000 bgf@gmail.com OutputFile(By merging file1 and file2):- deptid firstname lastname salary email 1 Aman Sharma 20000 abc@gmail.com 2 Raman Verma 30000 bgf@gmail.com like the output will be grouping by deptid. How can i get this ouput?
... View more
06-13-2018
11:42 AM
I am having two csv files and want to merge them into single csv file using Id column.
... View more
- Tags:
- data
Labels:
- Labels:
-
Apache NiFi