Member since
09-08-2019
13
Posts
0
Kudos Received
0
Solutions
09-20-2019
01:37 PM
If I make it blank and save, then it is defaulting to; maybe it is expecting a default value?
... View more
09-20-2019
01:33 PM
I think maybe I didn't explain it well. SKIP value is not in the rows, SKIP is in the column header. when we say col1 <> 'SKIP' i believe it will skip all rows with value 'SKIP' but my intention is to remove columns whose header is called 'SKIP' Here is an example of file header : FirstName|Skip|Skip|City|State|ZipCode|Skip|LastVisitDate|Skip|ExtId The file is not predefined, no of columns in a file will vary, header positions will vary, place where 'SKIP' can exist in the header will vary from file to file.
... View more
09-19-2019
04:17 PM
@Shu_ashu Skip is column header name, so how does the query look like to exclude columns whose header name is "SKIP"?
... View more
09-19-2019
04:15 PM
@Wynner It is giving an error as shown below, i have also uploaded screenshots of configuration for reference.
... View more
09-18-2019
03:47 PM
Hi, I have a CSV file where the last column has pipe-delimited text which needs to be split up on pipe and I have to pivot it into rows. The last column can have any number of values with pipe-delimited and it varies by each row. How can we accomplish this in NIFI? Ex: A, B, C|D X, Y, X|Y|Z|B The above file has to be converted to A, B, C A, B, D X, Y, X X, Y, Y X, Y, Z X, Y, B
... View more
Labels:
- Labels:
-
Apache NiFi
09-18-2019
01:46 PM
@Shu_ashu : Thank you so much for the link, it covers part of my need. The other thing is to assign the lookup value to attribute so I think the solution is ExecuteSQL -> ConvertAvroToJson -> EvaluateJsonPath can we do it in one step instead of 3 like above? All I am pulling is one field from the database table. Query: select id from table A
... View more
09-17-2019
03:39 PM
Hi, I am in need of SQL Server lookup, found this library https://github.com/mrcsparker/nifi-sqllookup-services-bundle but there are no good examples especially when dealing with incoming CSV text file. Appreciate if anybody can point me to an article or sample workflow that does something similar. Thanks in advance
... View more
Labels:
- Labels:
-
Apache NiFi
09-17-2019
03:36 PM
Hi, I think it is slightly different, it is remove header when a file is split in to smaller files where as for me it is one file with multiple columns with same header name and i need to ignore certain columns based on a column name.
... View more
09-13-2019
12:55 PM
Hi, I have a csv file with dynamic columns and headers and there are multiple columns with same header name "SKIP" that needs to be removed from the file before ingesting them into the database using PutDatabaseRecord. How can I delete the multiple columns with header name "SKIP'?
... View more
Labels:
- Labels:
-
Apache NiFi
09-10-2019
12:27 PM
I need to zip 3 files from S3, so will the flow be like 3 FetchS3Object processors ( for 3 files ) → Merge Content → PutS3Object ?
... View more
09-10-2019
11:39 AM
Zip command is not working in Execute Stream Command but working in Execute Command. Please let me know what is wrong with the below. Command Arguments -r -j /opt/nifi/nifi-1.9.2/data/print/CIF_206.zip /opt/nifi/nifi-1.9.2/data/print/CIF_206/ Command Path zip Ingore STDIN true
... View more
Labels:
- Labels:
-
Apache NiFi
09-08-2019
08:37 PM
Hi, How can I zip s3 files together and drop them into another S3 folder? the s3 files have different formats and layouts, so merge content is not an option and also those S3 files are generated by upstream flow files so they are dynamically generated so need some kind of correlation id based zipping of s3 files together. Thanks for community help.
... View more
Labels:
- Labels:
-
Apache NiFi