Member since
09-08-2019
13
Posts
0
Kudos Received
0
Solutions
09-20-2019
01:37 PM
If I make it blank and save, then it is defaulting to; maybe it is expecting a default value?
... View more
09-20-2019
01:33 PM
I think maybe I didn't explain it well. SKIP value is not in the rows, SKIP is in the column header. when we say col1 <> 'SKIP' i believe it will skip all rows with value 'SKIP' but my intention is to remove columns whose header is called 'SKIP' Here is an example of file header : FirstName|Skip|Skip|City|State|ZipCode|Skip|LastVisitDate|Skip|ExtId The file is not predefined, no of columns in a file will vary, header positions will vary, place where 'SKIP' can exist in the header will vary from file to file.
... View more
09-19-2019
04:17 PM
@Shu_ashu Skip is column header name, so how does the query look like to exclude columns whose header name is "SKIP"?
... View more
09-19-2019
04:15 PM
@Wynner It is giving an error as shown below, i have also uploaded screenshots of configuration for reference.
... View more
09-18-2019
03:47 PM
Hi, I have a CSV file where the last column has pipe-delimited text which needs to be split up on pipe and I have to pivot it into rows. The last column can have any number of values with pipe-delimited and it varies by each row. How can we accomplish this in NIFI? Ex: A, B, C|D X, Y, X|Y|Z|B The above file has to be converted to A, B, C A, B, D X, Y, X X, Y, Y X, Y, Z X, Y, B
... View more
Labels:
- Labels:
-
Apache NiFi
09-18-2019
01:46 PM
@Shu_ashu : Thank you so much for the link, it covers part of my need. The other thing is to assign the lookup value to attribute so I think the solution is ExecuteSQL -> ConvertAvroToJson -> EvaluateJsonPath can we do it in one step instead of 3 like above? All I am pulling is one field from the database table. Query: select id from table A
... View more
09-17-2019
03:39 PM
Hi, I am in need of SQL Server lookup, found this library https://github.com/mrcsparker/nifi-sqllookup-services-bundle but there are no good examples especially when dealing with incoming CSV text file. Appreciate if anybody can point me to an article or sample workflow that does something similar. Thanks in advance
... View more
Labels:
- Labels:
-
Apache NiFi
09-17-2019
03:36 PM
Hi, I think it is slightly different, it is remove header when a file is split in to smaller files where as for me it is one file with multiple columns with same header name and i need to ignore certain columns based on a column name.
... View more
09-13-2019
12:55 PM
Hi, I have a csv file with dynamic columns and headers and there are multiple columns with same header name "SKIP" that needs to be removed from the file before ingesting them into the database using PutDatabaseRecord. How can I delete the multiple columns with header name "SKIP'?
... View more
Labels:
- Labels:
-
Apache NiFi