Member since
12-20-2019
4
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
9826 | 02-25-2020 06:01 AM |
02-25-2020
06:01 AM
1 Kudo
The solution is to change the schema access strategy to Use String Fields From Header.
... View more
02-20-2020
01:41 PM
I tried to update the schema text of CSV reader with the following content: { "type" : "record", "name" : "userInfo", "namespace" : "my.example", "fields" : [{"name" : "measure_ts", "type" : { "type" : "long", "logicalType" : "timestamp-millis" }},{"name" : "temperature", "type" : "long"}] } but always the same error !
... View more
02-20-2020
12:44 PM
Hi all I have the following Nifi template which ingests data from a csv file and put them in a database.
The template is available here https://github.com/cetic/fadi/blob/master/examples/basic/basic_example_final_template.xml
The template is composed of two processes InvokeHTTP and PutDatabaseRecord
InvokeHTTP PutDatabase
It has also two controller services : CSV Reader and DBCPCOnnectionPool
The complete explanation of this small example is available here https://github.com/cetic/fadi/blob/master/USERGUIDE.md#3-ingest-measurements
The csv file is here https://raw.githubusercontent.com/cetic/fadi/master/examples/basic/sample_data.csv
The table creation is:
CREATE TABLE example_basic ( measure_ts TIMESTAMP NOT NULL, temperature FLOAT (50) );
Until Apache Nifi 1.9.2 everything works are expected! Since Apache Nifi 10.0.0, I have an Error in the PutDatabaseRecord processor
"org.apache.nifi.serialization.record.util.IllegalTypeConversionException: Cannot convert CHOICE, type must be explicit"
It seems to be related to this https://github.com/apache/nifi/blob/master/nifi-commons/nifi-record/src/main/java/org/apache/nifi/serialization/record/util/DataTypeUtils.java#L1733
Any idea how can I edit the template to fix this error?
... View more
Labels:
- Labels:
-
Apache NiFi
12-20-2019
12:57 AM
Hi community,
Beyond the ConvertExcelToCSVProcessor, does Nifi offer other processors specific to MS Excel (.xls and/or .xlsx) like for example a specific processor to parse MS Excel files?
I know that is possible to do (and I already did) it with scripting (using for example the xlrd module of Python). However, here, I ask about the existence of pre-configured Nifi processors for MS Excel format.
Thanks in advance!
... View more
Labels:
- Labels:
-
Apache NiFi