Member since
06-11-2018
10
Posts
1
Kudos Received
0
Solutions
08-07-2018
12:55 PM
1 Kudo
Hello, I would like to use PutDatabaseRecord, to insert to oracle tables milions of rows from JSON file. So i start with two records from json, but I came across a problem, PutDatabaseRecord[id=70264994-b0a7-1501-0000-00003bbb7199] Failed to process StandardFlowFileRecord[uuid=afa320f6-9d5f-4e91-a7fc-abb3136464d0,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1533633308238-185, container=default, section=185], offset=567109, length=32],offset=0,name=1138608139480143,size=32] due to None of the fields in the record map to the columns defined by the ... table:
My flow for test: Generateflowfile (JSON) --> PutDatabaseRecord (with JSONTreeReader) I used different properties for processor PutDatabaseRecord for (Translate Field Names/Unmatched Field Behavior/Unmatched Column Behavior/Quote Column Identifiers/Quote Table Identifiers) base on this thread: none of the fields in the records map to the columns CSV to putDatabaseRecord I also created flow with CSV flowfile, but nothing change, the same error occured Table in database: COLUMN NAME DATA TYPE TEST_ID NUMBER STRING VARCHAR2 (3000 CHAR)
... View more
Labels:
- Labels:
-
Apache NiFi
07-19-2018
05:42 AM
Ok, thanks Matt, this template helps me
... View more
07-03-2018
05:27 PM
ok you are right, for this kind of flow but when I have for example: - one flow for data acquisition from source to Cassandra in one process group - second flow for data ingestion from Cassandra in another process group How to set properties in Wait/Notify in this kind of flow ? Unless there is also possible another solution ..
... View more
07-03-2018
12:39 PM
HI, I would like to create data flow,which put file to one directory, and the if it has succeded, put the same file to another directory I use for that Notify/Wait, but I wonder if uuid is a good solution for the signal, Are Wait/Notify properties adequate ? or if there is another way ?
... View more
Labels:
- Labels:
-
Apache NiFi
06-21-2018
07:55 AM
I don't know, I am newbie How to check ?
... View more
06-20-2018
11:09 AM
If I understood you correctly, I download Drill 1.13.0 (https://drill.apache.org/download/) and I copied the driver from apache-drill-1.13.0/jars/jdbc-driver/drill-jdbc-all-1.13.0.jar to /var/lib/dlfs/lib/drill-jdbc-all-1.13.0.jar, where access has all nodes with NiFi, but when I started processor , I got the following error nifi-logs.txt
... View more
06-20-2018
07:28 AM
07:24:56 UTC WARNING eec752d9-0163-1000-0000-0000293632ce pas01nod02.internsg.net:9093 ExecuteSQL[id=eec752d9-0163-1000-0000-0000293632ce]
Processor Administratively Yielded for 1 sec due to processing failure 07:24:56 UTC ERROR eec752d9-0163-1000-0000-0000293632ce pas01nod03.internsg.net:9093 ExecuteSQL[id=eec752d9-0163-1000-0000-0000293632ce]
ExecuteSQL[id=eec752d9-0163-1000-0000-0000293632ce] failed to process session
due to java.lang.IllegalStateException: Cannot invoke method public abstract
java.sql.Connection org.apache.nifi.dbcp.DBCPService.getConnection() throws
org.apache.nifi.processor.exception.ProcessException on Controller Service with
identifier 0723417c-1d9b-1340-0000-00005b696e28 because the Controller Service
is disabled: Cannot invoke method public abstract java.sql.Connection org.apache.nifi.dbcp.DBCPService.getConnection()
throws org.apache.nifi.processor.exception.ProcessException on Controller
Service with identifier 0723417c-1d9b-1340-0000-00005b696e28 because the
Controller Service is disabled 07:24:56 UTC WARNING eec752d9-0163-1000-0000-0000293632ce pas01nod03.internsg.net:9093 ExecuteSQL[id=eec752d9-0163-1000-0000-0000293632ce]
Processor Administratively Yielded for 1 sec due to processing failure 07:25:05 UTC ERROR 0723417c-1d9b-1340-0000-00005b696e28 pas01nod01.internsg.net:9093 DBCPConnectionPool[id=0723417c-1d9b-1340-0000-00005b696e28]
Failed to invoke @OnEnabled method due to
org.apache.nifi.reporting.InitializationException: Can't load Database Driver:
Can't load Database Driver 07:25:05 UTC ERROR 0723417c-1d9b-1340-0000-00005b696e28 pas01nod02.internsg.net:9093 DBCPConnectionPool[id=0723417c-1d9b-1340-0000-00005b696e28]
Failed to invoke @OnEnabled method due to
org.apache.nifi.reporting.InitializationException: Can't load Database Driver:
Can't load Database Driver 07:25:05 UTC ERROR 0723417c-1d9b-1340-0000-00005b696e28 pas01nod03.internsg.net:9093 DBCPConnectionPool[id=0723417c-1d9b-1340-0000-00005b696e28]
Failed to invoke @OnEnabled method due to
org.apache.nifi.reporting.InitializationException: Can't load Database Driver:
Can't load Database Driver 07:25:35
UTC ERROR 0723417c-1d9b-1340-0000-00005b696e28 pas01nod03.internsg.net:9093 DBCPConnectionPool[id=0723417c-1d9b-1340-0000-00005b696e28]
Failed to invoke @OnEnabled method due to
org.apache.nifi.reporting.InitializationException: Can't load Database Driver:
Can't load Database Driver 07:25:35 UTC ERROR 0723417c-1d9b-1340-0000-00005b696e28 pas01nod03.internsg.net:9093 DBCPConnectionPool[id=0723417c-1d9b-1340-0000-00005b696e28]
Failed to invoke @OnEnabled method due to
org.apache.nifi.reporting.InitializationException: Can't load Database Driver:
Can't load Database Driver logs-nifi.txt
... View more
06-20-2018
06:41 AM
@kkawamura, I check that each node has to have the jar file under the path from Controller Services. Please see below.
... View more
06-20-2018
05:09 AM
Yes but when I set the jar file path instead, I get another error ("database-driver-locations ...")
... View more
06-14-2018
01:36 PM
Hi, I am trying to connect Apache Drill 1.13.0 from Apache NiFi 1.5.0 by DBCPConnectionPool 1.5.0 but I got error 06:17:54
UTC ERROR eec752d9-0163-1000-0000-0000293632ce %%%%% ExecuteSQL[id=eec752d9-0163-1000-0000-0000293632ce]
ExecuteSQL[id=eec752d9-0163-1000-0000-0000293632ce] failed to process session
due to java.lang.RuntimeException: java.lang.RuntimeException:
java.lang.ClassNotFoundException: Class ${package.namespace.prefix}null not
found: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class
${package.namespace.prefix}null not found 06:17:54
UTC WARNING eec752d9-0163-1000-0000-0000293632ce %%%% ExecuteSQL[id=eec752d9-0163-1000-0000-0000293632ce] Processor
Administratively Yielded for 1 sec due to processing failure Thanks in advance, Tom
... View more
Labels:
- Labels:
-
Apache NiFi