Member since
01-02-2020
40
Posts
3
Kudos Received
5
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 11184 | 12-23-2020 09:33 AM | |
| 2826 | 05-18-2020 01:27 AM | |
| 2414 | 04-28-2020 11:02 AM | |
| 6740 | 04-23-2020 12:20 PM | |
| 3089 | 01-25-2020 11:50 PM |
04-22-2020
10:49 AM
I have a situation, where I have to get the combined data from two tables from Mysql database, ExecuteSql processor throwing out bellow error, where as the same query is working fine from Mysql Workbench.
2020-04-22 14:55:06,597 ERROR [Timer-Driven Process Thread-8] o.a.nifi.processors.standard.ExecuteSQL ExecuteSQL[id=9d81c7ae-0171-1000-f638-2f1e60bfe48e] Unable to execute SQL select query select t1.CODE_CLOCK_ID, t1.COMPANY_CD, t1.GROUP_SEGMENT_L1, t1.GROUP_SEGMENT_CD, t2.CODE_CLOCK_ID, t2.COMPANY_CD, t2.GROUP_SEGMENT_L1, t2.GROUP_SEGMENT_CD from sheet26 t1 INNER JOIN sheet27 t2 on t1.CODE_CLOCK_ID = t2.CODE_CLOCK_ID and t1.COMPANY_CD = t2.COMPANY_CD LIMIT 0, 1000; due to org.apache.nifi.processor.exception.ProcessException: org.apache.avro.AvroRuntimeException: Duplicate field CODE_CLOCK_ID in record any.data.sheet26: CODE_CLOCK_ID type:UNION pos:4 and CODE_CLOCK_ID type:UNION pos:0.. No FlowFile to route to failure: org.apache.nifi.processor.exception.ProcessException: org.apache.avro.AvroRuntimeException: Duplicate field CODE_CLOCK_ID in record any.data.sheet26: CODE_CLOCK_ID type:UNION pos:4 and CODE_CLOCK_ID type:UNION pos:0. org.apache.nifi.processor.exception.ProcessException: org.apache.avro.AvroRuntimeException: Duplicate field CODE_CLOCK_ID in record any.data.sheet26: CODE_CLOCK_ID type:UNION pos:4 and CODE_CLOCK_ID type:UNION pos:0. at org.apache.nifi.processors.standard.AbstractExecuteSQL.lambda$onTrigger$1(AbstractExecuteSQL.java:301) at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2746) at org.apache.nifi.processors.standard.AbstractExecuteSQL.onTrigger(AbstractExecuteSQL.java:297) at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27) at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1176) at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:213) at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117) at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:830) Caused by: org.apache.avro.AvroRuntimeException: Duplicate field CODE_CLOCK_ID in record any.data.sheet26: CODE_CLOCK_ID type:UNION pos:4 and CODE_CLOCK_ID type:UNION pos:0. at org.apache.avro.Schema$RecordSchema.setFields(Schema.java:651) at org.apache.avro.SchemaBuilder$FieldAssembler.endRecord(SchemaBuilder.java:2013) at org.apache.nifi.util.db.JdbcCommon.createSchema(JdbcCommon.java:636) at org.apache.nifi.util.db.JdbcCommon.convertToAvroStream(JdbcCommon.java:239) at org.apache.nifi.processors.standard.sql.DefaultAvroSqlWriter.writeResultSet(DefaultAvroSqlWriter.java:49) at org.apache.nifi.processors.standard.AbstractExecuteSQL.lambda$onTrigger$1(AbstractExecuteSQL.java:299) ... 13 common frames omitted
what could be issue and what I have to change in query to get the record set from database?
I am using Nifi 1.11.4.
This issue happens even excluding INNER or even replacing INNER JOIN with "where" in the select query.
... View more
Labels:
- Labels:
-
Apache NiFi
03-28-2020
09:26 AM
1 Kudo
great and Thanks it was very useful for my work. Here I will be having data in the excel, I need to extract the column names(1st row) and form the create the table with primary key and foreign key and data(2nd row) in the database(mysql) from nifi.
... View more
03-27-2020
12:22 AM
Hi,
I did nifi and mysql setup in stand alone machine, where I have scenario the input will be in excel form, i need to create table in mysql db.
I have seen processors where we can do UPDATE, INSERT, or DELETE SQL, does create will be possible?
Also Do I need to write custom processor to extract the column names from the excel?
... View more
Labels:
- Labels:
-
Apache NiFi
01-25-2020
11:50 PM
Hi, This issue is resolved, it was the issue with the kafka server, which was stopped due /tmp log issue
... View more
01-25-2020
10:59 PM
Hi,
I have a scenarios getting the flow file from NLPProcessor as jason object, then passing to PublishKafka, the PublishKafka throwing out following error TimeoutException error, what is wrong in the configurations.
PublishKafka configurations...
The issue looks to be configuration, any help really appreciated.
Thank you,
--Murali
... View more
Labels:
- Labels:
-
Apache Kafka
01-23-2020
03:02 AM
Thanks Matt
... View more
01-21-2020
09:54 PM
The Apache NiFi registry installation guide is not mentioned support ability for windows, could any one tried installing it on Windows?
... View more
Labels:
- Labels:
-
Apache NiFi
01-10-2020
03:17 AM
2 Kudos
The issue is I was not using right value for the attribute Destination, the value suppose to be flowfile-attribute in my case. Thanks Steven for suggestions.
... View more
01-09-2020
07:12 PM
Hi Steven, Great Thank full to you, I tried the workaround but its failed, the problem is the attribute is not coming out from EvaluateJasonPath, the attribute which I supposed to use in RouteOnAttribute for comparison. The following is the output of attributes property file from EvalueJasonPath processor. If I get attribute HR.finance.user from EvaluateJasonPath, then i can use that attribute in RouteOnAttribute for comparison of attribute value.
... View more
01-09-2020
11:43 AM
Hi Steven, I doing a poc(learning nifi and doing it), getting the data successfully from EvaluteJasonPath its going to matched processor with the only extracted data, but the flow file is missing when it is going to RouteOnAttribute, I could see only data extracted present but total flow file is missing, because of this my condition is not getting validated and going to unmatched status.
... View more
- « Previous
-
- 1
- 2
- Next »