Cloudera Community
maykiwogno
user rank
Rising Star

Re: Failed to index Provenance Events org.apache.l...

by Rising Star in Support Questions
‎04-19-2022 02:34 AM
‎04-19-2022 02:34 AM
Hello @Neil_1992  Can you post the original error in attachment and where I saw the nars issues. I'm trying to find if i got the same issue. Regards ... View more

Re: Failed to index Provenance Events org.apache.l...

by Rising Star in Support Questions
‎04-19-2022 12:46 AM
‎04-19-2022 12:46 AM
Hello @Neil_1992  Why have you replace only these 4 nars ? Have you got some logs ?   Thanks  ... View more

Re: Failed to index Provenance Events org.apache.l...

by Rising Star in Support Questions
‎04-19-2022 12:15 AM
‎04-19-2022 12:15 AM
Hello,  For my experience, when we restart the nifi, the message disaspeared for one or two days and come back again. Let check in one week.     ... View more

Re: Failed to index Provenance Events org.apache.l...

by Rising Star in Support Questions
‎04-19-2022 12:13 AM
‎04-19-2022 12:13 AM
Hello @MattWho    I have opened a issue here : https://issues.apache.org/jira/browse/NIFI-9572 I've checked and rechecked the number of open files and it is never up than +10000   I've already thought to increase the number of open files in the /etc/security/limit.d/90-nifi.conf  but there are two things  Why are we got this limit but not in with nifi 1.11.4  And the number 999999 is done by experience or it is high limit ?   Regards  ... View more

Re: Failed to index Provenance Events org.apache.l...

by Rising Star in Support Questions
‎04-07-2022 02:38 AM
‎04-07-2022 02:38 AM
Hello @Neil_1992    I've got the same error after upgrade from 1.11.4 to 1.15.3 For this moment, I don't have any information about this error. Hope to found it one day.   regards ... View more

Re: FAILED with DBCPConnectionPool 1.9.2 to SQL SE...

by Rising Star in Support Questions
‎08-01-2019 07:02 AM
‎08-01-2019 07:02 AM
The error message was not very clear but it works for HDF 1.9.2. Thanks a lot! ... View more

Re: FAILED with DBCPConnectionPool 1.9.2 to SQL SE...

by Rising Star in Support Questions
‎07-31-2019 11:44 AM
‎07-31-2019 11:44 AM
Hi, I have also tried with NIFI 1.5 and it works to. ... View more

FAILED with DBCPConnectionPool 1.9.2 to SQL SERVER

by Rising Star in Support Questions
‎07-31-2019 11:25 AM
‎07-31-2019 11:25 AM
Hi all, I have an issue to connect to the SQL Server with DBCPConnectionPool 1.9.2 but it is worked with DBCPConnectionPool 1.2 Do you know if there are some modifications between 1.2 and 1.9.2 concerning DBCPConnectionPool ? Connection parameter : jdbc:jtds:sqlserver://${host}:${port};databaseName=xxxxxx;user=xxxxxx;password=xxxxxx net.sourceforge.jtds.jdbc.Driver /var/dlk/squad/squad-jars/jtds-1.3.1.jar Thanks for helps. Here error on NIFI 1.9.2 2019-07-31 12:53:42,483 ERROR [Timer-Driven Process Thread-12] o.a.n.p.standard.ListDatabaseTables ListDatabaseTables[id=db1439dc-aa6f-385b-be8f-66ee7faf84f4] ListDatabaseTables[id=db1439dc-aa6f-385b-be8f-66ee7faf84f4] failed to process session due to java.lang.AbstractMethodError; Processor Administratively Yielded for 1 sec: java.lang.AbstractMethodError java.lang.AbstractMethodError: null         at net.sourceforge.jtds.jdbc.JtdsConnection.isValid(JtdsConnection.java:2833)         at org.apache.commons.dbcp2.DelegatingConnection.isValid(DelegatingConnection.java:874)         at org.apache.commons.dbcp2.PoolableConnection.validate(PoolableConnection.java:270)         at org.apache.commons.dbcp2.PoolableConnectionFactory.validateConnection(PoolableConnectionFactory.java:389)         at org.apache.commons.dbcp2.BasicDataSource.validateConnectionFactory(BasicDataSource.java:2398)         at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:2381)         at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:2110)         at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:1563)         at org.apache.nifi.dbcp.DBCPConnectionPool.getConnection(DBCPConnectionPool.java:470)         at org.apache.nifi.dbcp.DBCPService.getConnection(DBCPService.java:49)         at sun.reflect.GeneratedMethodAccessor537.invoke(Unknown Source)         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)         at java.lang.reflect.Method.invoke(Method.java:498)         at org.apache.nifi.controller.service.StandardControllerServiceInvocationHandler.invoke(StandardControllerServiceInvocationHandler.java:87)         at com.sun.proxy.$Proxy304.getConnection(Unknown Source)         at org.apache.nifi.processors.standard.ListDatabaseTables.onTrigger(ListDatabaseTables.java:230)         at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)         at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1162)         at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:209)         at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)         at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748) 2019-07-31 12:53:42,483 WARN [Timer-Driven Process Thread-12] o.a.n.controller.tasks.ConnectableTask Administratively Yielding ListDatabaseTables[id=db1439dc-aa6f-385b-be8f-66ee7faf84f4] due to uncaught Exception: java.lang.AbstractMethodError java.lang.AbstractMethodError: null         at net.sourceforge.jtds.jdbc.JtdsConnection.isValid(JtdsConnection.java:2833)         at org.apache.commons.dbcp2.DelegatingConnection.isValid(DelegatingConnection.java:874)         at org.apache.commons.dbcp2.PoolableConnection.validate(PoolableConnection.java:270)         at org.apache.commons.dbcp2.PoolableConnectionFactory.validateConnection(PoolableConnectionFactory.java:389)         at org.apache.commons.dbcp2.BasicDataSource.validateConnectionFactory(BasicDataSource.java:2398)         at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:2381)         at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:2110)         at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:1563)         at org.apache.nifi.dbcp.DBCPConnectionPool.getConnection(DBCPConnectionPool.java:470)         at org.apache.nifi.dbcp.DBCPService.getConnection(DBCPService.java:49)         at sun.reflect.GeneratedMethodAccessor537.invoke(Unknown Source)         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)         at java.lang.reflect.Method.invoke(Method.java:498)         at org.apache.nifi.controller.service.StandardControllerServiceInvocationHandler.invoke(StandardControllerServiceInvocationHandler.java:87)         at com.sun.proxy.$Proxy304.getConnection(Unknown Source)         at org.apache.nifi.processors.standard.ListDatabaseTables.onTrigger(ListDatabaseTables.java:230)         at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)         at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1162)         at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:209)         at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)         at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)         at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)         at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)         at java.lang.Thread.run(Thread.java:748) ... View more
Labels:

NIFI : was slow for each of the last 3 requests ma...

by Rising Star in Support Questions
‎04-12-2018 12:37 PM
‎04-12-2018 12:37 PM
Hi all, We have opened an ticket to hortonwork support but don't have any clues about this message, we have a lot of messages : 2018-04-12 14:18:10,277 WARN [Replicate Request Thread-42] o.a.n.c.c.h.r.ThreadPoolRequestReplicator Response time from node1-nifi:9091 was slow for each of the last 3 requests made. To see more information about timing, enable DEBUG logging for org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator We have set some parameters : nifi.cluster.node.connection.timeout=60 sec nifi.cluster.node.read.timeout=60 sec nifi.cluster.node.protocol.max.threads=100 nifi.cluster.node.protocol.port=9088 nifi.cluster.node.protocol.threads=80 nifi.web.jetty.threads=600 After restart the nifi, all is ok for a few minutes before the message come back again. I don't use custom processors, and CPU use is around 5%, host has 32Go and Memory HEAD is set to minimum 8GB and max 16GB. NIFI 1.2 Any helps are welcome. ... View more
Labels:

Re: Convert data from JSON/CSV/Avro to Parquet wit...

by Rising Star in Community Articles
‎12-06-2017 03:13 PM
‎12-06-2017 03:13 PM
Hi, thank for your tuto. Do you know if PutParquet could to deal with "date", "timestamp" type or it depends avro Schema ? So the answer is NO.. ... View more
Contact Me
Online
Offline
Last Visited
‎04-19-2022 01:50 PM
Community Statistics
Member Since ‎05-10-2016 03:11 PM
Last Visited ‎04-19-2022 01:50 PM
Posts 303
Kudos received 35