Member since
11-05-2019
25
Posts
1
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1991 | 01-15-2020 01:36 PM |
06-04-2020
05:24 AM
Great! thanks!
... View more
06-03-2020
01:51 PM
Hi! I have a DBCPConnectionPool on NiFi 1.11.3 with this configuration: Normally it works ok, but sometimes the query get stuck on a PutSQL, no errors for minutes and then a timeout (very basic queries) I was trying some configurations on the pool but it seems I didn't quite understand the best way to troubleshoot this, I was thinking in each processor add a retry+counter+error. But don't know where to set the time out for queries from start of it and no per connection. Maybe a way is to not keep connections open until the query starts, how should I set the pool to generate the connection on request from a processor and terminate it before execution. I think it's a Athena problem with pools because I have no problem with another databases like postgres and mysql. Any ideas?? Thank you!
... View more
Labels:
- Labels:
-
Apache NiFi
03-24-2020
03:43 PM
Ok, this is all me for not understanding permissions correctly, I thought that if a permission wasn't configured it heredates the the permissions of NiFi. So: I'm Admin, I generated a group I should have access. You made me check again and I thank you for that!
... View more
03-23-2020
11:38 AM
Sorry for the bump, have more time than usual to solve this kind of problems, any idea? It's becoming hard to debug flows without this. Thank you!
... View more
03-17-2020
02:01 PM
Hi, currently I have 2 process groups on NiFi 1.11.3, the native one is showing data provenance on every processor as it should.
The imported template (from 1.9.2) inside another group shows a blank provenance window.
Any idea of what can be causing this?
Thank you!
... View more
Labels:
- Labels:
-
Apache NiFi
03-01-2020
02:14 PM
Hi, is there a way to login to NiFi registry via openid (ej google)? I'm thinking of how I can secure the instance without a domain like in NiFi Thanks!
... View more
Labels:
- Labels:
-
NiFi Registry
01-18-2020
11:51 AM
Hi, I have a flowfile with this format:
<td>Item1</td> <td class="dest">50.3421</td> <td class="dest">20.5547</td>
I need to write a query with the parameters, so I need to extract the numbers, with this for example:
(\d{2}.\d{4})
And put the 2 resultos in:
Insert into table(a,b) VALUES($1,$2)
How can I do this?
Thanks!
I tryed with replaceText but it's not what im looking for
... View more
Labels:
- Labels:
-
Apache NiFi
01-15-2020
01:36 PM
1 Kudo
Solved, PutDatabaseRecord gives you mapping error if the table doesn't exists or if you don't have permissions, hours fighting against the columns names and it was a database problem.
... View more
01-15-2020
01:21 PM
Hi, im trying to upload a CSV to a RedShift database using GetFile->PutDatabaseRecord i'm getting this error: PutDatabaseRecord: CSVReader (my file got headers, this way and not hardcoding the schema makes everything more easily scalable): Null string: NULL CSV: A,B,C,D,E,F,G,H,I 2020-01-15,AX,COD245,NO,PASS,R,,, 2020-01-15,AX,COD235,YES,PASS,R,,, Table with same fields names. Any idea what i'm doing wrong? Is there any way to look for the query it's making, that will make this more easy to debug. Thank you!
... View more
Labels:
- Labels:
-
Apache NiFi