Member since
08-14-2019
8
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2565 | 08-23-2019 08:25 AM |
12-09-2019
01:44 PM
1 Kudo
@wann_douglas You can download and view the data from any connection to inspect your data as it passed through your dataflow. You can also do the same by looking at each reported provenance event; however, access to view or download the content of a FlowFile via a Provenance event is only possible if that cntent still exists in the NiFi content_repository. Here is my suggestion: 1. Stop all the processors in your dataflow 2. Start only the first processor and you will see data queue on the connection leading to the next processor. 3. Right click on the connection with the queued data and select "List Queue" form the context menu that is displayed. 4. You can click on the "view details' icon to far left side of any listed FlowFile from the table displayed 5. From the "FlowFile" UI that is displayed you can select the "Download" or "View" buttons to get access to the content as it exists at this point in your dataflow. When you are done examining the content, repeat steps 3-5 after starting the next processor in your dataflow. This allows you to see how your content is changing s it progresses through your dataflow one processor at a time. Hope this helps you, Matt
... View more
12-09-2019
01:44 PM
1 Kudo
@wann_douglas You can download and view the data from any connection to inspect your data as it passed through your dataflow. You can also do the same by looking at each reported provenance event; however, access to view or download the content of a FlowFile via a Provenance event is only possible if that cntent still exists in the NiFi content_repository. Here is my suggestion: 1. Stop all the processors in your dataflow 2. Start only the first processor and you will see data queue on the connection leading to the next processor. 3. Right click on the connection with the queued data and select "List Queue" form the context menu that is displayed. 4. You can click on the "view details' icon to far left side of any listed FlowFile from the table displayed 5. From the "FlowFile" UI that is displayed you can select the "Download" or "View" buttons to get access to the content as it exists at this point in your dataflow. When you are done examining the content, repeat steps 3-5 after starting the next processor in your dataflow. This allows you to see how your content is changing s it progresses through your dataflow one processor at a time. Hope this helps you, Matt
... View more
09-10-2019
07:12 AM
I to am attempting to migrate from Oracle to Postgres. I am using the template this blogger recommends but am unable to get it to work with NiFi 1.9.2 https://blog.pythian.com/database-migration-using-apache-nifi/ Any help would be much appreciated!
... View more
08-23-2019
08:25 AM
Thanks to all for your insights. What I ended up doing was installing NiFi locally on my machine, still connected to my database server on the network. I had to mess with the DB Connection Pool a bit to get the correct combination of Database Connection URL and userid and password, but I got it to write successfully to my hard drive locally. Fortunately, I had a limit of 45 files set for the directory in my PutFile processor because I got 45 flowfiles in a heartbeat. So, if you're testing this out, MAKE SURE YOU LIMIT YOUR NUMBER OF FILES before you attempt to run your processes!!!
... View more