- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How can i use invokeHTTP to download multiple .zips from different web pages dynamically in NiFi?
- Labels:
-
Apache NiFi
Created on ‎06-05-2018 12:05 AM - edited ‎09-16-2022 06:18 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have multiple web pages that contain the files (.zips) I need to download and archive. I need to be able to find the names of the files per each web page and download them to a specific directory. I have tried using
GenerateFlowFile: (Contains all urls i need data from) -> SplitText (one url per line)
->ExtractText -> InvokeHTTP -> this gives me the response with filenames i need listed in <a href=**>.
How would I extract the names of the files I need from the response, and then download the files?
Regards,
Created ‎06-05-2018 12:15 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
