Is it possible to create a flow in NiFi that after all the data ingestion and ETL complete, the pipeline triggers a Jupyter Notebook directly to kick off the Data Science model on the completed dataset?
Yes. You can use the Kernel Gateway feature of Jupyter to trigger notebooks over REST. Or you can also go over ZeroMQ. https://ndres.me/post/jupyter-notebook-rest-api/