Great post. Another solution may be to make use of Google Blockchain public dataset and Nifi: http://datamater.io/2018/07/19/fetching-bitcoin-transactions-with-apache-nifi/ ... View more

Expressing facebook API logic with standard processors may be tough and dirty. You could consider custom processors as we had to write for our usecase: https://datamater.io/2018/05/07/nifi-get-facebook-processor/ Yes, they solve paging problem 😉 ... View more

I had the same isssue and needed to create a processor on my own. Have a look at it: https://datamater.io/2018/06/02/nifi-openaq-get-bigquery-processor/ ... View more