Don't use Map Reduce anymore.   It's time to move to Spark or Flink. ... View more

We don't support Mosquitto.   That is an open source Eclipse project   https://mosquitto.org/   You can log to topics https://mosquitto.org/man/mosquitto-conf-5.html   https://www.datainmotion.dev/2019/12/iot-series-minifi-agent-on-raspberry-pi.html https://community.cloudera.com/t5/Community-Articles/MQTT-with-Apache-NiFi/ta-p/248016   ... View more

Flume was deprecated.   https://www.datainmotion.dev/2019/08/migrating-apache-flume-flows-to-apache.html ... View more

The name of the server must be set, it can't be localhost.   NiFi and Hive are on other machines. ... View more

https://www.datainmotion.dev/2020/10/running-flink-sql-against-kafka-using.html   https://www.datainmotion.dev/2020/08/deleting-schemas-from-cloudera-schema.html   https://www.cloudera.com/tutorials/schema-registry-in-trucking-iot/3.html  ... View more

Nifi doesnt create schemas.   you can create them from the sr web ui or sr rest api.  You could make nifi create schemas by writing some code tovhave it create schemas ... View more

If you are using versioning and the NiFi registry, when you apply a new version to a running process group it will stop things and wait until things are not in process.   https://pierrevillard.com/2018/04/09/automate-workflow-deployment-in-apache-nifi-with-the-nifi-registry/   See the Python Helper by Dan https://pypi.org/project/nipyapi/   CLI can do this, you'll have to look at the docs. https://nifi.apache.org/docs/nifi-docs/html/toolkit-guide.html   Examples https://www.datainmotion.dev/2021/01/automating-starting-services-in-apache.html   The upcoming Cloudera DataFlow Experience does this automatically as part of autoscaling.   Make sure you use Load Balanced Queues between processors.   You can also use Stateless NiFi if you want things to start/stop just complete a fixed job. https://www.datainmotion.dev/2019/11/exploring-apache-nifi-110-parameters.html   Extra docs https://docs.cloudera.com/cdf-datahub/7.2.6/nifi-api/topics/cdf-datahub-nifi-rest-api.html   https://github.com/tspannhw/EverythingApacheNiFi https://www.datainmotion.dev/2020/09/devops-working-with-parameter-contexts.html https://www.datainmotion.dev/2020/10/automating-building-migration-backup.html https://www.datainmotion.dev/2019/04/simple-apache-nifi-operations-dashboard.html   ... View more

Here is a cool NiFi websocket app https://www.datainmotion.dev/2020/12/ingesting-websocket-data-for-live-stock.html   Hosting web apps in NiFi https://www.datainmotion.dev/2020/11/flank-smart-weather-websocket.html   https://www.datainmotion.dev/2020/12/ingesting-websocket-data-for-live-stock.html   ... View more