Cloudera Flow Management / Apache NiFi Best Practices Cookbook

[#1]

Welcome! In this series of articles I will address various topics about Cloudera Flow Management (powered by Apache NiFi) in terms of Best Practices about how, when, and why to use the powerful and flexible features of Cloudera Flow Management (CFM) / Apache NiFi. I will use the terms CFM and NiFi interchangeably but will specify when something is specific to Cloudera Flow Management and does not apply to Apache NiFi.

These examples and screenshots will be taken both from CFM 2 (powered by Apache NiFi 1.x) and CFM 4 (powered by Apache NiFi 2.x) when prudent to illustrate the features and Best Practices that are common to both CFM 2 and 4, as well as when something is specific to CFM 4 / NiFi 2. Links will be present for articles that have been published.

This Best Practices Cookbook will feature the following articles, but please like/subscribe as articles may be added and/or edited at various times. Also if you have any ideas on Best Practices articles that may be helpful to the community, please leave them in the comments below. Happy Flowing!

Best Practices Cookbook

• Parameterize All The Things! (part 1 - Parameters and Parameter Contexts)

• Parameterize All The Things! (part 2 - Parameterizing Controller Service References)

• Parameterize All The Things! (part 3 - Parameter Providers)

• Flow Analysis Rules (enforcing Best Practices in Flow Design)

• Backpressure (Maximize throughput)

• Schema Drift (what to do when your source data structures change)

• Unlocking the power of  Registry (Version Control, Flow Development Lifecycle, etc.)