Best in Flow Event

[#1]

Cloudera DataFlow Connectors 

We would love to have you and your fellow colleagues attend this session. Please feel free to share this internally. We look forward to having you join us!

Reading from Iceberg

https://github.com/tspannhw/FLaNK-DataFlows/blob/main/jdbc/README.md 

Tip:

if you have missing core-site / CDP Environmental settings then paste these in to deploy.

/home/nifi/additional/secret/env_config/core-site.xml,/home/nifi/additional/secret/env_config/hive-site.xml,/home/nifi/additional/secret/env_config/ssl-client.xml

May 12, 2023

1.  Attend the Webinar .   Rewatch on demand.

2. Register for the Best in Flow Data Flow Sandbox Environment during the event or after via email you received when signing up.

3. Work on the the tutorials to get familiar.

4. Join my Zoom Sessions on May 4 @1pm EST, May 5 @ 9am EST, May 8 @11am EST, and May 9 @ 9am and more .   I will start more on demand if there is need.

5. Sign up for the slack  group and post if you need help.

6. Build your own flows and experiment.   You can use one of the available data streams or bring your own public datasets.

7. Submit your favorite two flows for the competition.

Tutorials To Get You Started

• https://github.com/tspannhw/FLaNK-TravelAdvisory/blob/main/steps.md

• https://github.com/tspannhw/FLaNK-DataFlows/blob/main/finaltutorials/BestInFlowCompetitionTutorials0...

• https://github.com/tspannhw/FLaNK-DataFlows/blob/main/finaltutorials/CloudToolGuidance03May2023.pdf 

• How to Start Video 

Additional Resources

• Best Practices Guide

• Meet the Committers Lab Prep

• Daily Zoom

• Guidelines

• Developer Home Page

• April 25, 2023 SF DataFlow Meetup Video

• ExamplesCloudera DataFlow Designer: The Key to Agile Data Pipeline Development

• Streaming Data Ingestion into an Open Data Lakehouse Made Easy with
  

• DataFlow Example
  

• Cloudera DataFlow Designer: Kafka to Iceberg in Cloudera Data Warehouse
  

• Serverless NiFi Flows with DataFlow Functions
  

• DataFlow Functions Technical Demo
  

• DataFlow Documentation

• https://www.slideshare.net/bunkertor/best-practices-for-workflow

• https://www.slideshare.net/bunkertor/meet-the-committers-webinar-lab-preparation

• https://www.slideshare.net/bunkertor/cloudera-sandbox-event-guidelines-for-workflow

• * https://www.datainmotion.dev/2023/05/best-in-flow-competition-tutorials-part.html 
  * https://www.datainmotion.dev/2023/05/best-in-flow-competition-tutorials-part_2.html 
  * https://www.datainmotion.dev/2023/05/best-in-flow-competition-tutorials-part_43.html 
  * https://www.datainmotion.dev/2023/05/best-in-flow-competition-tutorials-part_45.html 
  * https://github.com/tspannhw/FLaNK-DataFlows/tree/main/tutorials 
  * https://github.com/tspannhw/FLaNK-DataFlows/blob/main/tutorials/BestInFlowCompetitionTutorials.epub 
  * https://github.com/tspannhw/FLaNK-DataFlows/blob/main/tutorials/BestInFlowCompetitionTutorials.docx 
  * https://github.com/tspannhw/FLaNK-DataFlows/blob/main/tutorials/BestInFlowCompetitionTutorials.zip 
  * https://github.com/tspannhw/FLaNK-DataFlows/blob/main/tutorials/Cloud%20Tools%20Guidance.epub 
  * https://github.com/tspannhw/FLaNK-DataFlows/blob/main/tutorials/Cloud%20Tools%20Guidance.pdf 
  * https://github.com/tspannhw/FLaNK-DataFlows/blob/main/tutorials/Cloud%20Tools%20Guidance.zip 

• https://www.datainmotion.dev/2023/05/cloud-tools-guidance-how-to-build-data.html

• https://www.datainmotion.dev/2023/05/cloud-tools-guidance-how-to-build-data_2.html

• https://www.datainmotion.dev/2023/05/cloud-tools-guidance-how-to-build-data_18.html

• https://www.datainmotion.dev/2023/05/best-in-flow-competition-bring-your-own.html

• https://www.datainmotion.dev/2023/05/best-in-flow-competition-streaming-data.html

• https://www.youtube.com/@nifinotes5127 

 

Quick Tips

• DNS-based ad-blocker prevented some JavaScript from loading
•  Use a Chrome Browser
• Turn off VPNs and ad-blockers
• Use a fast enough internet connection
• Login if you are idle for more than 15 minutes
• Stop, terminate and delete things once you aren't using them
• Download and document your flows
• Prefix your work with your userid like this tim_.

 

[#2]

Can't wait for this event!  Let's go!!