Code Repositories
Find and share code repositories
Announcements
Check out our newest addition to the community, the Cloudera Innovation Accelerator group hub.
Labels (2)
New Contributor
Repo Description

Ephemeral means that we do not know the state of Spark before, during, or after the invocation, we just care that the job was submitted, executed and results came back, no state of any type is kept. Data, or reference to data, is passed in the invocation, and the results captured and stored in the flowfile.

The best use case for this processor is when you want to launch ephemeral jobs for processing in Spark with a predictable start and finish cycles, rather than long running jobs. Since the processor will launch-and-wait for spark to finish, it means a thread will be allocated to wait until spark returns, no interaction happens while the Spark job is running.

Repo Info
Github Repo URL https://github.com/diegobaez/PUBLIC/tree/master/NiFi-SnapSpark
Github account name diegobaez
Repo name NiFi-SnapSpark
2,523 Views
Don't have an account?
Version history
Last update:
‎10-31-2016 01:13 PM
Updated by:
Contributors
Top Kudoed Authors