Code Repositories
Find and share code repositories
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
Labels (2)
New Contributor
Repo Description

Ephemeral means that we do not know the state of Spark before, during, or after the invocation, we just care that the job was submitted, executed and results came back, no state of any type is kept. Data, or reference to data, is passed in the invocation, and the results captured and stored in the flowfile.

The best use case for this processor is when you want to launch ephemeral jobs for processing in Spark with a predictable start and finish cycles, rather than long running jobs. Since the processor will launch-and-wait for spark to finish, it means a thread will be allocated to wait until spark returns, no interaction happens while the Spark job is running.

Repo Info
Github Repo URL https://github.com/diegobaez/PUBLIC/tree/master/NiFi-SnapSpark
Github account name diegobaez
Repo name NiFi-SnapSpark
2,045 Views
Don't have an account?
Coming from Hortonworks? Activate your account here
Version history
Revision #:
1 of 1
Last update:
‎10-31-2016 01:13 PM
Updated by:
 
Contributors
Top Kudoed Authors