Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Notify/ Wait after store to HDFS

Highlighted

Notify/ Wait after store to HDFS

New Contributor

Hello all..

 

I would like to set a Notify/Wait logic in my flow.

A file comes in the PG, and it's being flaten out with JOLT. 

I want it to be passed to a second PG only when this file is

  1. successfuly stored on HDFS
  2. successfuly exited the JOLT conversion Group.

 

Now, i've set up a new attribute called flag after it's stored and after it's successfully converted with JOLT. However, The notify processor is not working as expected.

 

screenshot

This is my notify configuration: I'm not sure what to do with the successful relationship here.. do I terminate it or what?

screenshot1

And my wait configuration...

screenshot3

 

Now.. the after the file is stored as .orc... i need the .json file that's waiting to be passed on to the next process group outside this one. But I'm not sure what I'm doing wrong?

 

Thanks,

Rosa

 

 

Don't have an account?
Coming from Hortonworks? Activate your account here