About yzheng

yzheng · ‎07-20-2016

1. A retry file will be created when a retry is needed and be deleted after a retry finishes. 2. Graph storage file will record all the entities and instances to provide search and lineage information. It will grow as you create entities. The space complexity will be linear to the total number of entities and instances, assuming their dependency relations are sparse.

yzheng · ‎07-20-2016

Looks like jar file missing. Which version of Falcon? Could you check if you have activemq jar file under Falcon home directory? e.g. [root@sandbox falcon]# ls server/webapp/falcon/WEB-INF/lib/*activemq* server/webapp/falcon/WEB-INF/lib/activemq-core-5.4.3.jar server/webapp/falcon/WEB-INF/lib/activemq-protobuf-1.1.jar

yzheng · ‎06-03-2016

When Falcon creates Oozie bundle, it will pass the nominal time range and frequency to Oozie. Oozie bundle uses these information to create workflows for each nominal time.

yzheng · ‎06-01-2016

@yjiang Great!

yzheng · ‎06-01-2016

@Manoj Dhake If you use table feed, you have to define partition. For your case where you don't want to specify partition, you can use process with hive engine: https://falcon.apache.org/0.4-incubating/docs/EntitySpecification.html#Hive

yzheng · ‎06-01-2016

@yjiang Could you check the mirror instance status? You can run CLI command bin/falcon instance -list -type process -name [your-mirror-name] If it is failed or killed, could you check Oozie site on error details?

yzheng · ‎04-26-2016

Whether the output will be deleted/refreshed or simply appended depends on the process defined by the user. Falcon just reruns the process instance with the late-arriving input data.

yzheng · ‎04-26-2016

If the input data arrive late but within the cutoff time (defined in feed), Falcon will rerun the instance and update the output. If the input data arrive later than cutoff time, Falcon will not rerun but mark the instance as timeout.

yzheng · ‎03-22-2016

@Pavel Benes The error usually occurs because of the malformed xml. It would be helpful if you share the xml for the failed request when you have it. In the future, we'll log the input xml to ease the debug of similar errors.

yzheng · ‎03-21-2016

@Amit Tewari Which version of Falcon are you using? Are the jobs submitted and scheduled successfully? Could you go to falcon web ui and share the job status image? You should be able to see rawEmailIngestProcess, cleanseEmailProcess and corresponding feeds on the web ui after typing "*" in the search box.

Online	Offline
Last Visited	‎07-22-2016 10:06 PM

Member Since	‎09-28-2015 05:09 PM
Last Visited	‎07-22-2016 10:06 PM
Posts	22
Kudos received	4

Cloudera Community

Re: Falcon HA shared NFS drive sizing

Re: How can we pass or obtain the nominal time fro...

Re: Could not submit falcon feed schedule with dif...

Re: Falcon HA shared NFS drive sizing

Re: Unable to start falcon server

Re: How can we pass or obtain the nominal time fro...

Re: Falcon Doesn't Mirror Data?

Re: Is it mandatory to have partition on hive tabl...

Re: Falcon Doesn't Mirror Data?

Re: How does falcon handle late arriving data on t...

Re: How does falcon handle late arriving data on t...

Re: javax.xml.bind.UnmarshalException when trying...

Re: Output of the Falcon data pipeline is empty