@Rahul Pathak gave the correct answer. Apart from setting up NN ha config in core-site.xml, user also has to set property oozie.service.HadoopAccessorService.hadoop.configurations on the Oozie server. ... View more

Apart from defining location for data, can you please try setting "stats" and "meta" to "/tmp/${YEAR}-${MONTH}-${DAY}" ? Please let us know if this works. Also, please let me know the Java version you are using, I suspect the change in behavior is due to possible change in how pattern matcher behaves between Java 7 and 8. ... View more

This is similar to https://community.hortonworks.com/questions/17000/feed-unable-to-resolve-pattern-for-feedpath.html ... View more

@Misael Castro : If the process is not ending, here are a few things you should check. 1. What state is the process instance in Oozie. If it is in "WAITING", this is probably because you do not have sufficient containers/memory in Yarn to run the job. Please configure yarn accordingly. 2. If the process instance is in RUNNING state, please look into Yarn logs and see why the Pig script is not completing. Let me know if it is 1 or 2, and I can try to help you with configuration. ... View more

You can find logs by clicking on console url and clicking on the "1" under map tasks. I request you to share the hadoop version you are using. ... View more

@Junaid Rao and @mayki wogno : What does your logs in Yarn say? Do you see an error similar to this? Caused by: org.apache.falcon.FalconException: Couldn't evict feed from fileSystem at org.apache.falcon.entity.FileSystemStorage.evict(FileSystemStorage.java:306) at org.apache.falcon.retention.FeedEvictor.run(FeedEvictor.java:76) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.falcon.retention.FeedEvictor.main(FeedEvictor.java:52) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.oozie.action.hadoop.JavaMain.run(JavaMain.java:56) ... 15 more Caused by: java.io.IOException: Unable to resolve pattern for feedPath: / at org.apache.falcon.entity.FeedHelper.getFeedBasePath(FeedHelper.java:518) at org.apache.falcon.entity.FileSystemStorage.fileSystemEvictor(FileSystemStorage.java:331) at org.apache.falcon.entity.FileSystemStorage.evict(FileSystemStorage.java:300) ... 23 more ... View more

If you look at the XML on the right hand side (in the red oval)4309-falcon-edit-xml-datapath.png, you will notice that location tag for primary cluster does not have an entry for "path". Please fix this and you should be able to submit the cluster. ... View more

@mayki wogno : You did all the steps correct. The only possible explanation for you to continue seeing this error is that hdfs, yarn and oozie were not restarted after the changes were made to configs. If you did restart hdfs, yarn and oozie - I am not sure why you are continuing to see the problem. Based on the logs, I am assuming you have enabled Kerberos on your cluster. I see that the job is scheduled from clusterA, but the workflow is on clusterB. Oozie user oozie/clusterA@EXAMPLE.COM is unable to connect to clusterB and read the workflow.xml. This seems like kerberos configuration issue. Make sure, you have the config "oozie.authentication.kerberos.name.rules" set up correctly to handle these situations, and that kerberos server on clusterB can authenticate oozie/clusterA@EXAMPLE.COM ... View more

@mayki wogno Please share the relevant Oozie log for this workflow. This seems like auth issue on Oozie and not Falcon, and I will help you debug. ... View more

@Manoj Dhake Can you please confirm that oozie is configured correctly for Falcon to work? You can follow doc at https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_installing_manually_book/content/configuring_oozie_for_falcon.html ... View more

@mayki wogno Please go to Ambari, click on Falcon service, now go to configs and go to "Advanced falcon-env". This is where the log dir is configured for falcon. The log name should be falcon.application.log ... View more

The root cause of this issue is that the user you are using to run the workflow does not have permission to read the workflow.xml. If you submitted the feed entity as user "ABC", try to schedule it as user "ABC" and not some other user who does not have permissions to read the workflow. ... View more

Shouldnt the uri look like jdbc:hive2://<host>:<port>/<db>;transportMode=http;httpPath=<http_endpoint> ? ... View more

@Saurabh Kumar I did not refer to any feed/process entities in my comment. So I do not understand your comment. Can you please clarify? ... View more

https://falcon.apache.org/HiveDR.html explains how you can setup Hive replication from DB to DB, Table(s) to Table(s). Here are the limitations. 1. The DB and Table(s) names should be same on source and target. 2. Make sure hive has property hive.metastore.event.listeners set to org.apache.hive.hcatalog.listener.DbNotificationListener 3. User should bootstrap the DB and Table(s) on target from the source, after enabling event listeners. As of today, Falcon will only replicate events captured by hive.metastore.event.listeners. This means that for Hive 1.2.*, the following will NOT be replicated. Everything else should be replicated by Falcon because Hive saves the events. - will not replicate virtual objects like views, and will not handle other metadata objects such as roles, etc, it will be up to the warehouse administrator to manage those aspects currently. - will not replicate direct HDFS writes without Metadata registering (in Alter, Update scenarios) ... View more

@wood super : I tried running falcon-0.9 in embedded mode. The UI worked fine without any problems. Can you please share the logs in falcon.application.log when you see the "no found" error? Can you also let us know if this is secure cluster or un-secure cluster? ... View more

Hi @Hanna Lee : Select the instance, and click on Log. You should be able to see basic logs on why this instance failed. You can get the job-id from the log, and look directly into Oozie to get more information. Please let me know what the log says. ... View more

@Rahul Pathak is correct. @Hanna Lee : Please follow instructions at Please use information at https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_installing_manually_book/content/configuring_oozie_for_falcon.html and ensure Oozie is set up correctly for Falcon. Please let us know if this solved the issue. ... View more