When upgrading to HDP 2.5 or later with Falcon, you might encounter the following error when starting the ActiveMQ server:
 ERROR - [main:] ~ Failed to start ActiveMQ JMS Message Broker. Reason: java.lang.NegativeArraySizeException (BrokerService:528) You might also encounter this error if downgrading Falcon from HDP 2.5 to an earlier release. If you encounter this error, delete the ActiveMQ history and then restart Falcon. If you want to retain the history, be sure to back up the ActiveMQ history prior to deleting it.
 cd <ACTIVEMQ_DATA_DIR> rm -rf ./localhost cd /usr/hdp/current/falcon-server
 su -l <FALCON_USER> 


./bin/falcon-stop 
./bin/falcon-start ... View more

If you upgrade to or install HDP 2.5.0 or later without first installing the Berkeley DB file, you will get the error "Unable to initialize Falcon Client object. Cause : Could not authenticate, Authentication failed". The information below has also been added to the Data Movement and Integration guide and other Hortonworks documentation. Prerequisite to Installing or Upgrading Falcon Starting with the HDP 2.5.0 release, customers must provide the free Berkeley DB JAR file, under the Oracle license, as part of a Falcon installation or upgrade. This applies to Ambari express or rolling upgrades, to manual upgrades, and to all installations of HDP 2.5.0 or later, if you are using the Falcon service. Following are both Ambari and manual instructions for downloading and installing the JAR. Ambari Install or Upgrade of Falcon If you are using the Falcon service, the following steps must be performed on all Ambari server hosts on the cluster, prior to installing or upgrading to HDP 2.5.0 or later. To access the full installation or upgrade instructions for the Ambari version to which you are upgrading, go to the Hortonworks documentation website. You must have administrator privileges on all Ambari servers to perform this task. Steps Download the required Berkeley DB implementation file. wget –O je-5.0.73.jar http://search.maven.org/remotecontent?filepath=com/sleepycat/je/5.0.73/je-5.0.73.jar Log in to the Ambari server with administrator privileges. su – root Copy the file to the Ambari server share folder. cp je-5.0.73.jar /usr/share/ Set permissions on the file to owner=read/write, group=read, other=read. chmod 644 /usr/share/je-5.0.73.jar Configure the Ambari server to use the Berkeley DB driver. ambari-server setup --jdbc-db=bdb --jdbc-driver=/usr/share/je-5.0.73.jar Restart the Ambari server. ambari-server restart Restart the Falcon service from the Ambari UI. You need to have administrator privileges in Ambari to restart a service. In the Ambari web UI, click the Services tab and select the Falcon service in the left Services pane. From the Falcon Summary page, click Service Actions > Restart All. Click Confirm Restart All. When the service is available, the Falcon status displays as Started on the Summary page. Manual Install or Upgrade of Falcon If you are using the Falcon service, the following steps must be performed on all Falcon server hosts on the cluster, prior to installing or upgrading to HDP 2.5.0 or later. To access the full installation or upgrade instructions for the HDP version to which you are upgrading, go to the Hortonworks documentation website. You must have administrator privileges on the Falcon server to perform this task. Steps Log in to the Falcon server as user falcon. su - falcon Download the required Berkeley DB implementation file. wget –O je-5.0.73.jar http://search.maven.org/remotecontent?filepath=com/sleepycat/je/5.0.73/je-5.0.73.jar Copy the file to the Falcon library folder. cp je-5.0.73.jar /usr/hdp/<version>/falcon/webapp/falcon/WEB-INF/lib Set permissions on the file to owner=read/write, group=read, other=read. chmod 644 /usr/hdp/<version>/falcon/webapp/falcon/WEB-INF/lib/je-5.0.73.jar ... View more

There’s a new Data Movement and Integration (DMI) guide for the HDP 2.5.0 release. The guide currently focuses on Falcon features and functionality around the definition and scheduling of jobs for the backup, mirror, transfer, and processing of data. It also includes some content related to Flume, Sqoop, and Oozie. The existing Falcon content was moved out of the Data Governance Guide and into the DMI guide. New content was also added to the DMI guide to reflect changes to the Falcon UI and new Falcon features. In addition, the content has gone through an initial reorganization in an effort to more closely reflect the user’s experience. Significant changes to Falcon content in the guide include: Rewrote Tasks based on an improved, redesigned UI. Added Content about new functionality, including: RDBMS backup capability Snapshot-based backups Hive data mirroring Mirroring data between on-premise and cloud data with Azure and AWS S3 Ability to edit cluster entities using safe mode New entity dependencies view Replacement of client-side recipes with more flexible server-side extensions There is also a Falcon View available in Ambari. Instructions for installing the View are provided in the Apache Ambari Views guide. Apache Sqoop and Oozie content was moved out of the Data Access guide and into the DMI guide, with some minor updates to that content. Flume 1.5.2 content is still available in the Apache Flume Component Guide. A new introductory document has been added that includes a list of feature updates to Flume 1.5.2 for each HDP release. Most of the functionality in Flume 1.6 is available in the 1.5.2 version used with HDP. For HDP 2.5, Kafka Channel and TailDir Source were added. We will continue to add new HDP 2.5.0 content to the guide over the coming weeks, including: Configuring Falcon for HiveDR Information about Data Source entities We’ll let you know when updates to the document are available. If you have comments or suggestions, corrections or updates regarding our documentation, let us know on HCC. Help us continue to improve our documentation! Thanks! Hortonworks Technical Documentation Team ... View more