About bandalora

bandalora · ‎02-07-2018

Also check out info on the standby NameNode: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_hdfs-administration/content/get_ready_to_backup.html

bandalora · ‎02-07-2018

The passive NameNode can be used in high availability configurations, to prevent single point of failure: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_hadoop-high-availability/content/ch_HA-NameNode.html.

bandalora · ‎06-12-2017

Are there any error messages in your log files? Also, in the meantime, you might verify that you have a JDBC driver in /user/oozie/share/lib/lib_<timestamp>/sqoop.

bandalora · ‎05-24-2017

@Lucky_Luke Falcon on HDP 2.5.0 does support Spark actions. See the Data Movement & Integration guide for info. However, Falcon has been deprecated in HDP 2.6 and will be removed in HDP 3.0.

bandalora · ‎05-19-2017

@Saumidh Mhatre And FYI, most actions are asynchronous, so one has to end before the next begins, which you mention you want to happen. For a list of some of the actions available and which are synchronous vs asynchronous, see the Workflow Action Types table in the Workflow Management (WFM) guide (the table applies even if you aren't using WFM, as WFM is based on Oozie).

bandalora · ‎05-18-2017

A couple of things you might try: * Set oozie.use.system.libpath=true in the job.properties file and ensure you have the proper jars in sharelib. * Add the Hive settings file to the workflow.xml, such as <job-xml>hive-site.xml</job-xml>.

bandalora · ‎05-17-2017

Also, the documentation for Workflow Manager is available at http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_workflow-management/content/ch_wfm_basics.html. It's available as an Ambari View in HDP 2.6.

bandalora · ‎05-16-2017

The Data Movement and Integration guide might answer some of your questions. In particular, Chapter 5 "Considerations for Using Falcon" and the Important Considerations in Chapter 10, "Mirroring Data with HiveDR in a Secure Environment".

bandalora · ‎05-16-2017

You might check the Data Movement and Integration guide to see if it helps. In particular, chapter 7 "Creating Falcon Entity Definitions".

bandalora · ‎05-10-2017

Currently, you can only deploy HDP components, including Sqoop and Flume, on HDP.

bandalora · ‎05-08-2017

You can find some information in the HDF docs, like this topic on using Sqoop. Also, Flume is deprecated in HDP 2.6 and is being removed in HDP 3.0. See the Release Notes. And here's another topic you might want to check out: HDP and Component Information.

bandalora · ‎04-26-2017

If you are an existing HDP customer, please reach out to your account team and we can share more details.

bandalora · ‎04-26-2017

Did you configure Falcon for HA according to these instructions?

bandalora · ‎04-12-2017

@vsairam, do you know if the original and the secondary errors mentioned above are both still applicable to WFM in Ambari 2.5.0.3 but with HDP 2.6? I'm guessing they are, but want to confirm. Thanks.

bandalora · ‎04-06-2017

@mayki wogno, not sure if it's the problem, but did you set up the HDFS proxy user? http://docs.hortonworks.com/HDPDocuments/Ambari-2.5.0.3/bk_ambari-views/content/configure_cluster_wfm_view.html

bandalora · ‎04-05-2017

@Michael DeGuzis, I'm unaware of a list like that for non-Windows HDP documentation. However, we can take a look at that older list and see if it's feasible to provide an updated version in the future. Thanks for the suggestion!

bandalora · ‎04-03-2017

@Alex Woolford, Did you configure Kerberos for WFM? http://docs.hortonworks.com/HDPDocuments/Ambari-2.5.0.3/bk_ambari-views/content/wfm-kerberos-setup.html Also, ensure you completed other configuration requirements: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_workflow-management/content/config_wfm_view.html

bandalora · ‎03-29-2017

@shashi cheppela, curious if you were able to resolve this and, if so, what you did? Thanks.

bandalora · ‎03-27-2017

Although HiveDR might work on HDP 2.5.0, HDP 2.5.3 or higher is recommended, due to updates and bug fixes. There are also some considerations when using HiveDR with Falcon. See Considerations for Using Falcon and Mirroring Data with HiveDR in a Secure Environment.

bandalora · ‎03-27-2017

HiveDR requires HDP 2.5.3 or higher. See Considerations for Using Falcon and Mirroring Data with HiveDR in a Secure Environment.

bandalora · ‎03-27-2017

The JAR is free. If you run the command in step 1 in this article, it'll download the necessary file for you. Or you can go to http://search.maven.org/remotecontent?filepath=com/sleepycat/je/5.0.73/je-5.0.73.jar and download it from there.

bandalora · ‎03-24-2017

@ksuresh, thanks for posting your resolution. I work on the Sqoop documentation and will look into whether we need to add a comment about removing other jars from /lib.

bandalora · ‎03-22-2017

@Ward Bekker, why does that component have to be removed?

bandalora · ‎03-16-2017

When upgrading to HDP 2.5 or later with Falcon, you might encounter the following error when starting the ActiveMQ server:  ERROR - [main:] ~ Failed to start ActiveMQ JMS Message Broker. Reason: java.lang.NegativeArraySizeException (BrokerService:528) You might also encounter this error if downgrading Falcon from HDP 2.5 to an earlier release. If you encounter this error, delete the ActiveMQ history and then restart Falcon. If you want to retain the history, be sure to back up the ActiveMQ history prior to deleting it.  cd <ACTIVEMQ_DATA_DIR> rm -rf ./localhost cd /usr/hdp/current/falcon-server  su -l <FALCON_USER>    ./bin/falcon-stop  ./bin/falcon-start

bandalora · ‎03-15-2017

As mentioned by Namit, do be sure to follow the Prerequisite instructions under https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-movement-and-integration/content/ch_falcon_install_upgrade.html before reinstalling. If you encounter any issues with these instructions, please let me know.

bandalora · ‎03-09-2017

It looks like your staging directory (/apps/falcon/primaryCluster/staging) permissions are 755. Try setting to 777. That's the recommended setting for /staging. Don't know if it'll help, but something to try in the interim. From HWX doc: "Falcon stores artifacts of processes and feeds, such as the feed and process definitions and job logs, in /staging. When you schedule an entity, the workflow and library you specify in the entity are copied to the staging path."

bandalora · ‎03-07-2017

You might see if these docs help: http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-views/content/ch_using_falcon_view.html and http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-movement-and-integration/content/index.html.

bandalora · ‎03-07-2017

See if these docs help: http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-views/content/ch_using_falcon_view.html and http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-movement-and-integration/content/index.html.

bandalora · ‎03-07-2017

Check the documentation at http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-movement-and-integration/content/index.html. There's additional information in the guide. In particular, see "Locating and Managing Entities" in ch 11 and "Falcon logs" in ch 15.

bandalora · ‎03-02-2017

Also, maybe this article could be useful: https://community.hortonworks.com/articles/80301/spark-configuration-and-best-practice-advice.html

Online	Offline
Last Visited	‎12-13-2018 12:17 PM

Date Registered	‎03-25-2016 08:19 PM
Last Visited	‎12-13-2018 12:17 PM
Total Messages Posted	66
Total Kudos Received	21

Re: unable to access Workflow Manager view on kerb...

Re: Flume 1.6 in HDP?

Re: How do I set up Pig to use HCatalog?

Re: Does Apache Atlas(Version 0.5) would able to c...

Re: What is active and passive NameNode in Hadoop?

Re: What is active and passive NameNode in Hadoop?

Re: Cannot run program "hive": error=2, by using O...

Re: Spark action for oozie in HDP 2.5.0

Re: Is there anyway to run multiple oozie jobs in ...

Re: Oozie error when using with Hive2

Re: Should I schedule processes using Zeppelin or ...

Re: Falcon Cluster Sync

Re: Regarding creation of falcon data pipeline

Re: sqoop in HDF

Re: sqoop in HDF

Re: Apache Falcon in HDP 3.0

Re: Falcon feed throwing an error during feed sche...

Re: AMBARI : WORKFLOW MANAGER : Can't initialize d...

Re: configure workflow manager and oozie to workin...

Re: Configuration file documentation?

Re: unable to access Workflow Manager view on kerb...

Re: How to use S3 bucket as target locaiton for da...

Re: Hive Disaster Recovery using Falcon

Re: Falcon job running on source instead of target

Re: Falcon UI Inaccessible--Required Prerequisite ...

Re: Sqoop import of Avro file from Teradata to hd...

Re: Oozie restart fails after upgrading ambari to...

Falcon Upgrade/Downgrade Issue with ActiveMQ

Re: Uninstall Falcon

Re: FALCON HDFS Mirroring not working

Re: FALCON HDFS Mirroring not working

Re: HBASE/FALCON replication

Re: Falcon hdfs mirroring not working

Re: Spark Performance Tuning