Member since
03-25-2016
66
Posts
21
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
645 | 04-03-2017 06:55 PM | |
539 | 09-07-2016 06:18 PM | |
510 | 07-16-2016 12:34 AM | |
204 | 05-18-2016 07:17 PM |
02-07-2018
06:45 PM
Also check out info on the standby NameNode: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_hdfs-administration/content/get_ready_to_backup.html
... View more
02-07-2018
06:36 PM
The passive NameNode can be used in high availability configurations, to prevent single point of failure: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_hadoop-high-availability/content/ch_HA-NameNode.html.
... View more
06-12-2017
08:59 PM
Are there any error messages in your log files? Also, in the meantime, you might verify that you have a JDBC driver in /user/oozie/share/lib/lib_<timestamp>/sqoop.
... View more
05-24-2017
06:14 PM
@Lucky_Luke Falcon on HDP 2.5.0 does support Spark actions. See the Data Movement & Integration guide for info. However, Falcon has been deprecated in HDP 2.6 and will be removed in HDP 3.0.
... View more
05-19-2017
06:25 PM
@Saumidh Mhatre And FYI, most actions are asynchronous, so one has to end before the next begins, which you mention you want to happen. For a list of some of the actions available and which are synchronous vs asynchronous, see the Workflow Action Types table in the Workflow Management (WFM) guide (the table applies even if you aren't using WFM, as WFM is based on Oozie).
... View more
05-18-2017
08:01 PM
A couple of things you might try: * Set oozie.use.system.libpath=true in the job.properties file and ensure you have the proper jars in sharelib. * Add the Hive settings file to the workflow.xml, such as <job-xml>hive-site.xml</job-xml>.
... View more
05-17-2017
08:51 PM
1 Kudo
Also, the documentation for Workflow Manager is available at http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_workflow-management/content/ch_wfm_basics.html. It's available as an Ambari View in HDP 2.6.
... View more
05-16-2017
08:14 PM
The Data Movement and Integration guide might answer some of your questions. In particular, Chapter 5 "Considerations for Using Falcon" and the Important Considerations in Chapter 10, "Mirroring Data with HiveDR in a
Secure Environment".
... View more
05-16-2017
08:11 PM
You might check the Data Movement and Integration guide to see if it helps. In particular, chapter 7 "Creating Falcon Entity Definitions".
... View more
05-10-2017
02:54 PM
Currently, you can only deploy HDP components, including Sqoop and Flume, on HDP.
... View more
05-08-2017
07:57 PM
2 Kudos
You can find some information in the HDF docs, like this topic on using Sqoop. Also, Flume is deprecated in HDP 2.6 and is being removed in HDP 3.0. See the Release Notes. And here's another topic you might want to check out: HDP and Component Information.
... View more
04-26-2017
01:19 AM
If you are an existing HDP customer, please reach out to your account team and we can share more details.
... View more
04-26-2017
01:15 AM
Did you configure Falcon for HA according to these instructions?
... View more
04-12-2017
04:40 AM
@vsairam, do you know if the original and the secondary errors mentioned above are both still applicable to WFM in Ambari 2.5.0.3 but with HDP 2.6? I'm guessing they are, but want to confirm. Thanks.
... View more
04-06-2017
06:20 PM
@mayki wogno, not sure if it's the problem, but did you set up the HDFS proxy user? http://docs.hortonworks.com/HDPDocuments/Ambari-2.5.0.3/bk_ambari-views/content/configure_cluster_wfm_view.html
... View more
04-05-2017
12:09 AM
@Michael DeGuzis, I'm unaware of a list like that for non-Windows HDP documentation. However, we can take a look at that older list and see if it's feasible to provide an updated version in the future. Thanks for the suggestion!
... View more
04-03-2017
06:55 PM
1 Kudo
@Alex Woolford, Did you configure Kerberos for WFM? http://docs.hortonworks.com/HDPDocuments/Ambari-2.5.0.3/bk_ambari-views/content/wfm-kerberos-setup.html Also, ensure you completed other configuration requirements: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_workflow-management/content/config_wfm_view.html
... View more
03-29-2017
06:19 PM
@shashi cheppela, curious if you were able to resolve this and, if so, what you did? Thanks.
... View more
03-27-2017
07:33 PM
Although HiveDR might work on HDP 2.5.0, HDP 2.5.3 or higher is recommended, due to updates and bug fixes. There are also some considerations when using HiveDR with Falcon. See Considerations for Using Falcon and Mirroring Data with HiveDR in a Secure Environment.
... View more
03-27-2017
07:31 PM
HiveDR requires HDP 2.5.3 or higher. See Considerations for Using Falcon and Mirroring Data with HiveDR in a Secure Environment.
... View more
03-27-2017
02:42 AM
The JAR is free. If you run the command in step 1 in this article, it'll download the necessary file for you. Or you can go to http://search.maven.org/remotecontent?filepath=com/sleepycat/je/5.0.73/je-5.0.73.jar and download it from there.
... View more
03-24-2017
04:22 PM
@ksuresh, thanks for posting your resolution. I work on the Sqoop documentation and will look into whether we need to add a comment about removing other jars from /lib.
... View more
03-22-2017
06:31 PM
@Ward Bekker, why does that component have to be removed?
... View more
03-16-2017
12:40 AM
When upgrading to HDP 2.5 or later with Falcon, you might encounter the following error when starting the ActiveMQ server:
ERROR - [main:] ~ Failed to start ActiveMQ JMS Message Broker. Reason: java.lang.NegativeArraySizeException (BrokerService:528) You might also encounter this error if downgrading Falcon from HDP 2.5 to an earlier release. If you encounter this error, delete the ActiveMQ history and then restart Falcon. If you want to retain the history, be sure to back up the ActiveMQ history prior to deleting it.
cd <ACTIVEMQ_DATA_DIR>
rm -rf ./localhost cd /usr/hdp/current/falcon-server
su -l <FALCON_USER>
./bin/falcon-stop
./bin/falcon-start
... View more
- Find more articles tagged with:
- downgrade
- Falcon
- Governance & Lifecycle
- Issue Resolution
- issue-resolution
- jms
- upgrade
Labels:
03-15-2017
08:57 PM
As mentioned by Namit, do be sure to follow the Prerequisite instructions under https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-movement-and-integration/content/ch_falcon_install_upgrade.html before reinstalling. If you encounter any issues with these instructions, please let me know.
... View more
03-09-2017
07:07 PM
It looks like your staging directory (/apps/falcon/primaryCluster/staging) permissions are 755. Try setting to 777. That's the recommended setting for /staging. Don't know if it'll help, but something to try in the interim. From HWX doc: "Falcon stores artifacts of processes and feeds, such as the feed and process definitions and job logs, in /staging. When you schedule an entity, the workflow and library you specify in the entity are copied to the staging path."
... View more
03-07-2017
07:18 PM
You might see if these docs help: http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-views/content/ch_using_falcon_view.html and http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-movement-and-integration/content/index.html.
... View more
03-07-2017
07:14 PM
See if these docs help: http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-views/content/ch_using_falcon_view.html and http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-movement-and-integration/content/index.html.
... View more
03-07-2017
06:42 PM
Check the documentation at http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-movement-and-integration/content/index.html. There's additional information in the guide. In particular, see "Locating and Managing Entities" in ch 11 and "Falcon logs" in ch 15.
... View more
03-02-2017
10:44 PM
Also, maybe this article could be useful: https://community.hortonworks.com/articles/80301/spark-configuration-and-best-practice-advice.html
... View more