Member since
03-03-2016
28
Posts
13
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
4450 | 08-04-2016 08:54 PM |
07-06-2017
06:39 PM
@Scott Shaw Thanks for alerting me! I've fixed this, and I think everything should be in order now. Please let me know if you find anything else askew.
... View more
07-06-2017
03:17 AM
1 Kudo
So I might be late in posting this article, but I want to publicize the changes in HDP 2.6.0 documentation and blog postings for Hive, Hive Views, and Ambari that were released in early April 2017. After all, I don't think all of you out there are upgraded to HDP 2.6.0 yet. To complement the G.A. release of Hive low-latency analytical processing (LLAP), the "Hive Performance Tuning Guide" has been completely rewritten to focus on how to optimize your environment and queries for interactive processing. While the guide is tailored to run a Hive data warehouse on the Tez framework, the new edition still has relevant tips and links to information for users who do batch processing on a MapReduce framework. A couple of LLAP blogs to consider reading are "Fast Analytics in the Cloud with Hive LLAP" and "Top 5 Performance Boosters with Apache Hive LLAP". Important debugging and optimization tools to get the most out of your Hive queries and your architecture are documented in Hive View 2.0 and Tez View, both of which introduce improvements over earlier versions of Ambari Views. You might also want to check out the "3 Great Reasons to Try Apache Hive View 2.0" blog. SQL-standard ACID MERGE support in HDP 2.6 raises the bar for Hive transactional data management by adding a helpful capability to ACID tables in HDP Hive, which already had supported record-level INSERT, UPDATE, and DELETE operations within tables. The current plan is to expand the documentation to include a step-by-step procedure for creating an ACID table with Apache Ambari. In the meantime, a good overview of why to use this functionality is in the "Apache Hive: Moving Beyond Analytics Offload with SQL MERGE" blog.
... View more
Labels:
06-29-2017
07:41 PM
The Set Up Apache HBase Configuration Files section of the HDP Command-Line Installation Guide might be of some help. Some of the properties related to RegionServers are documented there.
... View more
06-23-2017
10:01 PM
1 Kudo
If you are using Hive from HDP 2.6.0 or later, you might get help understanding the query execution by using the visual explain plan feature in Hive Views 2.0 of Ambari. Open the Query Tab documentation of the Ambari Views Guide, and search for the "Visual Explain Plan" section.
... View more
06-12-2017
10:05 PM
Here is another link that might help: Using Tez View. This link goes to the the documentation about Tez View, a graphical UI in Ambari that can help you debug and optimize Hive queries that are run on a Tez framework.
... View more
03-16-2017
06:40 PM
A tip that's related to the Phoenix Query Server because a lot of people ask about how to make Phoenix as a whole active: You need to enable Phoenix after installing it, which you do easily in Ambari. See Enabling Phoenix and Interdependent Components in the Data Access Guide for HDP 2.5.3.
... View more
02-02-2017
07:44 PM
@Anika S Yes, as Binu said, the Tez View of Ambari can help you analyze and troubleshoot Hive queries if you are running on a Tez execution engine. Here are some resources to help guide you: For a quick overview of what Tez View can do, see How to Analyze or Debug Hive Queries. For how to set up Tez View after you have Ambari up-and-running and details about understanding the visualizations (such as DAGs) in the Tez View, see Using Tez View and Hive High Performance Best Practices.
... View more
01-03-2017
07:34 PM
Great tip. For people new to the Tez lexicon:
AM = application master
DAG = directed acyclic graph
... View more
11-03-2016
07:23 PM
2 Kudos
Perhaps the method documented in the following link can help you, though I think you are searching for a more automated method: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_data-access/content/ch_managing-hbase.html#hbase-snapshots
... View more
09-13-2016
01:08 AM
4 Kudos
Hortonworks Data Platform 2.5 enhances your data access experience by redesigning and centralizing data access content, including providing you with content roadmaps for Apache Hive and Apache HBase. These content roadmaps help you find your way through the wider HDP and Apache libraries, with links to relevant sites and topics based on your task. Working with Hive? You might want to try the technical preview of Interactive and Sub-Second SQL Queries through LLAP. HDP 2.5 also includes improved security through row-level filtering and column masking. And by default, the Hive View now supports a JDBC connection. HBase users, you can now backup and restore datasets that run on production clusters by performing a single full backup and then capturing incremental changes to the dataset. HDP 2.5 also provides HBase Medium Object (MOB) Storage support. Using Apache Phoenix? HDP 2.5 supports Apache Phoenix version 4.7 including improved integration of HBase and Phoenix namespaces. And you can configure Phoenix Storage Handlers so that Hive queries can be run on Phoenix data. The newest version of HDP also helps users who want a more lightweight client for developing and running applications with Phoenix. The distro supports more Phoenix Query Server client driver options. To help secure your data application environment, you can enable native Kerberos authentication in the query server. Check out these updates and more in the HDP Data Access content and leave us some feedback in HCC!
... View more
Labels: