Member since
09-18-2015
3274
Posts
1159
Kudos Received
426
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2557 | 11-01-2016 05:43 PM | |
| 8474 | 11-01-2016 05:36 PM | |
| 4848 | 07-01-2016 03:20 PM | |
| 8166 | 05-25-2016 11:36 AM | |
| 4311 | 05-24-2016 05:27 PM |
10-29-2015
09:11 PM
1 Kudo
@Chris Nauroth Chris, It's completely based on the business requirement. Personally, I don't suggest for HTTP auth to my customer because compliance requirement requires minimum 2 factor authentication. Logging into Ambari using LDAP/AD credentials and then Kerberos takes care of it. Setting up HTTP auth for each web ui adds more work for admin/users to access web pages ( definitely not strong reason for not setting it up)
... View more
10-29-2015
08:36 PM
@jeden@hortonworks.com Thanks for asking this question. I could not find any specific docs and looks like it's straight forward from Ambari end ( as you said it already) Under Yarn --> Config ( 2 features, Node label and Pre-emption - not relevant to this question) Link enable label - yarn.node-labels.enabled Doc mentioned to configure root-dir to HDFS but ambari has above location by default. We can follow the manual guide once enabling the labels through Ambari (Based on my testing in lab)
... View more
10-29-2015
08:10 PM
This is applicable to Hive only. Non-Hive/Yarn jobs will be coming from users running the job. @hrongali@hortonworks.com
... View more
10-29-2015
07:54 PM
@Sean Roberts #5 I hope this helps HS2 should support .hiverc Global Init File A global init file can be placed in the configured hive.server2.global.init.file.location location (Hive 0.14 onward, see HIVE-5160, HIVE-7497, and HIVE-8138). This can be either the path to the init file itself, or a directory where an init file named ".hiverc" is expected. The init file lists a set of commands that will run for users of this HiveServer2 instance, such as register a standard set of jars and functions.
... View more
10-29-2015
07:27 PM
3 Kudos
Set enable.doAs to "False"...This is really good explanation Link When set to "false," the Hive user identity is used instead of
the individual user identities for YARN. This setting enhances security and reuse:
hive.server2.enable.doAs=false Note
When doAs is set to false, queries execute as the Hive user and not the end
user. When multiple queries run as the Hive user, they can share resources.
Otherwise, YARN does not allow resources to be shared across different users.
When the Hive user executes all of the queries, a Tez session opened for one
query and is holding onto resources can use those resources for the next query
without re-allocation.
... View more
10-29-2015
06:38 PM
@Wes Floyd Infrastructure monitoring tools plays key role here. Regarding, Performance Just found this usefule Blog Modern servers have a lot of disks. What’s the impact of losing a single disk when you have 12 3TB drive in each node? A: When a single drive fails when Hadoop is configured in its default state, the ENTIRE NODE gets taken offline. Back when servers typically had 6 x 1.5TB drives in them, losing a single disk would cause the loss of 0.02% of total storage in a typical 10PB, three-replica setup. With today’s hardware — typically 12 x 3TB drives per node, losing a single disk results in the loss of five times as much data.
... View more
10-29-2015
02:44 PM
@Alex Miller I doubt that you will find the exact answer of this. This is good starting point and based on your use case , you can gather more data.
... View more
10-29-2015
02:09 PM
4 Kudos
Looking for cmparison matrix for Zeppelin vs IPython notebook(Jupyter)
... View more
Labels:
10-29-2015
12:09 PM
@ravi@hortonworks.com This may not be relevant but sharing in case it rings bell for new ideas link As you mentioned already, I am going to rephrase with more words/context Errors - Critical alert, Sev1 Warning - Sev2 Info: Sev4 This is good repo
... View more
10-29-2015
10:19 AM
I agree. I am trying to reach out to the contributors on that thread. I found this article Let me know if that helps to being with the customization on compression. @ravi@hortonworks.com
... View more