Member since
01-18-2016
169
Posts
32
Kudos Received
21
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1003 | 06-27-2025 06:00 AM | |
1121 | 01-14-2025 06:30 PM | |
1784 | 04-06-2018 09:24 PM | |
1866 | 05-02-2017 10:43 PM | |
4953 | 01-24-2017 08:21 PM |
05-26-2017
04:09 PM
1 Kudo
Ambari 2.5.0.3 complains about openblas-Rblas x86_64 0.2.19-4.el7 installed when installing HDP 2.6. This was in the checks done during service installation. What version of R is HDP happy with? If we remove openblasRblas, it will also remove R 3.3.3 and we want to replace it with the correct version.
... View more
Labels:
05-24-2017
02:36 AM
@Michael Szymczak - thanks for the reply and I'm sorry it's taken so long to get back to reply. We are a Centrify customer. I am wondering if it is possible to install HDP via Ambari if if accounts are pre-created in AD/Centrify (without any of them pre-existing or being added to /etc/password or /etc/shadow during installation). We would prefer to avoid any resemblance of a local account (or groups). This cluster will eventually be secured/kerberized which I have done numerous times with AD. However, I have always used some form of locally defined accounts and groups. The options Ambari offers (above) sounds like it will use accounts as long as it can get an the id and groups exist.
... View more
05-19-2017
02:39 PM
In Ambari 2.5.0.3 I noticed the following options under "Misc" when I want to specify an custom service account name:
Skip group modifications Have Ambari manage UIDs Whether to skip creating users and groups in a sysprepped cluster Previously I only remember seeing "Skip group modifications", but may be the UID option was there. The last option definitely seems new to me. Anyway, is there documentation or an HCC article explaining exactly what these do and when I would want them? I can take a guess based on the names, but it would be nice to have a clear understanding. Our present need is to have service accounts and groups pre-created in AD/Centrify and I assume not defined on the local OS at all. In this case it seems like checking all three options would be safe, but option 3 seems like it might imply options 1 and 2 are selected. I would like advice on how to proceed with my current scenario, but any additional insight into what these actually do is appreciated. Thanks. Incidentally, for those that care - you can set these three options above in blueprints. See my previous question: https://community.hortonworks.com/questions/103647/how-to-use-blueprints-with-pre-created-accounts-fo.html
... View more
Labels:
- Labels:
-
Apache Ambari
05-19-2017
02:06 PM
@Predrag Minovic Awesome! Thank you.
... View more
05-19-2017
03:28 AM
1 Kudo
Is there a way to use blueprints assuming we have pre-created service accounts (created in AD/Centrify), and if so, which I could use some help. I assume that in the blueprints I could add properties something like this: "spark_user" : "svcspark", "spark_group" : "svcspark" Part 1 of this question -- Will that cause Spark to run as svcspark? Also, related to this, I noticed there are now 3 options (checkboxes) in Ambari 2.5.0.3 which may relate to pre-created accounts. These are found under Misc when adding a service: Skip group modifications Have Ambari manage UIDs Whether to skip creating users and groups in a sysprepped cluster Part 2 of this question -- Can these be set in blueprints and if so, how? Our plan is to use blueprints but we need to create all service accounts in AD/Centrify before Ambari or services are installed. Thanks
... View more
Labels:
- Labels:
-
Apache Ambari
-
Hortonworks Cloudbreak
05-18-2017
10:25 PM
1 Kudo
@Michael Young Thanks! This is very well written. Straight forward, complete and I didn't find any mistakes or missing steps!
... View more
05-02-2017
10:43 PM
If you mean Solr on HDFS, the answer is "it depends." If you have a high number of frequent updates to your index, I usually recommend local storage. On the other hand, if your updates are more batch, and not a constant stream, then using HDFS is a convenient option. If you mean installing Solr on HDF, the only supported option and use case is installing Ambari Infra. The Ambari Infra component is Solr under the covers, but it is only supported for use with HDP and HDF components such as Ranger for User Audit records. There's no support to use Ambari Infra for indexing your own data.
... View more
02-24-2017
03:29 AM
@Tony Bolt It seems like the solr.hdfs.confdir is not being used. It's unlikely to be the problem, have you checked permissions?
... View more
02-03-2017
09:05 PM
@mqureshi made great points. Also, note that you do not have to store any fields in Solr. You can choose True for either or both: stored=true/false, indexed=true/false. Of course if stored=false, you won't see the value in results but you will at a minimum, see the "uniqueKey" which would be your "id" field. You could also look at the HBase Indexer: https://community.hortonworks.com/articles/1181/hbase-indexing-to-solr-with-hdp-search-in-hdp-%2023.html
... View more
01-24-2017
08:21 PM
2 Kudos
I have a solution.... We had this issue, caused by this: https://issues.apache.org/jira/browse/RANGER-1249 To fix it, create a file: /etc/ranger/admin/ranger-admin-env-tz.sh Add this: JAVA_OPTS="$JAVA_OPTS -Duser.timezone=UTC" Now chmod +x /etc/ranger/admin/ranger-admin-env-tz.sh Now restart ranger admin. I know this was asked long ago, but if this solves your problem (which it did for me), please accept the answer.
... View more