Member since
05-09-2016
421
Posts
54
Kudos Received
32
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2575 | 04-22-2022 11:31 AM | |
2364 | 01-20-2022 11:24 AM | |
2190 | 11-23-2021 12:53 PM | |
2917 | 02-07-2018 12:18 AM | |
4792 | 06-08-2017 09:13 AM |
03-31-2017
02:54 PM
3 Kudos
@Sandeep Nemuri Looks like you are hitting ATLAS-1403. This is fixed in next patch release of HDP-2.5.
... View more
03-31-2017
10:12 AM
No, it is not cumpulsory to have kerberos before installing Ranger/Ranger KMS
... View more
03-31-2017
09:53 AM
3 Kudos
@rahul gulati Please find below your answers: 1) Can i use the same PostgreSQL DB for creating ranger Audit and Policy DB's? Yes you can. However audit to DB has been removed so essentially db will be used for policy only. 2) I already have Ambari Infra installed on Cluster? Do i need to use URL as http://solr_host:6083/solr/ranger_audits? where solr_host will be the hostname of machine where Ambari Metrics is installed? Solr URL will be host where Ambari Infra is installed. 3) Do we need to setup Knox with kerberos before installing Ranger or can it be done later as well? Any help would be appreciated? Can you please share more details on this? Do you see any document to setup Knox with kerberos?
... View more
03-21-2017
05:43 PM
Check /var/log/hive/hivemetastore.out as well.
... View more
03-21-2017
09:46 AM
SYMPTOM
Concurrency issues hit during multi-threaded moveFile issued when processing queries such as "INSERT OVERWRITE TABLE ... SELECT .."
The following pattern is displayed in stack trace: Loading data to table testdb.test_table from hdfs://xyz/ra_hadoop/.hive-staging_hive_2017-01-31_14-09-52_561_8101886747064006778-4/-ext-10000
ERROR : Failed with exception java.util.ConcurrentModificationException
org.apache.hadoop.hive.ql.metadata.HiveException: java.util.ConcurrentModificationException
at org.apache.hadoop.hive.ql.metadata.Hive.moveFile(Hive.java:2883)
at org.apache.hadoop.hive.ql.metadata.Hive.replaceFiles(Hive.java:3140)
at org.apache.hadoop.hive.ql.metadata.Hive.loadTable(Hive.java:1727)
at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:353)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:89)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1745)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1491)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1289)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1156)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1151) ROOT CAUSE This issue occurs because of issue described in HIVE-15355.
WORKAROUND
Set the following property at the client side: set hive.mv.files.thread=0;
Re-run the hive query Note: The fix for HIVE-15355 is expected to be included in the next major release of HDP.
... View more
03-20-2017
05:05 PM
I have seen apache jira which says 2 way ssl should not be required for ranger if using kerberos. Has this been added in Hortonworks release? RANGER-1094
... View more
Labels:
- Labels:
-
Apache Ranger
03-20-2017
05:00 PM
@krajguru You can't run MR or Tez jobs using the REST API. The YARN REST API is meant for developers of applications such as Distributed shell, MR and Tez, not for users who submit applications. However for spark jobs on yarn REST api can be used as given here. https://community.hortonworks.com/articles/28070/starting-spark-jobs-directly-via-yarn-rest-api.html
... View more
03-17-2017
01:58 PM
1 Kudo
@Jan Horton Yes, you can install both at the same time without any problem. Spark 2.0 is TP as of HDP 2.5.3 and not recommended for production use, however you are welcome to use it for study.
... View more
01-04-2017
08:30 PM
@Anandha L Ranganathan Please upvote and accept the answer to close the thread.
... View more
01-04-2017
07:13 PM
@Anandha L Ranganathan Installation directory is /usr/hdp/<version> Inside /usr/hdp/current it should have symlink to /usr/hdp/<version>/ranger Please check for broken symlink as well. Also share output of hdp-select command.
... View more