Member since
04-13-2016
422
Posts
150
Kudos Received
55
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1863 | 05-23-2018 05:29 AM | |
4871 | 05-08-2018 03:06 AM | |
1630 | 02-09-2018 02:22 AM | |
2637 | 01-24-2018 08:37 PM | |
6059 | 01-24-2018 05:43 PM |
07-16-2018
11:33 AM
Guys there is challenge I am facing .. when I am running the snapshotdiff from a remote cluster it is failing with snapshot not found error even though it is available .. do we have any solution for this .. we built a DR cluster and running distcp from DR to utilize the DR resources instead of overloading the PROD .. any solution how this can be achived..
... View more
06-02-2017
08:14 PM
Unfortunately, spark is limited in terms of sqlstandard authorization.
Spark isn't designed to work with hive sqlstandard authorizations due to which creating a table isn't creating default grants. Here are two related JIRA's that mention the same.
https://issues.apache.org/jira/browse/SPARK-8321 https://issues.apache.org/jira/browse/SPARK-12008 You may create the necessary grants after table creation or
Rely on storage based authorization i.e hdfs permissions for authorizations or
use Ranger for hive authorizations .
... View more
03-23-2017
04:37 PM
@Kent Brodie
Great to hear that your issue is resolved. It will be wonderful if you can mark the answer of this thread as "Accepted" so that it will be useful for community.
... View more
03-16-2017
01:52 AM
@Jay SenSharma We have blocked Hive CLI due to security reasons, do you have something similar for beeline ?
... View more
02-01-2017
07:21 AM
In addition to the above, we can have HBase on S3 instead of HDFS, but for that we must use emrfs implementation. Keeping it simple, use EMR 5.2 and greater versions. But, still Namenode is mandatory.
... View more
11-18-2016
09:02 PM
3 Kudos
@SBandaru Suppose you have two Namenodes A and B. A is active and B is Standby --> If you restart Namenode A, ZKFC(Zookeeper failover controller) will detect that Namenode A is not reachable(When daemon is restarting), fencing will happen and Namenode B will be active NN. --- B is active and A is Standby --> If you restart both the Namenodes, whichever comes up first and respond to ZKFC will become active and ultimately another one will become standby. --- Now both Namenode thinks that they are active and sends write request to quorum journal manager with their epoc number, how QJM handles this situation? Quorum journal manager stores epoc number locally which called as promised epoc. Whenever JournalNode receives RPC request along with epoc number from Namenode, it compares the epoch number with promised epoch. If request is coming from newer node which means epoc number is greater than promised epoc then itrecords new epoc number as promised epoc. If the request is coming from Namenode with older epoc number, then QJM simply rejects the request. Please refer - https://community.hortonworks.com/articles/27225/how-qjm-works-in-namenode-ha.html for more details about how QJM works. Hope this information helps! 🙂
... View more
11-22-2016
04:52 PM
1 Kudo
Yes, there was some messaging early this year (that it seems the Spring folks replicated on their site) which indicated a change in the certification program, but it was determined that the planned changes were being released too fast and did not give enough time for folks already preparing for the existing certification exams to complete them. It is imaginable that the certification program will continue to evolve, but our intention is to ensure adequate time to adjust will be offered whenever any future plans are introduced. Good luck on the HDPCD exam!
... View more