Member since
02-29-2016
108
Posts
213
Kudos Received
14
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2009 | 08-18-2017 02:09 PM | |
3508 | 06-16-2017 08:04 PM | |
3250 | 01-20-2017 03:36 AM | |
8807 | 01-04-2017 03:06 AM | |
4395 | 12-09-2016 08:27 PM |
08-24-2016
08:44 PM
2 Kudos
Just took it last month and the exam is based off Spark 1.x. There is no limit about how you should solve the problem, so RDD, dataframe, spark SQL all could be used depends on which you feel comfortable with.
... View more
08-24-2016
08:21 PM
2 Kudos
For maintenance mode, you could always tun off the maintenance mode and enable the service manually. Some of the components are best left off when you don't really need them because some of them are really resource hogs. Generally, HDFS, MapReduce2, YARN and Hive should be green the makes most things working.
... View more
08-24-2016
08:18 PM
3 Kudos
Also make sure you Ambari server is running ambari-server status
... View more
08-24-2016
08:15 PM
2 Kudos
after start the sandbox run the following to check the status of Ambari. If any of them is not running, start it again and you should be fine ambari-agent status
ambari-server status
ambari-server start
ambari-server start
... View more
08-24-2016
04:38 PM
2 Kudos
Look like the keyless ssh is not setup properly, check the document at http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.0/bk_Installing_HDP_AMB/content/_set_up_password-less_ssh.html Or install Ambari agent manually
... View more
08-24-2016
04:24 PM
3 Kudos
You are looking at the document to setup RM HA manually, which is a very involved process. You want to use the Ambari UI instead to achieve the same goal with much less effort. The following is the instruction on doing it in Ambari. I have done this many time and should not take you more than 10 minutes. After that, you could go back and check all the conf files to understand what has been changed. http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.0/bk_Ambari_Users_Guide/content/_resource_manager_high_availability.html
... View more
08-08-2016
02:21 AM
I download the HDP2.5 TP Sandbox in early July. Not sure if there is newer version out after that.
... View more
08-05-2016
06:33 PM
I always got "Unable to connect to Audit store !!" error in Audit=>Access tab. Nothing in that tab
... View more
08-05-2016
01:54 AM
2 Kudos
I tried to follow the tutorial on the tag based policy in Atlas, but can't seem to make it work. Actually the tutorial itself seems to be misleading with the tag based policy. In part 4, although it looks like the access is granted through the tag based policy by excluding admin user in deny access, it is not. Even I disable that tag based policy in Ranger, the access for admin user is still there. It is because the original 2 resource based policies are enabled which grant admin user all access. So with or without the tag based policy, the admin use always has access to the hive table. I also tried is to modify the tag based policy in the tutorial so it blocks access for admin user by put the following in the deny conditions. And admin use still has access Select Group – none
Select User – admin
Component Permission – Hive – Select
You can select the component permission through this popup: All resourced based policy worked as expected and the problem only exist with tag related policy. After some digging in Ranger audit, it seems that when tag related policy is created/changed, they were not synced to plug in, not sure if that is the reason behind the failure You can see the sync only happened with resource based policies
... View more
Labels:
- Labels:
-
Apache Atlas
-
Apache Ranger
07-22-2016
09:11 PM
2 Kudos
Could you filter the empty string before the group? df.where(df("number") !== "").groupBy($"id").agg(concat_ws(DELIM, collect_list($"num")))
... View more