Make sure that /tmp is not mounted with noexec option on the host where spark2 history is failing.  #mount -v  #df -h /tmp ... View more

Check the config property hadoop.http.authentication.type, if this is set to kerberos , then accessing UIs would need kerberos credentials on client. By default this is et to kerberos in HDP 3.x version when cluster is kerberized.    If you want to disable kerberos auth then change below config properties.  ->  Ambari > HDFS> Configs> in core-site hadoop.http.authentication.type=simple hadoop.http.authentication.simple.anonymous.allowed=true ... View more

@Sundar Lakshmanan Try sort with delimiter # ls -1 | sort -t '_' -nk3 # ls -1 | sort -t '_' -nk3 abcd_1_20180703 abcd_2_20180703 abcd_3_20180703 abcd_4_20180703 abcd_5_20180703 abcd_6_20180703 abcd_1_20180704 abcd_2_20180704 abcd_3_20180704 abcd_4_20180704 abcd_5_20180704 abcd_6_20180704 #cat test.out | sort -t '_' -nk3 ... View more

@Haaris Khan In Zeppelin 0.7, HDP2.6 we have new LdapRealm, that allows to specify search filter. With the search filter we can restrict login based on groups. Below is one such example I tested in my lab. Please note that this works only in HDP2.6 or zeppelin 0.7 and above. In HDP2.5 this was not possible because active directory realm was based on UserPrincipalName attribute and there was no way to filter the users based on groups so login cannot be restricted, but with Authorization(as mentioned by @Vipin Rathor you can restrict the users accessing specific urls based on group role map) [main] ldapADGCRealm = org.apache.zeppelin.realm.LdapRealm ldapADGCRealm.contextFactory.systemUsername = hadoopadmin@lab.hortonworks.net ldapADGCRealm.contextFactory.systemPassword = <Password> ldapADGCRealm.searchBase = "dc=lab,dc=hortonworks,dc=net" ldapADGCRealm.userSearchBase = "dc=lab,dc=hortonworks,dc=net" ldapADGCRealm.userSearchFilter=(&(objectclass=user)(sAMAccountName={0})(|(memberOf=CN=hr,OU=CorpUsers,DC=lab,DC=hortonworks,DC=net)(memberOf=CN=hadoop-admins,OU=CorpUsers,DC=lab,DC=hortonworks,DC=net)(memberOf=CN=sales,OU=CorpUsers,DC=lab,DC=hortonworks,DC=net))) ldapADGCRealm.contextFactory.url = ldap://LdapServer:389 #ldapADGCRealm.userSearchAttributeName = sAMAccountName ldapADGCRealm.contextFactory.authenticationMechanism = simple #ldapADGCRealm.userObjectClass = user ldapADGCRealm.groupObjectClass = group ldapADGCRealm.memberAttribute = member sessionManager = org.apache.shiro.web.session.mgt.DefaultWebSessionManager securityManager.sessionManager = $sessionManager securityManager.sessionManager.globalSessionTimeout = 86400000 shiro.loginUrl = /api/login ... View more

@Daniel Kozlowski Install EPEL repo and try the installation again. Required dependencies for R-devel are available in epel repo. # yum install -y epel-release #yum install R-devel libcurl-devel openssl-devel Note that you need internet connectivity to allow connection for epel repo. ... View more