About pminovic

pminovic · ‎05-23-2016

Terribly sorry, haven't seen that comment. Then, DN couldn't detect your disk as failed.

pminovic · ‎05-23-2016

Can you check your setting for dfs.datanode.failed.volumes.tolerated in hdfs-site.xml? DN will shut itself down if the number of detected failed disks is larger than this setting. If you want DN to stop on a first failed disk, be sure to set this property to zero. Now, if it's already zero, something else could be wrong.

pminovic · ‎05-21-2016

Also tried to set authentication.ldap.pagination.enabled=false but to no avail. BTW, the LDAP is on AD.

pminovic · ‎05-21-2016

"ambari-server sync-ldap --users file" against an LDAP server with more than 10,000 users fails saying one of the users in the file is not there. When I do ldapsearch from the command line without filter, that user is not returned, because I guess LDAP server returns max of 2000 entities. When I do ldapsearch with a filter I can find him. How can I tell Ambari to do such search using a filter? ldapsearch returns distinguishedName: CN=user123456,OU=users,DC=example,DC=com For ldapsearch I provide "(CN=user123456)" as my filter. In setup-ldap I do like below, but it doesn't work. Any ideas. authentication.ldap.baseDn="OU=users,DC=example,DC=com" authentication.ldap.usernameAttribute=CN authentication.ldap.dnAttribute=distinguishedName authentication.ldap.userObjectClass=organizationalPerson ... have 4 classes listed: top,person,organizationlPerson, user; also tried user authentication.ldap.referral=ignore ... also tried follow When I try to sync with one of the users returned using ldapserach without filter it works.

pminovic · ‎05-21-2016

Knox supports such a use case by means of multiple topology files. However, Ambari supports only one single topology file, for the cluster managed by Ambari in which Knox is running as a service. For your requirements it's the best to install Knox stand-alone and configure it manually. It's an easy operation, you can find details here.

pminovic · ‎05-21-2016

In Knox, you can create two or more topology files, and specify different LDAP seraver in each of them. End users can select which LDAP server to use by specifying one of those file names in the Knox URL. Specifiying two or more LDAP or any other authentication providers in the same topology file is not supported, for more details see here. Ranger also supports only one LDAP provider. For initial user-sync you can sync with one LDAP server, and then change settings and sync with the other. However, for subsequent user-syncs Ranger will use only the single LDAP server currently set.

pminovic · ‎05-19-2016

@mark doutre I've just found a new blog post talking about your use-case of storing Avro schema-less objects in HBase. It's implemented by direct interaction with HBase, without Hive. The code appears to be simple. HTH

pminovic · ‎05-19-2016

Hi @Stephen Redmond, sorry I missed your comment. No, haven't done tests with compression. I'll let you know if I find something. Also, you can file a question on HCC, copying your comment, to get wider attention. Tnx.

pminovic · ‎05-19-2016

Hi @darkz yu, you need to perform the so-called Takeover by Ambari, check this for your options. The easiest way to do it, provided you don't have a lot of data is a variant of option 1 from that post, meaning to export all important data from your current cluster, setup a new cluster using Ambari, and then import your data into new cluster. Note that you will need to export/import hdfs files, Hive tables, and HBase tables separately. If you want to do it keeping your data "in place" then you can consider options 2 and 3: takeover using Ambari REST API, or by using a dummy cluster. Both are more complicated than option 1.

pminovic · ‎05-19-2016

Hi @mike pal, have you resolved this? As Artem suggested you can put it in your workflow lib directory. You can also put it in Oozie Hive share lib directory, or in your home directory in hdfs and declare its location using <job-xml> tag in your workflow.

Online	Offline
Last Visited	‎08-19-2019 01:20 AM

Member Since	‎09-24-2015 04:02 AM
Last Visited	‎08-19-2019 01:20 AM
Posts	816
Kudos received	481

Cloudera Community

Re: datanode + Error occurred during initializatio...

Re: Problem when Distcp between two HA Cluster.

Re: Beeline over KNOX fails with HTTP Response co...

Re: What does nclients option of performance evalu...

Re: missing directories in ambari installation pac...

Re: What causes a datanode to consider a volume as...

Re: What causes a datanode to consider a volume as...

Re: Cannot sync-ldap Ambari

Cannot sync-ldap Ambari

Re: KNOX multiple path via Ambari

Re: Can multiple LDAP servers be configured on apa...

Re: Unable to access Avro object in HBase from Hiv...

Re: Troubleshooting Kafka Upgrade

Re: Can ambari manage an exists hadoop cluster an ...

Re: in Sqoop oozie Action hive-site.xml what locat...