Member since
08-06-2019
9
Posts
0
Kudos Received
0
Solutions
08-06-2019
02:04 AM
Hi All,
We are using CDH 5.14.4 and we hit https://issues.apache.org/jira/browse/HIVE-9862. Is this bug fixed in 5.15 or 5.16 ? I could not find in fixed issues.
... View more
Labels:
12-16-2017
12:27 PM
Hi all, We are using azkaban as job scheduler and trying to run a sqoop job by passing mapreduce.job.credentials.binary. Given token blongs to a user called testi and azkaban is running as azkaban user with proxy user privileges. Below is sqoop command sqoop import -D mapreduce.job.credentials.binary=${HADOOP_TOKEN_FILE_LOCATION} --verbose --driver com.mysql.jdbc.Driver --connect "jdbc:mysql://ahdp22/temp?useUnicode=true&characterEncoding=UTF-8&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false" --username temp --password temp --table people --fetch-size 10000 --target-dir /user/testi/people_avro --as-avrodatafile --compression-codec snappy -m 1 but it does not work. It still trying to run as azkaban. Do you have any idea?
... View more
Labels:
10-10-2017
08:35 PM
Hi all, I want to know which operations are atomic in hive without using hive acid/transactions. I can understand that insert into overwrite is easy to make atomic since directory rename and move operations on hdfs are atomic. But for example is inserting data to existing table atomic? Since if we have multiple files as a result of a select (."insert into table A select * from B") and if operation crash in the middle of multiple file move we see half of the data. We can create a single file at the end of select but this require a single reducer. Also dynamic partition insertions? Thank you...
... View more
Labels:
05-03-2017
10:33 PM
Thank you vperiasamy
... View more
04-24-2017
04:12 PM
Hi @vperiasamy, Thank you for quick response. We are using 2.5.3. In the mean time, is this information still correct for ambari enabled plugins: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_security/content/hdfs_plugin_kerberos.html What I understand, ambari making this config automatically? Am I correct?
... View more
04-24-2017
03:44 PM
Hi All, I dont understand what (ranger_admin_username)"amb_ranger_admin" user is for? I enabled kerberos on my cluster and installed ranger. Everything is working very well. I changed "ranger_admin_username" value to some meaningless value but it is still working. So is ranger_admin_username still a relevant property in a kerberos enabled cluster? In the mean time there is no "amb_ranger_admin" in ambari internal users as well. It was not created by ambari or ranger.
... View more
Labels:
04-18-2017
11:30 AM
Hi Frank, Here is my configuration: id output of bilgin user from shell: id bilgin
uid=908601104(bilgin) gid=908603108(hadoopgroup) groups=908603108(hadoopgroup),908600513(domain users) another example: id ol889372
uid=908602857(ol889372) gid=908600513(domain users) groups=908600513(domain users),908603108(hadoopgroup) As you can see ranger takes user groups except primary group(hadoopgroup in case of user bilgin and "domain users" in case of ol889372). In the mean time we are using windows 2012 server. Thank you in advance..
... View more
04-17-2017
02:29 PM
Hi all, I am trying to implement our security integration with sssd and i could not make ranger to import users primary group from active directory. Our sssd configuration syncronizing groups of users correctly like uid=908602857(ol889372) gid=908600513(domain users) groups=908600513(domain users),908603108(hadoopgroup) But ranger could not get "domain users" group from active directory since it is the primary group. Any idea how to make it work?
... View more
Labels: