Member since
05-09-2016
421
Posts
54
Kudos Received
32
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2506 | 04-22-2022 11:31 AM | |
2255 | 01-20-2022 11:24 AM | |
2126 | 11-23-2021 12:53 PM | |
2854 | 02-07-2018 12:18 AM | |
4695 | 06-08-2017 09:13 AM |
11-04-2019
11:36 PM
You need to stop ambari metrics service via ambari and then remove all temp files. Go to Ambari Metrics collector service host. and execute the below command. mv /var/lib/ambari-metrics-collector /tmp/ambari-metrics-collector_OLD Now you can restart ams service again and now you should be good with Ambari Metrics.
... View more
02-08-2018
05:53 AM
@Pee Tankulrat, As Rahul mentioned you need to make sure that policy is not failing back to POSIX permission. And for group policy issue, you may ask another question with more details.
... View more
06-04-2017
06:53 AM
Hi @Chandan Kumar Can you elaborate when you say loading file. What exactly are you doing?
... View more
05-25-2017
07:52 PM
1 Kudo
Currently ranger does not support defining password of default admin users(rangerusersync and rangertagsync) during installation.
This is a security concern if you miss to update the password post installation as default password for these users is same as username, thereby compromising admin access to ranger.
There is plan to address this in future HDP release by allowing to define the passwords for admin users during installation, however for the time being below workaround can be used to enforce password policy.
Once ranger installation is successful one can use below rest api get and put command to change the password of any user.
This is helpful in case of automated cluster installation using ambari blueprint.
To change the password of the user first get the user details using below call: curl -s -u admin:admin -H "Accept: application/json" -H "Content-Type: application/json" -X GET http://h2.openstacklocal:6080/service/xusers/users/2
You will get something like this. {"id":2,"createDate":"2017-05-24T17:36:49Z","updateDate":"2017-05-25T08:09:25Z","owner":"Admin","updatedBy":"Admin","name":"rangerusersync","firstName":"rangerusersync","lastName":"","password":"*******","description":"rangerusersync","groupIdList":[],"groupNameList":[],"status":1,"isVisible":1,"userSource":0,"userRoleList":["ROLE_SYS_ADMIN"]}
Now send the PUT request with the above information after setting required password as give below: curl -iv -u admin:admin -X PUT -H "Accept: application/json" -H "Content-Type: application/json" http://h2.openstacklocal:6080/service/xusers/secure/users/2 -d '{"id":2,"createDate":"2017-05-24T17:36:49Z","updateDate":"2017-05-25T08:09:25Z","owner":"Admin","updatedBy":"Admin","name":"rangerusersync","firstName":"rangerusersync","lastName":"","password":"Password@123","description":"rangerusersync","groupIdList":[],"groupNameList":[],"status":1,"isVisible":1,"userSource":0,"userRoleList":["ROLE_SYS_ADMIN"]}'
PS : To change password of keyadmin user, use keyadmin credentials in REST api call. Thanks @Ronak bansal for testing this.
... View more
Labels:
02-12-2019
07:02 AM
@Priyanka This is a closed thread (2017) can you open a new one and copy past this content.
... View more
03-21-2017
09:46 AM
SYMPTOM
Concurrency issues hit during multi-threaded moveFile issued when processing queries such as "INSERT OVERWRITE TABLE ... SELECT .."
The following pattern is displayed in stack trace: Loading data to table testdb.test_table from hdfs://xyz/ra_hadoop/.hive-staging_hive_2017-01-31_14-09-52_561_8101886747064006778-4/-ext-10000
ERROR : Failed with exception java.util.ConcurrentModificationException
org.apache.hadoop.hive.ql.metadata.HiveException: java.util.ConcurrentModificationException
at org.apache.hadoop.hive.ql.metadata.Hive.moveFile(Hive.java:2883)
at org.apache.hadoop.hive.ql.metadata.Hive.replaceFiles(Hive.java:3140)
at org.apache.hadoop.hive.ql.metadata.Hive.loadTable(Hive.java:1727)
at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:353)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:89)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1745)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1491)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1289)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1156)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1151) ROOT CAUSE This issue occurs because of issue described in HIVE-15355.
WORKAROUND
Set the following property at the client side: set hive.mv.files.thread=0;
Re-run the hive query Note: The fix for HIVE-15355 is expected to be included in the next major release of HDP.
... View more
03-20-2017
05:11 PM
Yes, One way SSL is possible from HDP-2.5.0 https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.0/bk_release-notes/content/patch_ranger.html
... View more
12-28-2016
12:22 PM
1 Kudo
Check auth_to_local rules for Atlas. In many installation there exist invalid rule like below: RULE:[1:$1@$0](.*@EXAMPLE.COM)s/@.*// After removing above rule Atlas UI will work fine.
... View more
Labels:
08-31-2016
04:51 PM
Hi David, I encounter the same "nifi.processors.hadoop.PutHDFS" error because of "Failed to specify server's Kerberos principal name;" Which "Hadoop Configuration Files" have you modified, and what did you added to that file? Could you please shed some light on this issue? Thanks in advance! arvin
... View more
11-17-2017
05:54 PM
I had the same problem and I also solve it adding the user to all controler nodes. Run a script for add them from on_to_all ______________________________________________________________________________________________ #!/bin/bash # Linux/UNIX box with ssh key based login SERVERS=/root/hadoop_hosts # SSH User name USR="root" # Email SUBJECT="Server user login report" EMAIL="your_e-mail@here" EMAILMESSAGE="/tmp/sshpool_`date +%Y%m%d-%H:%M`.txt" # create new file >$EMAILMESSAGE # connect each host and pull up user listing for host in `cat $SERVERS` do echo "--------------------------------" >>$EMAILMESSAGE echo "* HOST: $host " >>$EMAILMESSAGE echo "--------------------------------" >>$EMAILMESSAGE ###ssh $USR@$host w >> $EMAILMESSAGE ssh -tq -o "BatchMode yes" $USR@$host $1 >> $EMAILMESSAGE done # send an email using /bin/mail ######/bin/mailx -s "$SUBJECT" "$EMAIL" < $EMAILMESSAGE echo ">>>>>>>>>>>>>>>>>>>>>>>>>>><<<<<<<<<<<<<<<<<<<<<<<<<<<<" echo ">>> check the output file " $EMAILMESSAGE _________________________________________________________________________________________ put DNS servers names into /root/hadoop_hosts Also in linux there is a good command called pssh to run comands in parallel in computer clusters 🙂
... View more