Re: HIVE Metastore HA (High Availability) MariaDB

achandra · ‎07-02-2018

I will try this @Sindhu and shall confirm.

achandra · ‎07-01-2018

Could you provide steps to enable high availability for HIVE Metastore with MariaDB. Please let me know how to specify new database node name in addition to existing one in HIVE configs of Ambari.

achandra · ‎07-01-2018

@mqureshi @sunile.manjee @Max Marwan What did you specify against DB in Hive configs in ambari? Can we specify the database nodes separated by semi colon? Can you add steps of doing that as well please.

achandra · ‎07-01-2018

@naveen sangam I have the same question. How did you do it finally?

achandra · ‎06-27-2018

I have an expression like HA^G^FER$$JY I would like to replace the all ^ with $. How do I do it. I tried all methods but this isn't working. Most common error I get is : java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask

achandra · ‎06-25-2018

How to set up common URL for MYSQL HA against AMBARI DB, HIVE DB etc. I read about VIP but how to implement that?

achandra · ‎06-25-2018

Also please let me know if we can have a common URL to automatically resolve the active MYSQL node. @jigar.patel

achandra · ‎06-25-2018

Can you please provide me the actual working steps then. I need to enable MYSQL HA for my cluster here. @Shawn Weeks

achandra · ‎06-25-2018

Can you please provide me the steps for enabling high availability of MYSQL DB. I tried to follow: https://community.hortonworks.com/articles/92023/high-availability-for-mysql-database.html But the comments says this may not be the right method.

achandra · ‎06-25-2018

Doe this actually work. I have to do this in my current organization.

achandra · ‎06-19-2018

How to assign privileges to a group when it is created?

achandra · ‎05-29-2018

All this while I have been using hive 1.5 and it has been working fine. I recently enabled hive view 2 but its acting differently.First its very very slow. When I choose a database it comes up after a minute or two. Sometimes it gives me a message on the browser that the webpage is taking too much memory.Even when I type queries the words I type takes a long time to appear. What could be the issue. Just to ensure, I have all queries working fine using beeline or hive view 1.5. Its just that I have all these issues with hive view 2.0.

achandra · ‎05-29-2018

do you have any update. I am facing the same problem. @Neha Nirmal

achandra · ‎05-23-2018

Thats a good point. I would like to restrict save for all users. Can you tell me what needs to be manipulated to disable it.

achandra · ‎05-23-2018

I am not tlking about the saved queries. I am saying about the query results itself. There is a option to download the results to HDFS / csv. I don't want my user to do that. I would want to restrict them from downloading any production data results.

achandra · ‎05-23-2018

I have a hive view user and wouldn't want him to save the query results. How should I go about restricting him from doing it.

achandra · ‎05-16-2018

So I identified that this is a bug which they will fix only in HDP 3. Looks like there is work around which worked on HDP 2.6.0 but it stopped working in 2.6.1. I upgraded my stack to 2.6.2 and it works fine now.

achandra · ‎05-16-2018

This can happen if spark1 and spark2 are both running on same node.Try to kill the process. Then delete the service and add it to a separate node.It must work.

achandra · ‎05-04-2018

I have a requirement where I need to move the Ranger logs accumulated in HDFS to Amazon S3. How can I make this work. Alternately can I accumulate the logs in S3 itself going forward. Is that an option?

achandra · ‎04-27-2018

Thanks @vperiasamy for your input. I have some questions: 1. how do I pass a condition like requestUser<>hive, so it gives me information of all other user except hive. 2. This being in JASON format, I assume I may have to pass it to a visualization tool to make it presentable. Right? 3. Is there a provision within Ranger where I can embed this so I can see it like a dashboard.

achandra · ‎04-27-2018

I get the following error: <?xml version="1.0" encoding="UTF-8"?> <response> <lst name="responseHeader"><int name="status">400</int><int name="QTime">1</int></lst><lst name="error"><lst name="metadata"><str name="error-class">org.apache.solr.common.SolrException</str><str name="root-error-class">org.apache.solr.parser.ParseException</str></lst><str name="msg">org.apache.solr.search.SyntaxError: Cannot parse 'evtTime:[* TO NOW- 7DAYS]': Encountered " <RANGE_GOOP> "7DAYS "" at line 1, column 19. Was expecting one of: "]" ... "}" ... </str><int name="code">400</int></lst>

achandra · ‎04-26-2018

We would like to use ranger audit to HIVE to track HIVE View user activity alone. Currently when I enable Ranger Plug in for Hive it logs activity of all Hive users. Predominantly, I see the access log of edge node user the most since thats used to run the scheduled jobs.We have around 20 HIVE View users and it becomes difficult for me to add each of these users in filter to get their results. Here is what I am thinking.Either of these options will help me: 1. Can I modify the solr query to isolate the edge node user? 2. Can I filter the results by saying "User <> edgenodeuser" 3. Can I create a custom ranger audit report. But how? Thanks, Abhi

achandra · ‎04-26-2018

Thank you so much!!

achandra · ‎04-19-2018

@Rodrigo Rondena I am having the same problem. There is full access but still I get an error with having a temporary function. Please let me know what else I can try. I was also not able to find the JIRA that @jbarnett mentioned. , @Rodrigo RondenaWere you able to find a solution? I have the same problem.

Online	Offline
Last Visited	‎07-02-2018 08:43 PM

Date Registered	‎04-19-2018 03:31 PM
Last Visited	‎07-02-2018 08:43 PM
Total Messages Posted	24

Re: HIVE Metastore HA (High Availability) MariaDB

HIVE Metastore HA (High Availability) MariaDB

Re: How HIVE metastore HA work

Re: How to configurate available MySQL HA (Maste...

How to use regexp_replace in hive to remove specia...

How to set up common URL for MYSQL HA against AMBA...

Re: High Availability for MySQL Database

Re: High Availability for MySQL Database

Enabling High Availability OF MYSQL DB

Re: High Availability for MySQL Database

Re: Ambari API calls for creating Ambari Local Use...

hive view 2.0 very slow

Re: Ambari Hive View queries either failing or slo...

Re: How to restrict saving results of queries in H...

Re: How to restrict saving results of queries in H...

How to restrict saving results of queries in HIVE ...

Re: Ranger permissions to create temporary functio...

Re: Spark2 Thrift Server not start on ambari clust...

Moving Ranger HDFS Logs to S3

Re: Ranger SOLR Access log to only contain activit...

Re: How to delete Solr collections data beyond 7 d...

Ranger SOLR Access log to only contain activity of...

Re: Solr TTL - Auto-Purging Solr Documents & Range...

Re: Ranger permissions to create temporary functio...