Member since
05-09-2016
421
Posts
54
Kudos Received
32
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
961 | 04-22-2022 11:31 AM | |
584 | 01-20-2022 11:24 AM | |
636 | 11-23-2021 12:53 PM | |
1401 | 02-07-2018 12:18 AM | |
2918 | 06-08-2017 09:13 AM |
04-22-2022
11:31 AM
Hi @ToddP Can you try after setting below? set hive.vectorized.execution.enabled=false;
... View more
04-19-2022
09:39 AM
This error does not looks to be coming from Cloudera JDBC driver. This error is loading org.apache.hive.jdbc. Cloudera's driver name start with com.cloudera*
... View more
04-14-2022
03:46 PM
Hi Video KB you are following is more than 2 years old. Try using Cloudera JDBC driver for hive. You can download the latest driver and user guide from below links. https://www.cloudera.com/downloads/connectors/hive/jdbc/2-6-17.html https://docs.cloudera.com/documentation/other/connectors/hive-jdbc/2-6-17.html
... View more
04-05-2022
02:24 PM
Did you try the hint mentioned in ERROR? Try : <hiveserevr2 host>:10000/; Are you missing a '/' after the hostname
... View more
02-16-2022
08:16 AM
Hi @Priyanka26 I will recommend to get this checked using cloudera support case. LLAP configuration has lot of tuning options which is difficult to look at over community questions.
... View more
02-04-2022
01:47 PM
Hi @Priyanka26 The limit is coming from below setting. llap memory per daemon = 75 Gb
... View more
01-20-2022
11:24 AM
1 Kudo
Yes, there are lot of places to check but without knowing what are you looking for you will be lost. You can start with what you see on screen / console where you run the query. In beeline you see tez job summary which has lot of details to look at. example of one of the tuning guide is below https://community.cloudera.com/t5/Community-Articles/Demystify-Apache-Tez-Memory-Tuning-Step-by-Step/ta-p/245279 Update: I see you are using cdh6 which does not have tez. You can refer below link for cdh https://docs.cloudera.com/documentation/enterprise/6/6.1/topics/admin_hive_tuning.html#concept_u51_lkv_cv
... View more
01-20-2022
10:37 AM
1 Kudo
Hi Ulises, This is expected. When you do select * without any complex aggregation / function hive can directly read the data from hdfs / files But in case of count it need to do computation which involve creating job and doing the required aggregation which will take time.
... View more
12-08-2021
01:22 PM
Please check official mysql documentation as well. https://dev.mysql.com/doc/refman/5.7/en/log-file-maintenance.html
... View more
11-23-2021
12:53 PM
Hi @Andyjmoss As you already pointed https://community.cloudera.com/t5/Support-Questions/How-are-number-of-mappers-determined-for-a-query... There is no limit per query, you can only adjust max and min grouping size to play around on mapper tasks. Would this then impact the structure of data stored by my data? No this only affects how much data each map task will get.
... View more
06-23-2020
04:18 PM
Hi, Nifi is one of the options. See https://community.cloudera.com/t5/Support-Questions/Trouble-converting-JSON-to-AVRO-in-Nifi/td-p/202590
... View more
05-25-2018
12:18 AM
@Naresh Kumar Korvi Let me know if below works --columns \\\"column name\\\"
... View more
05-10-2018
07:33 PM
It was just for example. You can replace * with list of users separated by comma and then space and list of groups comma separated.
... View more
05-10-2018
03:58 AM
@Jarosław Gronowski You need to set tez.am.view-acls https://community.hortonworks.com/articles/73837/enable-the-specified-users-or-groups-to-tez-view-w.html
... View more
05-10-2018
03:32 AM
1 Kudo
@Abe Ram Check below link: https://stackoverflow.com/questions/32191260/beeline-equivalent-of-hive-silent-mode Basically add export HADOOP_CLIENT_OPTS="-Djline.terminal=jline.UnsupportedTerminal" before running beeline in background. https://issues.apache.org/jira/browse/HIVE-6758
... View more
05-10-2018
03:30 AM
@Carol Elliott Check this out https://stackoverflow.com/questions/32191260/beeline-equivalent-of-hive-silent-mode
... View more
05-09-2018
05:41 AM
Hi @Megh Vidani Not sure how your poc.test2 table looks like but I tried to create and insert into hive druid based table using wikiticker data and it worked fine. Note that hive-druid integration required hive Interactive and HDP 2.6+ I did my testing on HDP-2.6.4 Below are the queries which I executed. CREATE EXTERNAL TABLE druid_table_1
STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'
TBLPROPERTIES ("druid.datasource" = "wikiticker");
CREATE TABLE druid_table_2 STORED BY 'org.apache.hadoop.hive.druid.DruidStorageHandler' as select `__time`, channel, countryname, regionname from druid_table_1;
insert into table druid_table_2 select `__time`, channel, countryname, regionname from druid_table_1 where channel='#ca.wikipedia';
... View more
03-28-2018
10:56 PM
You need to figure out from where this malformed row is coming. You can check this in yarn application log.
... View more
03-28-2018
08:37 PM
Hi Robert, You have to follow something like this. https://community.hortonworks.com/articles/65914/how-to-add-ports-to-the-hdp-25-virtualbox-sandbox.html
... View more
03-28-2018
08:30 PM
@santhosh ch The issue here is with json file. Caused by: com.google.gson.JsonSyntaxException: java.lang.IllegalStateException: Expected a string but was BEGIN_ARRAY You can find the file in log which is malformed.
... View more
02-21-2018
02:11 AM
Hi @Fawze AbuJaber There is no strict requirement for naming convention for the servers. You can keep the hostname as per your convenience. Ambari by default do not provide single user mode like cloudera-scm user, you have to manually configure the user as per documents below. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_security/content/_how_to_configure_an_ambari_agent_for_non-root.html https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.0.0/bk_ambari-security/content/how_to_configure_ambari_server_for_non-root.html
... View more
02-07-2018
12:22 AM
@PJ Try running set hive.exec.stagingdir=<new location> before running your query.
... View more
02-07-2018
12:18 AM
1 Kudo
@Pee Tankulrat Also make sure that it is not failing back to POSIX permission. Remove all POSIX permission from the directory using hdfs dfs -chmod
... View more
06-30-2017
02:42 PM
Hi @Mahesh Thumar If you are using ambari then you can do this in Advanced gateway log4j Rahul
... View more
06-08-2017
09:13 AM
THis has been resolved by changing the apllication.properties to atlas-application.properties.
... View more
06-04-2017
06:53 AM
Hi @Chandan Kumar Can you elaborate when you say loading file. What exactly are you doing?
... View more
06-04-2017
06:48 AM
@JT Ng I suspect this can be issue with missing hive-site and tez-site. You can find more hint in yarn MR job log launched by oozie.
... View more
05-25-2017
07:52 PM
1 Kudo
Currently ranger does not support defining password of default admin users(rangerusersync and rangertagsync) during installation.
This is a security concern if you miss to update the password post installation as default password for these users is same as username, thereby compromising admin access to ranger.
There is plan to address this in future HDP release by allowing to define the passwords for admin users during installation, however for the time being below workaround can be used to enforce password policy.
Once ranger installation is successful one can use below rest api get and put command to change the password of any user.
This is helpful in case of automated cluster installation using ambari blueprint.
To change the password of the user first get the user details using below call: curl -s -u admin:admin -H "Accept: application/json" -H "Content-Type: application/json" -X GET http://h2.openstacklocal:6080/service/xusers/users/2
You will get something like this. {"id":2,"createDate":"2017-05-24T17:36:49Z","updateDate":"2017-05-25T08:09:25Z","owner":"Admin","updatedBy":"Admin","name":"rangerusersync","firstName":"rangerusersync","lastName":"","password":"*******","description":"rangerusersync","groupIdList":[],"groupNameList":[],"status":1,"isVisible":1,"userSource":0,"userRoleList":["ROLE_SYS_ADMIN"]}
Now send the PUT request with the above information after setting required password as give below: curl -iv -u admin:admin -X PUT -H "Accept: application/json" -H "Content-Type: application/json" http://h2.openstacklocal:6080/service/xusers/secure/users/2 -d '{"id":2,"createDate":"2017-05-24T17:36:49Z","updateDate":"2017-05-25T08:09:25Z","owner":"Admin","updatedBy":"Admin","name":"rangerusersync","firstName":"rangerusersync","lastName":"","password":"Password@123","description":"rangerusersync","groupIdList":[],"groupNameList":[],"status":1,"isVisible":1,"userSource":0,"userRoleList":["ROLE_SYS_ADMIN"]}'
PS : To change password of keyadmin user, use keyadmin credentials in REST api call. Thanks @Ronak bansal for testing this.
... View more
- Find more articles tagged with:
- How-ToTutorial
- Ranger
- Sandbox & Learning
- Security
Labels:
05-25-2017
10:01 AM
@subash sharma You can do it using below api. https://cwiki.apache.org/confluence/display/RANGER/REST+APIs+for+Policy+Management#RESTAPIsforPolicyManagement-Deletepolicy:
... View more
05-24-2017
05:14 PM
@Chavz Linde Check falcon.application.log. Are you doing this from ambari. Any error you see?
... View more