Member since
10-02-2015
51
Posts
34
Kudos Received
12
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2383 | 08-23-2016 10:31 PM | |
2006 | 08-23-2016 08:59 PM | |
10180 | 08-22-2016 08:49 PM | |
3836 | 06-30-2016 10:59 PM | |
11937 | 06-27-2016 06:15 PM |
01-07-2016
04:22 PM
3 Kudos
Given your initial request that you had, you can expand the fields which are returned by adding fields=* This will add a new field called "maintenance_state". So then we have the request /api/v1/clusters/tech_hdp/alerts?fields=*&Alert/state=CRITICAL From here we can filter out the ones with a maintenance state of ON, (returning only those with maintenance mode off) /api/v1/clusters/tech_hdp/alerts?fields=*&Alert/state=CRITICAL&Alert/maintenance_state=OFF I found this info on the API reference https://github.com/apache/ambari/blob/trunk/ambari...
... View more
01-07-2016
01:37 PM
Performance really isn't slow when executing the query. This is interesting. I figured that because the query had utilized the CBO in the tutorial I linked in the original question that it would still work now. I guess my thinking is incorrect?
... View more
01-06-2016
03:15 PM
Thanks Andrew! I did not know that. I probably should have done some digging myself to figure that out. However I'm still having issue when I run an EXPLAIN and it says my query is not optimized by CBO. See my comment to @Deepesh's response
... View more
01-06-2016
02:26 PM
@Andrew Grande, Thank you I saw that it was enabled in my settings After running both ANALYZE queries, I attempt to execute an EXPLAIN on the query I'm trying to run. -- Ran these first
analyze table hvac_orc compute statistics;
analyze table hvac_orc compute statistics for columns;
-- Then ran this one
EXPLAIN select buildingid, max(targettemp-actualtemp) from hvac_orc group by buildingid;
However when I do this and read the results, it still says CBO is not on, and I see this specific line in the results: Statistics:Num rows: 4001 Data size: 116289 Basic stats: COMPLETE Column stats: NONE
... View more
01-05-2016
05:03 PM
I'm following a tutorial on the Hortonworks site, http://hortonworks.com/hadoop-tutorial/superchargi... I'm wondering if it is possible to get the CBO working. I've tried setting the 4 params and getting the table stats, but for some reason I'm getting an error which looks like: org.apache.ambari.view.hive.client.HiveErrorStatusException: H110 Unable to submit statement. Error while processing statement: Cannot modify set hive.cbo.enable at runtime. It is not in list of params that are allowed to be modified at runtime [ERROR_STATUS] I get the error across 3 different params. How do I get the CBO working?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hive
12-29-2015
01:42 PM
1 Kudo
The part of the tutorial in question has been updated.
... View more
12-08-2015
11:36 PM
5 Kudos
I would take a look at the Apache Ambari API reference. I think that this link might be of use: https://github.com/apache/ambari/blob/trunk/ambari... For a list of all configurations to the API you could make a call similar to the following GET /api/v1/clusters/cluster/configurations Then if you wanted to get all of the configuration versions for Hive you could make the call to GET /api/v1/clusters/cluster/configurations?type=hive-site And from that list if you picked one of the versions you would make a call like: /api/v1/clusters/Sandbox/configurations?type=hive-site&tag=version1447446748723 The response would look something like: {
"href" : "http://localhost:8080/api/v1/clusters/Sandbox/configurations?type=hive-site&tag=version1447446748723",
"items" : [
{
"href" : "http://localhost:8080/api/v1/clusters/Sandbox/configurations?type=hive-site&tag=version1447446748723",
"tag" : "version1447446748723",
"type" : "hive-site",
"version" : 4,
"Config" : {
"cluster_name" : "Sandbox",
"stack_id" : "HDP-2.3"
},
"properties" : {
"ambari.hive.db.schema.name" : "hive",
"atlas.cluster.name" : "Sandbox",
"atlas.hook.hive.synchronous" : "true",
"atlas.rest.address" : "http://sandbox.hortonworks.com:21000",
"datanucleus.autoCreateSchema" : "false",
"datanucleus.cache.level2.type" : "none",
"hive.auto.convert.join" : "true",
"hive.auto.convert.join.noconditionaltask" : "true",
"hive.auto.convert.join.noconditionaltask.size" : "357913941",
"hive.auto.convert.sortmerge.join" : "true",
"hive.auto.convert.sortmerge.join.to.mapjoin" : "false",
"hive.cbo.enable" : "true",
"hive.cli.print.header" : "false",
"hive.cluster.delegation.token.store.class" : "org.apache.hadoop.hive.thrift.ZooKeeperTokenStore",
"hive.cluster.delegation.token.store.zookeeper.connectString" : "sandbox.hortonworks.com:2181",
"hive.cluster.delegation.token.store.zookeeper.znode" : "/hive/cluster/delegation",
"hive.compactor.abortedtxn.threshold" : "1000",
"hive.compactor.check.interval" : "300s",
"hive.compactor.delta.num.threshold" : "10",
"hive.compactor.delta.pct.threshold" : "0.1f",
"hive.security.authorization.enabled" : "true",
"hive.security.authorization.manager" : "org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdConfOnlyAuthorizerFactory",
"hive.security.metastore.authenticator.manager" : "org.apache.hadoop.hive.ql.security.HadoopDefaultMetastoreAuthenticator",
"hive.security.metastore.authorization.auth.reads" : "true",
"hive.security.metastore.authorization.manager" : "org.apache.hadoop.hive.ql.security.authorization.StorageBasedAuthorizationProvider",
"hive.server2.allow.user.substitution" : "true",
"hive.server2.authentication" : "NONE",
"hive.server2.authentication.spnego.keytab" : "HTTP/_HOST@EXAMPLE.COM",
"hive.server2.authentication.spnego.principal" : "/etc/security/keytabs/spnego.service.keytab",
"hive.server2.enable.doAs" : "false",
"hive.server2.logging.operation.enabled" : "true",
"hive.server2.logging.operation.log.location" : "${system:java.io.tmpdir}/${system:user.name}/operation_logs",
"hive.server2.support.dynamic.service.discovery" : "true",
"hive.server2.table.type.mapping" : "CLASSIC",
"hive.server2.tez.default.queues" : "default",
"hive.server2.tez.initialize.default.sessions" : "false",
"hive.server2.tez.sessions.per.default.queue" : "1",
"hive.server2.thrift.http.path" : "cliservice",
"hive.server2.thrift.http.port" : "10001",
"hive.server2.thrift.max.worker.threads" : "500",
"hive.server2.thrift.port" : "10000",
"hive.server2.thrift.sasl.qop" : "auth",
"hive.server2.transport.mode" : "binary",
"hive.server2.use.SSL" : "false",
"hive.server2.zookeeper.namespace" : "hiveserver2",
"hive.smbjoin.cache.rows" : "10000",
"hive.stats.autogather" : "true",
"hive.stats.dbclass" : "fs", From this you can retrieve the correct property and it's value.
... View more
10-16-2015
04:58 PM
I suppose so? I was really just using it as a place holder. See screenshot in original question. That "trucks_stage" table, I was able to read and load from.
... View more
10-16-2015
04:45 PM
I think it's an issue with user permissions, but I don't know why I can still run commands like select * from table_name;
... View more
- « Previous
- Next »