Member since
05-30-2018
1322
Posts
715
Kudos Received
148
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 4032 | 08-20-2018 08:26 PM | |
| 1933 | 08-15-2018 01:59 PM | |
| 2365 | 08-13-2018 02:20 PM | |
| 4094 | 07-23-2018 04:37 PM | |
| 5002 | 07-19-2018 12:52 PM |
06-03-2016
03:14 PM
I assume restarted oozie?
... View more
06-03-2016
01:20 PM
1 Kudo
@Sagar Shimpi You may need to enable proxyuser. User ProxyUser Configuration Oozie supports impersonation or proxyuser functionality (identical to Hadoop proxyuser capabilities and conceptually similar to Unix 'sudo'). Proxyuser enables other systems that are Oozie clients to submit jobs on behalf of other users. Because proxyuser is a powerful capability, Oozie provides the following restriction capabilities (similar to Hadoop):
Proxyuser is an explicit configuration on per proxyuser user basis. A proxyuser user can be restricted to impersonate other users from a set of hosts. A proxyser user can be restricted to impersonate users belonging to a set of groups. There are 2 configuration properties needed to set up a proxyuser:
oozie.service.ProxyUserService.proxyuser.#USER#.hosts: hosts from where the user #USER# can impersonate other users. oozie.service.ProxyUserService.proxyuser.#USER#.groups: groups the users being impersonated by user #USER# must belong to. Both properties support the '*' wildcard as value. Although this is recommended only for testing/development.
... View more
06-02-2016
07:31 PM
@Manoj Dhake please advise if I have answered your question.
... View more
06-01-2016
06:06 PM
@Manoj Dhake as long as the those dates are within the partition range then yes it will only query the partition. the CBO will help make that determination.
... View more
06-01-2016
05:26 PM
@Manoj Dhake Partition Based Queries In general, a SELECT query scans the entire table (other than for sampling). If a table created using the PARTITIONED BY clause, a query can do partition pruning and scan only a fraction of the table relevant to the partitions specified by the query. Hive currently does partition pruning if the partition predicates are specified in the WHERE clause or the ON clause in a JOIN. For example, if table page_views is partitioned on column date, the following query retrieves rows for just days between 2008-03-01 and 2008-03-31. SELECT page_views.*
FROM page_views
WHERE page_views.date >= '2008-03-01' AND page_views.date <= '2008-03-31'
If a table page_views is joined with another table dim_users, you can specify a range of partitions in the ON clause as follows: SELECT page_views.*
FROM page_views JOIN dim_users
ON (page_views.user_id = dim_users.id AND page_views.date >= '2008-03-01' AND page_views.date <= '2008-03-31' )
See also Group By. See also Sort By / Cluster By / Distribute By / Order By.
... View more
06-01-2016
01:53 AM
1 Kudo
@Ryan Cicak natively through ambari I am not aware of this feature. However, ambari use a backend db of your choice and from there you can set lockout at the db level. for example if you have oracle or postgres db as the backend for ambari, can can specify number of attempts before lock out. This will need to be tested. On the other hand it may not work since you may have to do a ambari server reset after the password has been changed. Since that is the case I believe the password may be store in memory. In that case then no work around for too many attempts I know of.
... View more
05-27-2016
01:40 AM
@Timothy Spann @Artem Ervits I got confirmation Pig CAN NOT load directly into HAWQ. it is not supported.
... View more
05-26-2016
03:03 PM
How do I set parameters for hive in sparksql context? For example I have a hive table which I want to query from sparksql. I want to set the following parameter mapred.input.dir.recursive=true To read all directories recursively. How to set this in spark context?
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Spark
05-24-2016
09:11 PM
@Practise Hadoop can you try with 1.3.7 serde?
... View more
05-24-2016
03:53 PM
@Constantin Stanca what do you mean by "Additionally, you need to start the JVM with something like this in order to be able to truly access the JVM remotely"? JVM start as they normally do to use this tool.
... View more