Member since
01-09-2017
17
Posts
0
Kudos Received
0
Solutions
11-30-2017
07:55 AM
hdp 2.3 and hive 1.2 the hive.enforce.bucketing is default true What is the need to set?
... View more
11-30-2017
07:33 AM
my hdp is 2.3 hive 1.2 sql union all itself use tez and orc is right bug use mr is 0 this is my ddl CREATE TABLE `test.web`
( `id` string , `uid` string , `user_id` int )
PARTITIONED BY (`p_date` string)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t'
COLLECTION ITEMS TERMINATED BY ','
MAP KEYS TERMINATED BY ':'
LINES TERMINATED BY '\n'
NULL DEFINED AS ''
STORED AS ORC
TBLPROPERTIES('orc.compress'='SNAPPY') sql SELECT
count(*)
FROM
(
SELECT
id,
user_id
FROM
test.web
WHERE
p_date = 20171129
AND user_id > 0
UNION ALL
SELECT
id,
user_id
FROM
test.web
WHERE
p_date = 20171129
AND stat_id = 'adm'
AND user_id > 0
) a hive 1.2 hive.enforce.bucketing default is true Do need other parameters?
... View more
11-30-2017
07:24 AM
hive 1.2 hive.enforce.bucketing default is true Do need other parameters?
... View more
11-30-2017
07:20 AM
my hdp is 2.3 hive 1.2 sql union all itself use tez and orc is right bug use mr is 0 this is my ddl CREATE TABLE `test.web`
( `id` string , `uid` string , `user_id` int )
PARTITIONED BY (`p_date` string)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t'
COLLECTION ITEMS TERMINATED BY ','
MAP KEYS TERMINATED BY ':'
LINES TERMINATED BY '\n'
NULL DEFINED AS ''
STORED AS ORC
TBLPROPERTIES('orc.compress'='SNAPPY') sql SELECT
count(*)
FROM
(
SELECT
id,
user_id
FROM
test.web
WHERE
p_date = 20171129
AND user_id > 0
UNION ALL
SELECT
id,
user_id
FROM
test.web
WHERE
p_date = 20171129
AND stat_id = 'adm'
AND user_id > 0
) a
can help me ??
... View more