Hi all,   I have generated a query and the summary of Memory as below. Need your help to elaborate and how to read the summary. Thank you.   Query(9c4786bd80e8ed20:1caa788500000000): Limit=3.00 GB Reservation=0 ReservationLimit=2.40 GB OtherMemory=0 Total=0 Peak=520.47 MB ... View more

Hi all,   I am new to Hive, was told below parameter used to improve hive performance, if i were to set and run those code sequence as below, does the sequence matters and correlated to each other? Do we need to put up these code whenever run the query? Or execute once will be sufficient? Thanks.     Set hive.exec.parallel = true; set hive.vectorized.execution.enabled = true; set hive.vectorized.execution.reduce.enabled = true; set hive.cbo.enable=true; set hive.compute.query.using.stats=true; set hive.stats.fetch.column.stats=true; set hive.stats.fetch.partition.stats=true; set mapred.compress.map.output = true; set mapred.output.compress= true; SET hive.exec.dynamic.partition = true; SET hive.exec.dynamic.partition.mode = nonstrict; set hive.auto.convert.join = false; set hive.exec.max.dynamic.partitions=100000; set hive.exec.max.dynamic.partitions.pernode=10000;       ... View more

Hi folks,   Can I use the below script in Ozzie workflow?   WITH order_data (order_date, product_name, amount) AS ( SELECT   order_date,   product_name,   SUM(i.quantity * i.list_price * (1 - discount)) FROM sales.orders o INNER JOIN sales.order_items i   ON i.order_id = o.order_id INNER JOIN production.products p   ON p.product_id = i.product_id GROUP BY order_date,          product_name )   SELECT * FROM order_data; ... View more

Hi all,   Have hit a snag when trying to setup a Ozzie workflow with combination of CTE and Insert Statement, not sure why, please help me look at the code, thanks.     set hive.exec.dynamic.partition=true; set hive.exec.dynamic.partition.mode=nonstrict; insert into table A partition(date) with test as (select col1 as name1 , col2 as name2, col3 as name3 from table B), select * from test       ... View more