question Re: HAWQ VS HIVE in Support Questions

HAWQ VS HIVE

avinashrpds7 — Fri, 27 May 2016 19:37:20 GMT

If we have to compare SQL tools on HDFS : HAWQ vs HIVE, for a Data-Lake of size 400+TB(Without replication) semi structured machine data. Which is preferable ? How will HIVE perform ? Pros and Cons of using HIVE compared to HAWQ.

Note : Right now we are on older version of HAWQ .This is very unstable and are evaluating options.

Re: HAWQ VS HIVE

rajkumar_singh — Fri, 27 May 2016 19:42:42 GMT

This is a nice post comparing hive on mr,tez vs HAWQ

https://www.pivotalguru.com/?p=956

hope it will help you.

Re: HAWQ VS HIVE

bandarusridhar1 — Fri, 27 May 2016 21:04:04 GMT

@Avinash P

Below link might help you more

https://blog.pivotal.io/big-data-pivotal/products/pivotal-hawq-benchmark-demonstrates-up-to-21x-faster-performance-on-hadoop-queries-than-sql-like-solutions

Re: HAWQ VS HIVE

ravi1 — Fri, 27 May 2016 23:20:46 GMT

Whenever you are trying to evaluate Hive on Tez vs any other tool and this is for data analytics (with row level update/access patterns), my suggestion is to start with hive, use all the right tunings at OS, Cluster and Hive level, use ORC, bloom filters, organize your data and see if query times hit your SLA.

We have a seen at a lot of places that once they tune hive correctly and move away from text files they will hit SLAs. You can then look at other tools if and when your SLAs are not met.

Re: HAWQ VS HIVE

avinashrpds7 — Mon, 30 May 2016 21:12:26 GMT

Thank you Ravi. Just checking ,

Have you ever seen HIVE and HAWQ in single environment ?

Did any of the customers you worked , moved away from HIVE to HAWQ and what where there reasons to do?

Re: HAWQ VS HIVE

avinashrpds7 — Mon, 30 May 2016 21:15:28 GMT

Thank you Raj.. How had been your experience with HAWQ ? Do you recommend HAWQ/Hive ? Are you using latest version of HAWQ and how is it working ?

Re: HAWQ VS HIVE

avinashrpds7 — Mon, 30 May 2016 21:19:25 GMT

Thank you Sri.. How had been your experience with HAWQ ? Do you recommend HAWQ/Hive ? Are you using latest version of HAWQ and how is it working ? what do you recommend ?

Re: HAWQ VS HIVE

fmcquillan — Tue, 12 Jul 2016 00:26:34 GMT

For folks interested in data science, HAWQ supports Apache MADlib (incubating) http://madlib.incubator.apache.org/ which is a mature, distributed, in-database machine learning library. Hive does not have an integrated machine learning capability at the current time.