question I am using Both hive CLI and Beeline CLI. Beeline CLI much slower than Hive CLI ..what is reason? in Archives of Support Questions (Read Only)

I am using Both hive CLI and Beeline CLI. Beeline CLI much slower than Hive CLI ..what is reason?

dev143786 — Fri, 16 Sep 2022 10:30:43 GMT

Hi Myself Devendra Bhumarapu,

Recently We have upgraded to from Hive CLI to Beeline CLI with Hive Server2. While Querying on both Beeline CLI much slower than the Hive CLI. Though Beeline CLI advanced version of Hive We need to look into speed.I dont know the what is the exact reason behind that.. Please share your thoughts.

Thanks,

Devendra B

Re: I am using Both hive CLI and Beeline CLI. Beeline CLI much slower than Hive CLI ..what is reason

mszurap — Mon, 08 Aug 2016 15:16:49 GMT

Hello Devendra,

Beeline is just a thin JDBC client to access HiveServer2. HS2 does the same thing which Hive CLI should - to submit the Hive query as a MR job. So the YARN / MR job execution times should be the same.

There can be more factors what could influence the speed of the query through HiveServer2, but most of the time it comes to one of these:

- HS2 host is overloaded (see top output for example)

- HiveServer2 java heap is too small and JVM needs to GC too many time. Thus it cannot process the query as fast as it would be optimal (look up HS2 java heap settings, look at GC times after enabling GC logging)

- HiveServer2 needs to run more complex queries at the same time, but only one query can be compiled at a time which can be a bottleneck. You can exclude it if you do your performance tests in a quite time, or take a stack trace collection while this is slow.

Hope this helps a bit.

Miklos Szurap

Customer Operations Engineer, Cloudera

Re: I am using Both hive CLI and Beeline CLI. Beeline CLI much slower than Hive CLI ..what is reason

dev143786 — Tue, 09 Aug 2016 06:56:58 GMT

Thanks Miklos Szurap

your information helped much

Re: I am using Both hive CLI and Beeline CLI. Beeline CLI much slower than Hive CLI ..what is reason

Vennila — Mon, 05 Feb 2018 12:35:01 GMT

So what will be the solution, Is there any configuration changes we can make to speed up the beeline CLI?