question Re: Getting error while loading Druid over Hive in Support Questions

Getting error while loading Druid over Hive

burak_bicen — Fri, 16 Sep 2022 12:19:08 GMT

Hi All,

I am testing Druid with Hive2 and managed to push sample data (1.5M aggregated rows) the way described, but when I try to build a dataset with 192M rows, I got error ArrayIndexOutOfBoundsException at io.DruidRecordWriter. I searched Hive Jira and it is a bug that is resolved, but I understand this is not applied on HDP 2.6.2 that I am using. Is there any workaround?

Thanks

Re: Getting error while loading Druid over Hive

sbouguerra — Fri, 29 Sep 2017 21:54:14 GMT

The only fix is to apply the patch and replace the druid-hive-handler jar. It is only one jar that needs to be replaced. Otherwise 2.6.3 will have the fix if you want to wait. Sorry

Re: Getting error while loading Druid over Hive

burak_bicen — Mon, 02 Oct 2017 14:58:13 GMT

I replaced every hive-druid-handler*.jar in my cluster with the new version, but now I am getting "org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException: cache" error. I think I will have to wait for 2.6.3 and hope it will work.

Re: Getting error while loading Druid over Hive

sbouguerra — Mon, 02 Oct 2017 20:58:57 GMT

can you please past the log error stack?

Re: Getting error while loading Druid over Hive

burak_bicen — Mon, 02 Oct 2017 22:04:14 GMT

Thanks @Slim. I'm attaching one task's log. hive-20171002172650-1672cd6f-dec7-46ca-bb45-f52491.txt.

Re: Getting error while loading Druid over Hive

sbouguerra — Mon, 02 Oct 2017 22:27:30 GMT

seems like you are compiling/building with the wrong druid version. Can you please explain how are you building this? are you using druid 0.10.1 or previous release?

Re: Getting error while loading Druid over Hive

burak_bicen — Wed, 04 Oct 2017 13:29:45 GMT

@Slim

I am using HDP 2.6.2 and the installed version of Druid is 0.9.2. Is there any way to upgrade Druid while bypassing Ambari?

Re: Getting error while loading Druid over Hive

jsensharma — Wed, 04 Oct 2017 13:39:56 GMT

@Burak Bicen

I will suggest opening a separate thread will be more useful. As this is slightly unrelated question to this thread. Even though the topic is related to Druid. That way you might get more accurate response.